-- Logs begin at Fri 2022-08-12 00:35:53 UTC, end at Fri 2022-08-12 01:46:13 UTC. -- Aug 12 01:16:02.795815 dv-cinder-784815-15-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 12 01:16:02.803253 dv-cinder-784815-15-smb devstack@keystone.service[81540]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 12 01:16:02.805256 dv-cinder-784815-15-smb devstack@keystone.service[81540]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 12 01:16:02 2022] *** Aug 12 01:16:02.805256 dv-cinder-784815-15-smb devstack@keystone.service[81540]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 12 01:16:02.805256 dv-cinder-784815-15-smb devstack@keystone.service[81540]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 12 01:16:02.805256 dv-cinder-784815-15-smb devstack@keystone.service[81540]: nodename: dv-cinder-784815-15-smb Aug 12 01:16:02.805256 dv-cinder-784815-15-smb devstack@keystone.service[81540]: machine: x86_64 Aug 12 01:16:02.805256 dv-cinder-784815-15-smb devstack@keystone.service[81540]: clock source: unix Aug 12 01:16:02.805256 dv-cinder-784815-15-smb devstack@keystone.service[81540]: pcre jit disabled Aug 12 01:16:02.805256 dv-cinder-784815-15-smb devstack@keystone.service[81540]: detected number of CPU cores: 4 Aug 12 01:16:02.805256 dv-cinder-784815-15-smb devstack@keystone.service[81540]: current working directory: / Aug 12 01:16:02.805256 dv-cinder-784815-15-smb devstack@keystone.service[81540]: detected binary path: /usr/bin/uwsgi-core Aug 12 01:16:02.805256 dv-cinder-784815-15-smb devstack@keystone.service[81540]: your processes number limit is 47680 Aug 12 01:16:02.805256 dv-cinder-784815-15-smb devstack@keystone.service[81540]: your memory page size is 4096 bytes Aug 12 01:16:02.805256 dv-cinder-784815-15-smb devstack@keystone.service[81540]: detected max file descriptor number: 2048 Aug 12 01:16:02.805256 dv-cinder-784815-15-smb devstack@keystone.service[81540]: lock engine: pthread robust mutexes Aug 12 01:16:02.806199 dv-cinder-784815-15-smb devstack@keystone.service[81540]: thunder lock: enabled Aug 12 01:16:02.806199 dv-cinder-784815-15-smb devstack@keystone.service[81540]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 12 01:16:02.806199 dv-cinder-784815-15-smb devstack@keystone.service[81540]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 12 01:16:02.846874 dv-cinder-784815-15-smb devstack@keystone.service[81540]: Python main interpreter initialized at 0x55bb319f89c0 Aug 12 01:16:02.846874 dv-cinder-784815-15-smb devstack@keystone.service[81540]: python threads support enabled Aug 12 01:16:02.846874 dv-cinder-784815-15-smb devstack@keystone.service[81540]: your server socket listen backlog is limited to 100 connections Aug 12 01:16:02.846874 dv-cinder-784815-15-smb devstack@keystone.service[81540]: your mercy for graceful operations on workers is 90 seconds Aug 12 01:16:02.847279 dv-cinder-784815-15-smb devstack@keystone.service[81540]: mapped 403077 bytes (393 KB) for 2 cores Aug 12 01:16:02.847279 dv-cinder-784815-15-smb devstack@keystone.service[81540]: *** Operational MODE: preforking *** Aug 12 01:16:02.847591 dv-cinder-784815-15-smb devstack@keystone.service[81540]: *** uWSGI is running in multiple interpreter mode *** Aug 12 01:16:02.847591 dv-cinder-784815-15-smb devstack@keystone.service[81540]: spawned uWSGI master process (pid: 81540) Aug 12 01:16:02.847806 dv-cinder-784815-15-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 12 01:16:02.848535 dv-cinder-784815-15-smb devstack@keystone.service[81540]: spawned uWSGI worker 1 (pid: 81554, cores: 1) Aug 12 01:16:02.854138 dv-cinder-784815-15-smb devstack@keystone.service[81540]: spawned uWSGI worker 2 (pid: 81555, cores: 1) Aug 12 01:16:02.854138 dv-cinder-784815-15-smb devstack@keystone.service[81540]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 12 01:16:08.231543 dv-cinder-784815-15-smb devstack@keystone.service[81554]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 12 01:16:08.231543 dv-cinder-784815-15-smb devstack@keystone.service[81554]: from cryptography.utils import int_from_bytes Aug 12 01:16:08.232359 dv-cinder-784815-15-smb devstack@keystone.service[81554]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 12 01:16:08.232359 dv-cinder-784815-15-smb devstack@keystone.service[81554]: from cryptography.utils import int_from_bytes Aug 12 01:16:08.238804 dv-cinder-784815-15-smb devstack@keystone.service[81555]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 12 01:16:08.238804 dv-cinder-784815-15-smb devstack@keystone.service[81555]: from cryptography.utils import int_from_bytes Aug 12 01:16:08.239309 dv-cinder-784815-15-smb devstack@keystone.service[81555]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 12 01:16:08.239309 dv-cinder-784815-15-smb devstack@keystone.service[81555]: from cryptography.utils import int_from_bytes Aug 12 01:16:08.280614 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 12 01:16:08.280782 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 12 01:16:08.281009 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] command line args: [] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 12 01:16:08.281286 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 12 01:16:08.281452 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ================================================================================ {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 12 01:16:08.281777 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] admin_token = **** {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.282074 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] config_dir = [] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.282321 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.282528 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] config_source = [] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.282734 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] debug = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.282941 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.284082 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.284082 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.284082 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.284292 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.284412 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] list_limit = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.284613 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] log_config_append = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.284788 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.284990 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] log_dir = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.285211 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] log_file = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.285476 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.285775 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.286070 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.286383 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.286558 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.286716 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.286989 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.287263 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.287535 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.287786 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 12 01:16:08.287871 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.287995 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 12 01:16:08.288092 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.288174 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] command line args: [] {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 12 01:16:08.288373 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.288460 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 12 01:16:08.288619 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ================================================================================ {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 12 01:16:08.288697 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.288877 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] admin_token = **** {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.288967 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.289121 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] config_dir = [] {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.289307 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.289386 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.289490 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] config_source = [] {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.289666 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] debug = True {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.289874 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.289988 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.26/identity {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.290089 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] publish_errors = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.290180 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.290296 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.290381 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.290544 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.290628 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.290789 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.290873 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.291016 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] list_limit = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.291104 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.291249 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] log_config_append = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.291507 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.291677 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.291758 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] standard_threads = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.292097 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] log_dir = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.292202 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.292276 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] log_file = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.292490 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.292570 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.292696 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.292779 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.292898 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] use_journal = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.292982 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.293099 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] use_json = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.293214 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.293293 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] use_stderr = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.293393 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.293473 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] use_syslog = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.293569 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.293754 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.293836 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.294045 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.294149 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.294303 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.294401 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.294833 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.294995 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.295075 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.295285 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.295361 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.295531 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.295616 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.295775 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.295902 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.296046 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.296233 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.296537 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.26/identity {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.296623 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.296704 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] publish_errors = False {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.296931 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.297008 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.297156 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.297324 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.297403 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.297562 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.297645 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.297789 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.297866 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.298014 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] standard_threads = False {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.298092 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.298264 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.298345 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.298501 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.298588 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.298669 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.298742 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.298833 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] use_journal = False {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.298961 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.299045 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] use_json = False {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.299162 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] use_stderr = False {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.299250 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.299323 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] use_syslog = False {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.299450 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.299534 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 01:16:08.299689 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.299771 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.299919 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.299997 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.300165 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.300247 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.300417 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.300494 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.300666 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.300749 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.300910 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.300987 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.301136 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.301212 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.301396 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.301476 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.301572 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.301649 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.301800 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.301878 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.302048 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.302154 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.302305 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.302390 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.302528 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.302604 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.302753 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.302832 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.302993 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.303071 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.303235 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.303317 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.303462 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.303539 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.303703 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.303789 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.303931 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.304016 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.304158 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.304247 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.304386 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.304462 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.304611 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.304699 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.304834 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.304911 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.305059 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.305136 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.305281 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.305365 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.305509 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.305586 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.305750 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.305827 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.305974 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.306058 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.306225 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.306303 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.306447 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.306533 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.306676 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.306870 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.306977 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.307322 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.307398 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.307617 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.307695 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.307853 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.307937 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.308088 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.308171 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.308320 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.308402 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.308550 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.308628 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.308778 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.308856 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.309002 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.309079 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.309235 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.309312 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.309462 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.309537 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.309694 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.309772 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.309921 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.310027 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.310168 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.310286 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.310404 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.310544 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.310661 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.310756 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.310850 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.310950 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.311066 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.311186 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.311293 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.311371 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.311524 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.311605 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.311754 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.311830 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.311997 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.312095 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.312224 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.312310 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.312454 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.312572 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.312682 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.312767 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.312910 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.312988 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.313141 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.313261 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.313369 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.313455 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.313594 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.313671 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.313821 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.313943 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.314050 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.314160 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.314305 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.314385 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.314531 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.314608 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.314759 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.314884 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.315004 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.315082 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.315229 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.315309 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.315460 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.315547 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.315687 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.315763 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.315922 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.316001 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.316155 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.316245 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.316383 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.316461 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.316612 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.316689 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.316836 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.316921 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.317061 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.317139 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.317285 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.317362 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.317512 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.317598 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.317737 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.317820 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.317966 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.318050 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.318224 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.318386 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.318462 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.318532 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.318674 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.318753 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.318904 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.318990 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.319134 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.319224 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.319365 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.319442 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.319610 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] auth.external = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.319687 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.319835 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.319922 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.320071 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.320148 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.320302 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.320383 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.320539 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.320618 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] auth.password = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.320768 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] auth.token = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.320844 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.320996 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.321072 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.321222 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.321299 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.321446 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.321522 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.321672 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.321749 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.321899 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.321995 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.322149 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.322232 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.322377 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.322488 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.322665 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] credential.caching = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.322811 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.322898 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.323271 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.323349 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.323516 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.323594 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.323745 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.323832 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.323981 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.324059 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.324210 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.324290 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.324468 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.324554 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.324716 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.324794 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] auth.external = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.324948 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.325026 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.325193 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.325279 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.325463 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.325540 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.325693 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] auth.password = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.325771 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.325921 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] auth.token = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.326007 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.326176 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.326259 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.326412 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.326490 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.326654 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] federation.caching = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.326746 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.326880 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.326966 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.327116 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.327193 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.327354 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.327445 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.327578 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.327656 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.327806 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] credential.caching = True {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.327882 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.328033 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.328144 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.328283 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.328404 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.328514 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.328651 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.328761 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.328884 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.328989 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.329123 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.329228 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.329354 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.329453 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] identity.caching = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.329614 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.329694 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.329863 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.329942 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.330095 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.330208 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.330364 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.330444 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.330603 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.330680 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.330831 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.330910 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.331059 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.331139 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.331302 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.331380 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.331546 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.331624 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.331771 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.331850 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] federation.caching = True {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.331994 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.332071 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.332216 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.332369 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.332444 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.332516 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.332679 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.332816 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.332943 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.333077 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.333204 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.333330 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.333455 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.333586 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.333731 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.333861 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.333861 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.334195 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.334326 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.334448 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.334448 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.334696 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.334821 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] identity.caching = True {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.334945 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.334945 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.335174 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.335296 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.335427 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.335551 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.335674 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.335802 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.335936 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.336058 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.336189 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.336311 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.336433 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.336556 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.336678 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.336800 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.336930 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.337053 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.337175 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.337297 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.337419 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.337549 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.337688 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.337812 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.337934 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.338084 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.338223 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.338350 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.338485 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.338612 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.338737 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.338861 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.338861 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.339098 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.339231 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.339376 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.339501 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.339626 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.339750 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.339874 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.340007 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.340007 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.340247 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.340371 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.340494 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.340494 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.340738 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.340866 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.340991 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.341125 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.341249 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.341372 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.341504 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.341504 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.341738 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.341862 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.user = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.341988 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.342131 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.342264 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.342388 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.342512 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.342636 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.342772 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.342897 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.343029 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.343153 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.343276 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.343399 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.343522 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.343652 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.343777 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.343902 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.344027 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.344150 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.344274 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.344406 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.344539 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.344662 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.344787 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.344907 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.345037 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.345169 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.345292 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.345373 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.345497 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.345618 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.345748 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.345881 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.346015 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.346202 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.346335 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.346460 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.346585 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.346719 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.346844 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.346969 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.347093 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.347217 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.347342 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.347473 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.347597 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.347721 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.347843 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.347968 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.348103 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.user = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.348235 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.348366 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.348492 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.348616 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.348740 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.348864 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.348995 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.349121 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.349245 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.349369 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.349492 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.349615 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.349756 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.349880 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.350004 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.350147 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.350269 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.350394 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.350530 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.350656 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.350781 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.350909 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.351034 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.351158 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.351292 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] resource.caching = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.351418 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.351552 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.351677 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.351808 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.351939 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.352071 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.352197 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.352322 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.352446 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.352570 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.352700 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.352835 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.352960 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.353085 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.353209 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.353346 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.353477 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.353616 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.353773 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.353965 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] role.caching = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.354173 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.354322 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] role.driver = sql {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.354448 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.354585 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.354709 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.354834 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.354959 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.355082 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.355219 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.355354 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.355480 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.355602 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.355727 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.355852 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.355976 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.356110 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.356235 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.356359 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.356484 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.356608 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.356608 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.356608 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.356608 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.357149 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.357274 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.357398 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.357531 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.357657 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.357657 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.357892 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.358015 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] resource.caching = True {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.358158 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.358291 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.358418 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.358543 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.358684 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.358810 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.358810 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.359056 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.359182 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.359308 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.359433 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.359558 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.359683 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.359816 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.359942 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.360066 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.360191 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.360316 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.360448 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] role.caching = True {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.360582 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.360708 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] role.driver = sql {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.360839 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.360958 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.361084 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.361208 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.361340 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.361466 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.361591 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.361717 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.361842 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.361966 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.362127 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.362127 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.362317 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.362390 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.362460 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.362541 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] token.caching = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.362623 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.362696 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.362767 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.362837 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.362907 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.362977 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.363055 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.363132 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.363207 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.363278 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.363347 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.363417 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.363513 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.363586 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.363657 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.363728 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.363798 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.363868 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.363868 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.364005 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.364076 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.364148 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.364218 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.364295 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.364368 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.364437 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.364507 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.364577 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.364647 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.364724 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.364796 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.364866 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.364936 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.365006 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.365122 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] database.connection = **** {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.365210 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.365291 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.365373 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.365445 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.365516 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.365586 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.365656 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.365729 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.365807 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.365915 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.366027 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.366102 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.366273 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.366349 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.366434 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.366508 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.366579 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.366649 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.366719 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] token.caching = True {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.366797 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.366878 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.366950 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.367022 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.367092 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.367162 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.367234 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.367312 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.367384 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.367384 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.367512 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.367581 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.367651 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.367731 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.367803 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.367874 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.367944 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.368013 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 12 01:16:08.368091 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.368203 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.368437 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.368668 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.368912 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.369157 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.369534 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.369936 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.370298 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.370579 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] database.connection = **** {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.370838 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.371096 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.371341 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.371584 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.371821 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.372137 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.372378 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.372616 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.372858 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.373093 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.373334 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.373569 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.373816 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.374050 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.374316 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.374546 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.374784 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.375013 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 01:16:08.375183 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 12 01:16:08.396830 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 01:16:08.397058 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 01:16:08.397767 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 01:16:08.400328 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 01:16:08.400694 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 01:16:08.400879 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 01:16:08.407099 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 01:16:08.411105 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 01:16:08.435628 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 01:16:08.435862 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 01:16:08.438180 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 01:16:08.438437 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 01:16:08.488428 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 01:16:08.488920 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 01:16:08.540218 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 01:16:08.540415 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 01:16:08.540621 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 01:16:08.540856 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 01:16:08.604047 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 01:16:08.604250 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 01:16:08.604626 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 01:16:08.604750 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 01:16:08.604850 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 01:16:08.604917 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 01:16:08.605047 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 01:16:08.605126 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 01:16:08.605236 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 01:16:08.605314 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 01:16:08.605444 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 01:16:08.605681 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 01:16:08.628314 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 01:16:08.628448 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 01:16:08.628523 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 01:16:08.628617 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 01:16:08.628769 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 01:16:08.628906 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 01:16:08.628984 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 01:16:08.629046 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 01:16:08.629242 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 01:16:08.629376 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 01:16:08.629376 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 01:16:08.629507 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 01:16:08.629577 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 01:16:08.629652 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 01:16:08.640789 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 01:16:08.641010 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 01:16:08.653462 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 01:16:08.653696 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 01:16:08.653902 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 01:16:08.654065 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 01:16:08.654183 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 01:16:08.654251 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 01:16:08.654311 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 01:16:08.654527 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 01:16:08.654666 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 01:16:08.654746 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 01:16:08.654809 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 01:16:08.654869 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 01:16:08.655020 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 01:16:08.655258 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 12 01:16:08.671844 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.672020 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 12 01:16:08.672389 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.672583 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.672709 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 12 01:16:08.672868 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 12 01:16:08.672950 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.673092 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.673215 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.673351 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 12 01:16:08.673443 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.673568 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.673646 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.673818 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.674084 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.674350 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.685041 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.685318 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.685583 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.685860 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.685983 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.686165 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.686447 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.686735 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.692717 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81554) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 01:16:08.693655 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81555) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 01:16:08.695765 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81554) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 01:16:08.696044 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.696325 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.696602 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.696725 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81555) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 01:16:08.696861 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.697032 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.697125 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.697305 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.697430 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.697788 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.698261 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.698348 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.698411 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.698484 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.698558 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.698630 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.698703 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.698909 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.699188 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.699468 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.699738 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.721168 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.722659 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81554) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 01:16:08.722937 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.723060 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.724459 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81555) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 01:16:08.724743 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.727504 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81554) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 01:16:08.727786 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.728063 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.729553 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81555) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 01:16:08.729839 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.730152 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.734781 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81554) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 01:16:08.735065 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.736760 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81555) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 01:16:08.737045 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.739194 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81554) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 01:16:08.739425 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.739715 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.739993 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.740269 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.740560 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.740842 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.741120 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.741244 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81555) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 01:16:08.741380 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.741700 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.741987 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.742272 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.742572 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.742856 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.743129 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.756890 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.757169 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.759305 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.759585 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.761116 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81554) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 01:16:08.763813 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81555) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 01:16:08.764243 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.764537 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.766975 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.767269 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.768885 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81554) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 01:16:08.771701 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81555) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 01:16:08.772029 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81554) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 01:16:08.774878 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81555) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 01:16:08.775179 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.775473 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.775893 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.775893 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.776401 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.776666 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.778209 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.778510 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.778796 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.779088 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.779367 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.779668 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.792678 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81554) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 01:16:08.792957 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.793217 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.793482 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.796089 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81555) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 01:16:08.796381 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.796657 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.796913 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.800693 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.802248 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.802499 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.803823 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.805285 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81554) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 01:16:08.805424 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.805613 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.805740 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.805886 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.806106 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.806431 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.808557 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81555) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 01:16:08.808842 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.809134 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.809429 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.809704 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.817921 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81554) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 01:16:08.818225 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.818503 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.818779 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.819057 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.819331 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.819600 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.821274 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81555) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 01:16:08.821564 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.821849 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.822156 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.822479 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.823081 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.823081 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.836003 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81554) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 01:16:08.839009 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81554) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 01:16:08.839638 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81555) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 01:16:08.841906 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.842629 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81555) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 01:16:08.843490 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.844967 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81554) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 01:16:08.845255 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.845541 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.845678 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.847182 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.848664 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81555) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 01:16:08.848949 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.849244 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.851929 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.853528 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81554) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 01:16:08.855910 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.856493 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.856778 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.857068 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.857343 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.857546 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81555) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 01:16:08.860493 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.860786 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.861080 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.861372 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.865285 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81554) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 01:16:08.865571 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.865847 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.869624 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81555) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 01:16:08.869996 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.870184 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.872892 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81554) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 01:16:08.873173 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.873449 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.873725 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.873993 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.874287 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.874559 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.874825 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.875208 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.875487 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.875761 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.876007 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.876280 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.876540 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.877063 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81555) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 12 01:16:08.877345 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.877629 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.877899 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.878198 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.878479 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.878770 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.879044 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.879429 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.879718 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.879995 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.880267 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.880556 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.880822 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 12 01:16:08.909595 dv-cinder-784815-15-smb devstack@keystone.service[81554]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bb319f89c0 pid: 81554 (default app) Aug 12 01:16:08.912861 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f3fa3-8485-4bf0-ade6-3ad30114bca7 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:08.913138 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f3fa3-8485-4bf0-ade6-3ad30114bca7 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:08.913405 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f3fa3-8485-4bf0-ade6-3ad30114bca7 None None] PATH_INFO: `/v3` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:08.914541 dv-cinder-784815-15-smb devstack@keystone.service[81555]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bb319f89c0 pid: 81555 (default app) Aug 12 01:16:08.918059 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1/1] 10.222.0.26 () {50 vars in 791 bytes} [Fri Aug 12 01:16:08 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:16:16.412232 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701acbb-4930-41aa-9daa-6f9c0dae44d2 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:16.412837 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701acbb-4930-41aa-9daa-6f9c0dae44d2 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:16.412837 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701acbb-4930-41aa-9daa-6f9c0dae44d2 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:16.417304 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1/2] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:16:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:16:16.424353 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c928d8ae-f408-4e2d-bd34-f99e08d96164 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:16.425118 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c928d8ae-f408-4e2d-bd34-f99e08d96164 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:16.425267 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c928d8ae-f408-4e2d-bd34-f99e08d96164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:16.508576 dv-cinder-784815-15-smb devstack@keystone.service[81554]: INFO dbcounter [None req-c928d8ae-f408-4e2d-bd34-f99e08d96164 None None] Registered counter for database keystone Aug 12 01:16:16.531645 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG oslo_db.sqlalchemy.engines [None req-c928d8ae-f408-4e2d-bd34-f99e08d96164 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81554) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 01:16:16.545181 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writer thread running {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 01:16:16.729131 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG passlib.handlers.bcrypt [None req-c928d8ae-f408-4e2d-bd34-f99e08d96164 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81554) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 12 01:16:16.729412 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG passlib.handlers.bcrypt [None req-c928d8ae-f408-4e2d-bd34-f99e08d96164 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81554) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 12 01:16:16.784817 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-c928d8ae-f408-4e2d-bd34-f99e08d96164 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:16:16.786450 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c928d8ae-f408-4e2d-bd34-f99e08d96164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:16:16.946428 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 2/3] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:16:16 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 524 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 12 01:16:17.431817 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1701acbb-4930-41aa-9daa-6f9c0dae44d2 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:17.502869 dv-cinder-784815-15-smb devstack@keystone.service[81555]: INFO dbcounter [None req-1701acbb-4930-41aa-9daa-6f9c0dae44d2 None None] Registered counter for database keystone Aug 12 01:16:17.531034 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG oslo_db.sqlalchemy.engines [None req-1701acbb-4930-41aa-9daa-6f9c0dae44d2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81555) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 01:16:17.542285 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writer thread running {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 01:16:17.677254 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1701acbb-4930-41aa-9daa-6f9c0dae44d2 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:17.686798 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed0dae-e32e-4a3b-b82f-484ab605ddce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:17.687701 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed0dae-e32e-4a3b-b82f-484ab605ddce admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:17.688163 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed0dae-e32e-4a3b-b82f-484ab605ddce admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:17.688609 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed0dae-e32e-4a3b-b82f-484ab605ddce admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:17.701290 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ed0dae-e32e-4a3b-b82f-484ab605ddce admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:17.755184 dv-cinder-784815-15-smb devstack@keystone.service[81555]: WARNING keystone.common.rbac_enforcer.enforcer [None req-82ed0dae-e32e-4a3b-b82f-484ab605ddce admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 12 01:16:17.755703 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ed0dae-e32e-4a3b-b82f-484ab605ddce admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:17.769594 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 2/4] 10.222.0.26 () {58 vars in 1324 bytes} [Fri Aug 12 01:16:17 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 12 01:16:17.779564 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c928d8ae-f408-4e2d-bd34-f99e08d96164 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:17.799594 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c928d8ae-f408-4e2d-bd34-f99e08d96164 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:17.806033 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffee960-f853-4faa-93e2-1443a1112ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:17.807280 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffee960-f853-4faa-93e2-1443a1112ab8 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:17.807555 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffee960-f853-4faa-93e2-1443a1112ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:17.807822 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffee960-f853-4faa-93e2-1443a1112ab8 admin admin] PATH_INFO: `/v3/projects/9f7a63ab9a434ddfb7cb138101d2e804` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:17.809512 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffee960-f853-4faa-93e2-1443a1112ab8 admin admin] RBAC: Authorizing `identity:get_project(project_id=9f7a63ab9a434ddfb7cb138101d2e804)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:17.860360 dv-cinder-784815-15-smb devstack@keystone.service[81554]: WARNING keystone.common.rbac_enforcer.enforcer [None req-bffee960-f853-4faa-93e2-1443a1112ab8 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 12 01:16:17.860700 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffee960-f853-4faa-93e2-1443a1112ab8 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:17.865495 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 3/5] 10.222.0.26 () {56 vars in 1207 bytes} [Fri Aug 12 01:16:17 2022] GET /identity/v3/projects/9f7a63ab9a434ddfb7cb138101d2e804 => generated 344 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:16:19.765620 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0acb15-db0f-46c7-b992-8f092637f404 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:19.766472 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0acb15-db0f-46c7-b992-8f092637f404 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:19.766472 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0acb15-db0f-46c7-b992-8f092637f404 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:19.773180 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 3/6] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:16:19 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:16:19.778956 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d292b46-5413-435d-8af0-6f06f6a853b5 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:19.779395 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d292b46-5413-435d-8af0-6f06f6a853b5 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:19.779488 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d292b46-5413-435d-8af0-6f06f6a853b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:19.802566 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-4d292b46-5413-435d-8af0-6f06f6a853b5 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:16:19.804084 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-4d292b46-5413-435d-8af0-6f06f6a853b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:16:19.812962 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 4/7] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:16:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 12 01:16:20.077459 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0acb15-db0f-46c7-b992-8f092637f404 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:20.100058 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0acb15-db0f-46c7-b992-8f092637f404 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:20.107034 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822a0b24-46c1-4130-993e-0d4e8c964475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:20.107635 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a0b24-46c1-4130-993e-0d4e8c964475 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:20.107904 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a0b24-46c1-4130-993e-0d4e8c964475 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:20.108166 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a0b24-46c1-4130-993e-0d4e8c964475 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:20.116404 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822a0b24-46c1-4130-993e-0d4e8c964475 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:20.118205 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822a0b24-46c1-4130-993e-0d4e8c964475 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:20.127150 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 4/8] 10.222.0.26 () {58 vars in 1324 bytes} [Fri Aug 12 01:16:20 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 12 01:16:20.135889 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d292b46-5413-435d-8af0-6f06f6a853b5 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:20.150174 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d292b46-5413-435d-8af0-6f06f6a853b5 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:20.155663 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2d900b-bb43-4775-ab79-36e8dd4fe18d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:20.156291 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2d900b-bb43-4775-ab79-36e8dd4fe18d admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:20.156564 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2d900b-bb43-4775-ab79-36e8dd4fe18d admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:20.156834 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2d900b-bb43-4775-ab79-36e8dd4fe18d admin admin] PATH_INFO: `/v3/users/7f20260f94904e78a150a9644ed5191c` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:20.158198 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2d900b-bb43-4775-ab79-36e8dd4fe18d admin admin] RBAC: Authorizing `identity:get_user(user_id=7f20260f94904e78a150a9644ed5191c)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:20.160002 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2d900b-bb43-4775-ab79-36e8dd4fe18d admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:20.161511 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 5/9] 10.222.0.26 () {56 vars in 1198 bytes} [Fri Aug 12 01:16:20 2022] GET /identity/v3/users/7f20260f94904e78a150a9644ed5191c => generated 247 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:16:22.159873 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42991428-3d7a-4e18-a3a5-ebf6524ed401 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:22.160408 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42991428-3d7a-4e18-a3a5-ebf6524ed401 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:22.160408 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42991428-3d7a-4e18-a3a5-ebf6524ed401 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:22.161741 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 5/10] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:16:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:16:22.167100 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c2fd7-a717-4a99-ab15-34cf2400ce33 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:22.167525 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c2fd7-a717-4a99-ab15-34cf2400ce33 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:22.167721 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c2fd7-a717-4a99-ab15-34cf2400ce33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:22.170719 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf050b1e-3ab1-4a6b-b112-768f72a1aa03 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:22.171005 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf050b1e-3ab1-4a6b-b112-768f72a1aa03 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:22.171282 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf050b1e-3ab1-4a6b-b112-768f72a1aa03 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:22.172477 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 6/11] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:16:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 01:16:22.177512 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e5e5b-21a7-4f5c-b1ce-47abedfbe071 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:22.177810 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e5e5b-21a7-4f5c-b1ce-47abedfbe071 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:22.178068 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e5e5b-21a7-4f5c-b1ce-47abedfbe071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:22.187054 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-7f6c2fd7-a717-4a99-ab15-34cf2400ce33 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:16:22.188242 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-7f6c2fd7-a717-4a99-ab15-34cf2400ce33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:16:22.221271 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG passlib.handlers.bcrypt [None req-b27e5e5b-21a7-4f5c-b1ce-47abedfbe071 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81555) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 12 01:16:22.221702 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG passlib.handlers.bcrypt [None req-b27e5e5b-21a7-4f5c-b1ce-47abedfbe071 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81555) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 12 01:16:22.266799 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-b27e5e5b-21a7-4f5c-b1ce-47abedfbe071 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:16:22.268378 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-b27e5e5b-21a7-4f5c-b1ce-47abedfbe071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:16:22.270070 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 6/12] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:16:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 01:16:22.374471 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 7/13] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:16:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 01:16:22.531417 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c2fd7-a717-4a99-ab15-34cf2400ce33 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:22.556182 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:22.636239 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c2fd7-a717-4a99-ab15-34cf2400ce33 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:22.645861 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27e5e5b-21a7-4f5c-b1ce-47abedfbe071 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:22.670083 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e092e6a-0811-4a7c-85a4-003226901f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:22.670717 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e092e6a-0811-4a7c-85a4-003226901f19 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:22.670991 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e092e6a-0811-4a7c-85a4-003226901f19 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:22.671255 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e092e6a-0811-4a7c-85a4-003226901f19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:22.740064 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e092e6a-0811-4a7c-85a4-003226901f19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:22.741481 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e092e6a-0811-4a7c-85a4-003226901f19 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:22.747152 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27e5e5b-21a7-4f5c-b1ce-47abedfbe071 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:22.749391 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:22.768380 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:22.784234 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daaaf15-5774-4389-8855-f0787761cd78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:22.785421 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daaaf15-5774-4389-8855-f0787761cd78 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:22.785699 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daaaf15-5774-4389-8855-f0787761cd78 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:22.785963 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daaaf15-5774-4389-8855-f0787761cd78 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:22.797752 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daaaf15-5774-4389-8855-f0787761cd78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:16:22.806145 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-9daaaf15-5774-4389-8855-f0787761cd78 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 01:16:22.806145 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:16:22.806145 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:16:22.806145 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:16:22.806145 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:16:22.806145 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:16:22.806145 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:16:22.806145 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:16:22.806145 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:16:22.806145 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:16:22.806145 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:16:22.806145 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:16:22.806145 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:16:22.806145 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:16:22.806145 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:16:22.806145 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:16:22.807157 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:16:22.807157 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:16:22.807157 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:16:22.807157 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:16:22.807157 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:16:22.807157 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:16:22.807157 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:16:22.807157 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:16:22.807157 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:16:22.807157 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:16:22.807157 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:16:22.807157 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:16:22.807157 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:16:22.807157 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:16:22.807157 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:16:22.807157 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:16:22.807956 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:16:22.807956 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:16:22.807956 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:16:22.807956 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:16:22.807956 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:16:22.807956 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:16:22.807956 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:16:22.807956 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:16:22.807956 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:16:22.807956 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:16:22.807956 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 01:16:22.807956 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:16:22.807956 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 8/14] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Aug 12 01:16:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:16:22.813136 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daaaf15-5774-4389-8855-f0787761cd78 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:22.849831 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 7/15] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 01:16:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 01:16:22.855618 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e092e6a-0811-4a7c-85a4-003226901f19 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:22.912503 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daaaf15-5774-4389-8855-f0787761cd78 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:22.948760 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f4fe43-2406-4c7d-a544-ee81b4b58813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:22.949379 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4fe43-2406-4c7d-a544-ee81b4b58813 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:22.949735 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4fe43-2406-4c7d-a544-ee81b4b58813 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:22.950003 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4fe43-2406-4c7d-a544-ee81b4b58813 None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:22.950709 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f4fe43-2406-4c7d-a544-ee81b4b58813 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:16:22.951005 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f4fe43-2406-4c7d-a544-ee81b4b58813 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:22.952463 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f4fe43-2406-4c7d-a544-ee81b4b58813 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:22.968545 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 9/16] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 01:16:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:16:22.974447 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f4fe43-2406-4c7d-a544-ee81b4b58813 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:23.003498 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:23.064212 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e092e6a-0811-4a7c-85a4-003226901f19 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:23.075643 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f4fe43-2406-4c7d-a544-ee81b4b58813 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:23.086792 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:23.099056 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1cdc1e-6a0a-4ea4-b323-a666c02d6a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:23.099698 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1cdc1e-6a0a-4ea4-b323-a666c02d6a33 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:23.099976 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1cdc1e-6a0a-4ea4-b323-a666c02d6a33 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:23.100241 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1cdc1e-6a0a-4ea4-b323-a666c02d6a33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:23.109877 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc9f01e-67d1-42aa-88e6-003e5f3d66ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:23.110552 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9f01e-67d1-42aa-88e6-003e5f3d66ac None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:23.110827 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9f01e-67d1-42aa-88e6-003e5f3d66ac None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:23.110920 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1cdc1e-6a0a-4ea4-b323-a666c02d6a33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:23.111096 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9f01e-67d1-42aa-88e6-003e5f3d66ac None admin] PATH_INFO: `/v3/users/7f20260f94904e78a150a9644ed5191c` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:23.112288 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1cdc1e-6a0a-4ea4-b323-a666c02d6a33 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:23.112593 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc9f01e-67d1-42aa-88e6-003e5f3d66ac None admin] RBAC: Authorizing `identity:get_user(user_id=7f20260f94904e78a150a9644ed5191c)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:23.114022 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc9f01e-67d1-42aa-88e6-003e5f3d66ac None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:23.115631 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 10/17] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 01:16:22 2022] GET /identity/v3/users/7f20260f94904e78a150a9644ed5191c => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:16:23.121659 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc9f01e-67d1-42aa-88e6-003e5f3d66ac None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:23.129833 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-7d1cdc1e-6a0a-4ea4-b323-a666c02d6a33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:16:23.129833 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:16:23.129833 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:16:23.129833 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:16:23.129833 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:16:23.129833 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:16:23.129833 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:16:23.129833 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:16:23.129833 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:16:23.129833 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:16:23.129833 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:16:23.129833 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:16:23.129833 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 01:16:23.129833 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 01:16:23.129833 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 01:16:23.129833 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 01:16:23.130728 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:16:23.130728 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:16:23.130728 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:16:23.130728 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:16:23.130728 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:16:23.130728 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:16:23.130728 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:16:23.130728 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:16:23.130728 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:16:23.130728 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:16:23.130728 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:16:23.130728 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:16:23.130728 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:16:23.130728 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:16:23.130728 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:16:23.130728 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:16:23.130728 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 01:16:23.131518 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 01:16:23.131518 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:16:23.131518 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:16:23.131518 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 8/18] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:16:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 01:16:23.136851 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1cdc1e-6a0a-4ea4-b323-a666c02d6a33 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:23.219053 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:23.226414 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc9f01e-67d1-42aa-88e6-003e5f3d66ac None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:23.233940 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1cdc1e-6a0a-4ea4-b323-a666c02d6a33 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:23.261896 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6281aa-5a59-48cb-8605-3ff1ca5cfb78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:23.262499 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6281aa-5a59-48cb-8605-3ff1ca5cfb78 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:23.262768 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6281aa-5a59-48cb-8605-3ff1ca5cfb78 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:23.263039 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6281aa-5a59-48cb-8605-3ff1ca5cfb78 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:23.264149 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6281aa-5a59-48cb-8605-3ff1ca5cfb78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:23.265600 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6281aa-5a59-48cb-8605-3ff1ca5cfb78 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:23.267189 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ae7495-c75d-43e4-9e9e-2fe928869108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:23.267321 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 11/19] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:16:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:16:23.267799 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae7495-c75d-43e4-9e9e-2fe928869108 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:23.268076 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae7495-c75d-43e4-9e9e-2fe928869108 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:23.268345 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae7495-c75d-43e4-9e9e-2fe928869108 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:23.268984 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ae7495-c75d-43e4-9e9e-2fe928869108 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:16:23.269281 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ae7495-c75d-43e4-9e9e-2fe928869108 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:23.270722 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ae7495-c75d-43e4-9e9e-2fe928869108 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:23.272964 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6281aa-5a59-48cb-8605-3ff1ca5cfb78 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:23.289987 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 9/20] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 01:16:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:16:23.382391 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6281aa-5a59-48cb-8605-3ff1ca5cfb78 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:23.420343 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d80f77-4ceb-4038-88f6-a67d727f6428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:23.420962 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d80f77-4ceb-4038-88f6-a67d727f6428 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:23.421237 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d80f77-4ceb-4038-88f6-a67d727f6428 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:23.421503 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d80f77-4ceb-4038-88f6-a67d727f6428 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:23.422241 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d80f77-4ceb-4038-88f6-a67d727f6428 None admin] RBAC: Adding query filter params (role.id=fb48693810be495fb4b1893a79429b78, scope.domain.id=default, user.id=7f20260f94904e78a150a9644ed5191c) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:16:23.422575 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d80f77-4ceb-4038-88f6-a67d727f6428 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:23.424055 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d80f77-4ceb-4038-88f6-a67d727f6428 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:23.434351 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 12/21] 10.222.0.26 () {56 vars in 1322 bytes} [Fri Aug 12 01:16:23 2022] GET /identity/v3/role_assignments?user.id=7f20260f94904e78a150a9644ed5191c&scope.domain.id=default&role.id=fb48693810be495fb4b1893a79429b78 => generated 233 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:16:25.390203 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb296ea7-b8d5-46db-a57c-973f480faf32 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:25.390716 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb296ea7-b8d5-46db-a57c-973f480faf32 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:25.390787 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb296ea7-b8d5-46db-a57c-973f480faf32 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:25.392098 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 10/22] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:16:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:16:25.406779 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7443a33-4af8-42f5-83f4-9946ab224225 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:25.407255 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7443a33-4af8-42f5-83f4-9946ab224225 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:25.407328 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7443a33-4af8-42f5-83f4-9946ab224225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:25.435366 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-d7443a33-4af8-42f5-83f4-9946ab224225 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:16:25.436592 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-d7443a33-4af8-42f5-83f4-9946ab224225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:16:25.461532 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:25.518286 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 13/23] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:16:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 01:16:25.537505 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f43f9f4-3a53-4815-8d81-6a861b2ac0a0 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:25.537796 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f43f9f4-3a53-4815-8d81-6a861b2ac0a0 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:25.538095 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f43f9f4-3a53-4815-8d81-6a861b2ac0a0 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:25.539727 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 11/24] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:16:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:16:25.545292 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc10b6-5561-4b71-927b-247c3aa53a7a None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:25.545727 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc10b6-5561-4b71-927b-247c3aa53a7a None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:25.546159 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc10b6-5561-4b71-927b-247c3aa53a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:25.580024 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-73bc10b6-5561-4b71-927b-247c3aa53a7a None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:16:25.581443 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-73bc10b6-5561-4b71-927b-247c3aa53a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:16:25.676751 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 14/25] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:16:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 01:16:25.984558 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5f4ed1-3c91-4293-bf01-8bcb5e3bb125 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:25.984758 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5f4ed1-3c91-4293-bf01-8bcb5e3bb125 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:25.985036 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5f4ed1-3c91-4293-bf01-8bcb5e3bb125 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:25.986562 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 12/26] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:16:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:16:25.991661 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30baa10-28a9-405c-8563-c41c690a550a None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:25.991949 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30baa10-28a9-405c-8563-c41c690a550a None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:25.992223 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30baa10-28a9-405c-8563-c41c690a550a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:26.011638 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-a30baa10-28a9-405c-8563-c41c690a550a None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:16:26.012836 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-a30baa10-28a9-405c-8563-c41c690a550a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:16:26.064858 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5f4ed1-3c91-4293-bf01-8bcb5e3bb125 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:26.132164 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:26.239499 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5f4ed1-3c91-4293-bf01-8bcb5e3bb125 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:26.249238 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 15/27] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:16:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 01:16:26.250500 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30baa10-28a9-405c-8563-c41c690a550a None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:26.277119 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:26.295153 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ced17ed-e0ed-443c-9e32-dd98eca16135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:26.295798 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ced17ed-e0ed-443c-9e32-dd98eca16135 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:26.296070 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ced17ed-e0ed-443c-9e32-dd98eca16135 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:26.296335 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ced17ed-e0ed-443c-9e32-dd98eca16135 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:26.317234 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ced17ed-e0ed-443c-9e32-dd98eca16135 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:26.318477 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ced17ed-e0ed-443c-9e32-dd98eca16135 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:26.342482 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-5ced17ed-e0ed-443c-9e32-dd98eca16135 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:16:26.342482 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:16:26.342482 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:16:26.342482 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:16:26.342482 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:16:26.342482 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:16:26.342482 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:16:26.342482 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:16:26.342482 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:16:26.342482 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:16:26.342482 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:16:26.342482 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:16:26.342482 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 01:16:26.342482 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 01:16:26.342482 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 01:16:26.342482 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 01:16:26.343439 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:16:26.343439 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:16:26.343439 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:16:26.343439 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:16:26.343439 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:16:26.343439 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:16:26.343439 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:16:26.343439 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:16:26.343439 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:16:26.343439 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:16:26.343439 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:16:26.343439 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:16:26.343439 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:16:26.343439 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:16:26.343439 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:16:26.343439 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:16:26.343439 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 01:16:26.344207 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 01:16:26.344207 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:16:26.344207 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:16:26.344207 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 13/28] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:16:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 01:16:26.351440 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d7a537-8d65-4739-866e-32218b5d1ef7 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:26.351719 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d7a537-8d65-4739-866e-32218b5d1ef7 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:26.352009 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d7a537-8d65-4739-866e-32218b5d1ef7 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:26.353393 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 14/29] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:16:26 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:16:26.353967 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d7a537-8d65-4739-866e-32218b5d1ef7 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:26.377208 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30baa10-28a9-405c-8563-c41c690a550a None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:26.414151 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4566dc9c-ed5c-4141-bf1e-cde9afa794d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:26.415775 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566dc9c-ed5c-4141-bf1e-cde9afa794d2 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:26.416297 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566dc9c-ed5c-4141-bf1e-cde9afa794d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:26.416800 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566dc9c-ed5c-4141-bf1e-cde9afa794d2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:26.428426 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4566dc9c-ed5c-4141-bf1e-cde9afa794d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:16:26.434060 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-4566dc9c-ed5c-4141-bf1e-cde9afa794d2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 01:16:26.434060 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:16:26.434060 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:16:26.434060 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:16:26.434060 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:16:26.434060 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:16:26.434060 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:16:26.434060 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:16:26.434060 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:16:26.434060 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:16:26.434060 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:16:26.434060 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:16:26.434060 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:16:26.434060 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:16:26.434060 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:16:26.434060 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:16:26.434901 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:16:26.434901 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:16:26.434901 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:16:26.434901 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:16:26.434901 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:16:26.434901 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:16:26.434901 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:16:26.434901 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:16:26.434901 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:16:26.434901 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:16:26.434901 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:16:26.434901 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:16:26.434901 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:16:26.434901 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:16:26.434901 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:16:26.434901 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:16:26.435642 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:16:26.435642 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:16:26.435642 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:16:26.435642 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:16:26.435642 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:16:26.435642 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:16:26.435642 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:16:26.435642 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:16:26.435642 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:16:26.435642 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:16:26.435642 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 01:16:26.435642 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:16:26.438233 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 16/30] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Aug 12 01:16:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:16:26.440105 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef6c592-2956-4bdf-b0de-71b056014593 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:26.440732 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef6c592-2956-4bdf-b0de-71b056014593 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:26.441195 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef6c592-2956-4bdf-b0de-71b056014593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:26.459682 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-0ef6c592-2956-4bdf-b0de-71b056014593 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:16:26.461299 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-0ef6c592-2956-4bdf-b0de-71b056014593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:16:26.543614 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:26.545773 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 17/31] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:16:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 01:16:26.546850 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef6c592-2956-4bdf-b0de-71b056014593 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:26.572618 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:26.622822 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d7a537-8d65-4739-866e-32218b5d1ef7 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:26.670087 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef6c592-2956-4bdf-b0de-71b056014593 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:26.694886 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9e3065-aa19-454f-bb35-80e1be0a3196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:26.695462 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e3065-aa19-454f-bb35-80e1be0a3196 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:26.695740 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e3065-aa19-454f-bb35-80e1be0a3196 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:26.696009 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e3065-aa19-454f-bb35-80e1be0a3196 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:26.696723 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9e3065-aa19-454f-bb35-80e1be0a3196 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:16:26.697085 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9e3065-aa19-454f-bb35-80e1be0a3196 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:26.698562 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9e3065-aa19-454f-bb35-80e1be0a3196 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:26.711968 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b96f880-6ac9-437a-9f60-5f0a78164734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:26.713050 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b96f880-6ac9-437a-9f60-5f0a78164734 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:26.713897 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b96f880-6ac9-437a-9f60-5f0a78164734 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:26.714679 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b96f880-6ac9-437a-9f60-5f0a78164734 None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:26.716275 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b96f880-6ac9-437a-9f60-5f0a78164734 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:16:26.717551 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b96f880-6ac9-437a-9f60-5f0a78164734 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:26.720045 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b96f880-6ac9-437a-9f60-5f0a78164734 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:26.720950 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 15/32] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 01:16:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:16:26.723654 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9e3065-aa19-454f-bb35-80e1be0a3196 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:26.739563 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 18/33] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 01:16:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:16:26.741396 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b96f880-6ac9-437a-9f60-5f0a78164734 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:26.861891 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:26.892282 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9e3065-aa19-454f-bb35-80e1be0a3196 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:26.897456 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b96f880-6ac9-437a-9f60-5f0a78164734 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:26.928079 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fece2c9-8fa6-45e2-b823-f20798b2061e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:26.928699 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fece2c9-8fa6-45e2-b823-f20798b2061e None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:26.928978 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fece2c9-8fa6-45e2-b823-f20798b2061e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:26.929310 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fece2c9-8fa6-45e2-b823-f20798b2061e None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:26.929980 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fece2c9-8fa6-45e2-b823-f20798b2061e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:26.931473 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fece2c9-8fa6-45e2-b823-f20798b2061e None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:26.933861 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9b98b9-c5b4-4fc4-94db-1dc75b12981d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:26.934504 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b98b9-c5b4-4fc4-94db-1dc75b12981d None admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:26.934778 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b98b9-c5b4-4fc4-94db-1dc75b12981d None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:26.935139 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b98b9-c5b4-4fc4-94db-1dc75b12981d None admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:26.935673 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9b98b9-c5b4-4fc4-94db-1dc75b12981d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:26.937086 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9b98b9-c5b4-4fc4-94db-1dc75b12981d None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:27.051134 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 16/34] 10.222.0.26 () {60 vars in 1131 bytes} [Fri Aug 12 01:16:26 2022] POST /identity/v3/roles => generated 225 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:16:27.052145 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fece2c9-8fa6-45e2-b823-f20798b2061e None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:27.063058 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:27.093875 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 19/35] 10.222.0.26 () {60 vars in 1141 bytes} [Fri Aug 12 01:16:26 2022] POST /identity/v3/projects => generated 301 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:16:27.095998 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9b98b9-c5b4-4fc4-94db-1dc75b12981d None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:27.227455 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fece2c9-8fa6-45e2-b823-f20798b2061e None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:27.274881 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265699fb-5727-483e-a8af-778c4cc3fcc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:27.276230 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265699fb-5727-483e-a8af-778c4cc3fcc8 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:27.276230 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265699fb-5727-483e-a8af-778c4cc3fcc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:27.278008 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265699fb-5727-483e-a8af-778c4cc3fcc8 None admin] PATH_INFO: `/v3/users/7f20260f94904e78a150a9644ed5191c` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:27.279573 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265699fb-5727-483e-a8af-778c4cc3fcc8 None admin] RBAC: Authorizing `identity:get_user(user_id=7f20260f94904e78a150a9644ed5191c)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:27.280821 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265699fb-5727-483e-a8af-778c4cc3fcc8 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:27.282580 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 17/36] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 01:16:27 2022] GET /identity/v3/users/7f20260f94904e78a150a9644ed5191c => generated 247 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:16:27.283835 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7ab9a-c58d-4488-b1e6-74380190258f None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:27.284120 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7ab9a-c58d-4488-b1e6-74380190258f None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:27.284397 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7ab9a-c58d-4488-b1e6-74380190258f None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:27.285674 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 18/37] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:16:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:16:27.286822 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566dcd82-360b-4102-a223-8306f8a09519 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:27.287069 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566dcd82-360b-4102-a223-8306f8a09519 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:27.287346 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566dcd82-360b-4102-a223-8306f8a09519 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:27.288532 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 19/38] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:16:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:16:27.289443 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566dcd82-360b-4102-a223-8306f8a09519 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:27.292754 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9b98b9-c5b4-4fc4-94db-1dc75b12981d None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:27.317754 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:27.337807 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab7541f-59a8-49a8-9d6b-b69d0c0fa71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:27.338470 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab7541f-59a8-49a8-9d6b-b69d0c0fa71c None admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:27.338752 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab7541f-59a8-49a8-9d6b-b69d0c0fa71c None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:27.339029 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab7541f-59a8-49a8-9d6b-b69d0c0fa71c None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:27.339705 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab7541f-59a8-49a8-9d6b-b69d0c0fa71c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:27.341225 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab7541f-59a8-49a8-9d6b-b69d0c0fa71c None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:27.358352 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 20/39] 10.222.0.26 () {60 vars in 1131 bytes} [Fri Aug 12 01:16:27 2022] POST /identity/v3/roles => generated 219 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:16:27.360199 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e5dfc2-2275-452c-b692-f6775bd8d778 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:27.360462 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e5dfc2-2275-452c-b692-f6775bd8d778 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:27.361235 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e5dfc2-2275-452c-b692-f6775bd8d778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:27.384957 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:27.385984 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-09e5dfc2-2275-452c-b692-f6775bd8d778 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:16:27.388448 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-09e5dfc2-2275-452c-b692-f6775bd8d778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:16:27.412818 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566dcd82-360b-4102-a223-8306f8a09519 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:27.452407 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9273a87f-93b3-4a51-b106-b6d86842a4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:27.453064 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273a87f-93b3-4a51-b106-b6d86842a4a9 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:27.453351 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273a87f-93b3-4a51-b106-b6d86842a4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:27.453626 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273a87f-93b3-4a51-b106-b6d86842a4a9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:27.455030 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9273a87f-93b3-4a51-b106-b6d86842a4a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:27.456550 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9273a87f-93b3-4a51-b106-b6d86842a4a9 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:27.458573 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 20/40] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:16:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:16:27.459862 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df385cf4-43c9-4276-bf42-1720b6dd26c5 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:27.460194 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df385cf4-43c9-4276-bf42-1720b6dd26c5 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:27.460473 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df385cf4-43c9-4276-bf42-1720b6dd26c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:27.486226 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-df385cf4-43c9-4276-bf42-1720b6dd26c5 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:16:27.486226 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-df385cf4-43c9-4276-bf42-1720b6dd26c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:16:27.486446 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 21/41] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:16:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 01:16:27.486446 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e5dfc2-2275-452c-b692-f6775bd8d778 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:27.563419 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 21/42] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:16:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 01:16:27.613135 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e5dfc2-2275-452c-b692-f6775bd8d778 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:27.625647 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:27.651609 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c508f5c-b28d-430d-9a5e-154c0271aad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:27.652281 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c508f5c-b28d-430d-9a5e-154c0271aad5 None admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:27.652561 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c508f5c-b28d-430d-9a5e-154c0271aad5 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:27.652841 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c508f5c-b28d-430d-9a5e-154c0271aad5 None admin] PATH_INFO: `/v3/domains/default/users/7f20260f94904e78a150a9644ed5191c/roles/fb48693810be495fb4b1893a79429b78` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:27.654791 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c508f5c-b28d-430d-9a5e-154c0271aad5 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=7f20260f94904e78a150a9644ed5191c, role_id=fb48693810be495fb4b1893a79429b78)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:27.656247 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c508f5c-b28d-430d-9a5e-154c0271aad5 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:27.670195 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 22/43] 10.222.0.26 () {58 vars in 1361 bytes} [Fri Aug 12 01:16:27 2022] PUT /identity/v3/domains/default/users/7f20260f94904e78a150a9644ed5191c/roles/fb48693810be495fb4b1893a79429b78 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:16:27.761522 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df385cf4-43c9-4276-bf42-1720b6dd26c5 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:27.826965 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c508f5c-b28d-430d-9a5e-154c0271aad5 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:27.839122 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:27.870662 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df385cf4-43c9-4276-bf42-1720b6dd26c5 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:27.908119 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975a35fd-4aa7-4bef-9c45-746e88e548ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:27.908741 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a35fd-4aa7-4bef-9c45-746e88e548ca None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:27.909024 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a35fd-4aa7-4bef-9c45-746e88e548ca None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:27.909302 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a35fd-4aa7-4bef-9c45-746e88e548ca None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:27.909976 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975a35fd-4aa7-4bef-9c45-746e88e548ca None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:27.911401 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975a35fd-4aa7-4bef-9c45-746e88e548ca None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:27.927597 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 22/44] 10.222.0.26 () {60 vars in 1131 bytes} [Fri Aug 12 01:16:27 2022] POST /identity/v3/roles => generated 223 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:16:27.933886 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c508f5c-b28d-430d-9a5e-154c0271aad5 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:27.973297 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bef5bf-a445-4cdf-95ac-a68509af6a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:27.974022 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bef5bf-a445-4cdf-95ac-a68509af6a95 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:27.974365 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bef5bf-a445-4cdf-95ac-a68509af6a95 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:27.974707 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bef5bf-a445-4cdf-95ac-a68509af6a95 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:27.976026 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bef5bf-a445-4cdf-95ac-a68509af6a95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:27.977658 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bef5bf-a445-4cdf-95ac-a68509af6a95 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:27.979882 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 23/45] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:16:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:16:27.985813 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975a35fd-4aa7-4bef-9c45-746e88e548ca None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:28.099329 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975a35fd-4aa7-4bef-9c45-746e88e548ca None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:28.132596 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:28.137883 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72d9af6-1a98-4af9-b27f-ad241e41a32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:28.139455 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d9af6-1a98-4af9-b27f-ad241e41a32f None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:28.139760 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d9af6-1a98-4af9-b27f-ad241e41a32f None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:28.140003 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d9af6-1a98-4af9-b27f-ad241e41a32f None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:28.140657 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72d9af6-1a98-4af9-b27f-ad241e41a32f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:28.142706 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72d9af6-1a98-4af9-b27f-ad241e41a32f None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:28.171427 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 23/46] 10.222.0.26 () {60 vars in 1141 bytes} [Fri Aug 12 01:16:27 2022] POST /identity/v3/projects => generated 312 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:16:29.541918 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a02da69-2716-45a9-ad87-9c16ce360ce9 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:29.542473 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a02da69-2716-45a9-ad87-9c16ce360ce9 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:29.542473 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a02da69-2716-45a9-ad87-9c16ce360ce9 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:29.543831 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 24/47] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:16:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:16:29.549701 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb27ab-56d7-449c-b03b-4023a4ffb114 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:29.550109 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb27ab-56d7-449c-b03b-4023a4ffb114 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:29.550321 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb27ab-56d7-449c-b03b-4023a4ffb114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:29.569417 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-9cdb27ab-56d7-449c-b03b-4023a4ffb114 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:16:29.570643 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-9cdb27ab-56d7-449c-b03b-4023a4ffb114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:16:29.639629 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 24/48] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:16:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 01:16:29.900099 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a02da69-2716-45a9-ad87-9c16ce360ce9 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:29.945493 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:30.010001 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a02da69-2716-45a9-ad87-9c16ce360ce9 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:30.044818 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d7430-a660-478a-88c3-0ed22e30eb16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:30.045446 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d7430-a660-478a-88c3-0ed22e30eb16 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:30.045720 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d7430-a660-478a-88c3-0ed22e30eb16 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:30.045983 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d7430-a660-478a-88c3-0ed22e30eb16 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:30.056756 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459d7430-a660-478a-88c3-0ed22e30eb16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:16:30.061684 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-459d7430-a660-478a-88c3-0ed22e30eb16 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 01:16:30.061684 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:16:30.061684 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:16:30.061684 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:16:30.061684 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:16:30.061684 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:16:30.061684 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:16:30.061684 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:16:30.061684 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:16:30.061684 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:16:30.061684 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:16:30.061684 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:16:30.061684 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:16:30.061684 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:16:30.061684 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:16:30.061684 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:16:30.062627 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:16:30.062627 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:16:30.062627 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:16:30.062627 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:16:30.062627 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:16:30.062627 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:16:30.062627 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:16:30.062627 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:16:30.062627 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:16:30.062627 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:16:30.062627 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:16:30.062627 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:16:30.062627 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:16:30.062627 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:16:30.062627 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:16:30.062627 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:16:30.063453 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:16:30.063453 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:16:30.063453 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:16:30.063453 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:16:30.063453 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:16:30.063453 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:16:30.063453 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:16:30.063453 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:16:30.063453 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:16:30.063453 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:16:30.063453 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 01:16:30.063453 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:16:30.063453 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 25/49] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Aug 12 01:16:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:16:30.070218 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdb27ab-56d7-449c-b03b-4023a4ffb114 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:30.080557 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885968a-9660-4901-9f7a-a63e3400f5d7 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:30.080848 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885968a-9660-4901-9f7a-a63e3400f5d7 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:30.081122 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885968a-9660-4901-9f7a-a63e3400f5d7 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:30.082516 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 26/50] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:16:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:16:30.087596 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05b55b-e242-45ab-8665-f211a92fa05d None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:30.087876 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05b55b-e242-45ab-8665-f211a92fa05d None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:30.088156 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05b55b-e242-45ab-8665-f211a92fa05d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:30.105667 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-ce05b55b-e242-45ab-8665-f211a92fa05d None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:16:30.106872 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-ce05b55b-e242-45ab-8665-f211a92fa05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:16:30.173191 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdb27ab-56d7-449c-b03b-4023a4ffb114 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:30.173553 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 27/51] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:16:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 01:16:30.187673 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:30.209526 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec34aaf-8262-4191-b6f0-211cdb298764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:30.210144 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec34aaf-8262-4191-b6f0-211cdb298764 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:30.210431 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec34aaf-8262-4191-b6f0-211cdb298764 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:30.210694 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec34aaf-8262-4191-b6f0-211cdb298764 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:30.211358 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec34aaf-8262-4191-b6f0-211cdb298764 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:16:30.211653 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec34aaf-8262-4191-b6f0-211cdb298764 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:30.213116 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec34aaf-8262-4191-b6f0-211cdb298764 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:30.224799 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 25/52] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 01:16:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:16:30.230566 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce05b55b-e242-45ab-8665-f211a92fa05d None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:30.258815 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:30.330823 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce05b55b-e242-45ab-8665-f211a92fa05d None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:30.364328 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e6d084-dcb3-4904-b7fb-ce6c182db696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:30.364953 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e6d084-dcb3-4904-b7fb-ce6c182db696 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:30.365228 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e6d084-dcb3-4904-b7fb-ce6c182db696 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:30.365497 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e6d084-dcb3-4904-b7fb-ce6c182db696 None admin] PATH_INFO: `/v3/users/7f20260f94904e78a150a9644ed5191c` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:30.366661 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e6d084-dcb3-4904-b7fb-ce6c182db696 None admin] RBAC: Authorizing `identity:get_user(user_id=7f20260f94904e78a150a9644ed5191c)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:30.368089 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e6d084-dcb3-4904-b7fb-ce6c182db696 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:30.369681 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 28/53] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 01:16:30 2022] GET /identity/v3/users/7f20260f94904e78a150a9644ed5191c => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:16:30.375454 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec34aaf-8262-4191-b6f0-211cdb298764 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:30.435642 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e6d084-dcb3-4904-b7fb-ce6c182db696 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:30.477501 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec34aaf-8262-4191-b6f0-211cdb298764 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:30.517083 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcf07d4-e685-419f-a239-97c8ffc1055c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:30.517716 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf07d4-e685-419f-a239-97c8ffc1055c None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:30.517985 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf07d4-e685-419f-a239-97c8ffc1055c None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:30.518290 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf07d4-e685-419f-a239-97c8ffc1055c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:30.519391 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcf07d4-e685-419f-a239-97c8ffc1055c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:30.520869 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcf07d4-e685-419f-a239-97c8ffc1055c None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:30.522461 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 26/54] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:16:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:16:30.528013 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:30.528514 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcf07d4-e685-419f-a239-97c8ffc1055c None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:30.534716 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e6d084-dcb3-4904-b7fb-ce6c182db696 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:30.569302 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508c8c7d-b79a-4c84-81cd-b0d2932bcc3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:30.569941 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c8c7d-b79a-4c84-81cd-b0d2932bcc3f None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:30.570211 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c8c7d-b79a-4c84-81cd-b0d2932bcc3f None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:30.570499 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c8c7d-b79a-4c84-81cd-b0d2932bcc3f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:30.571606 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508c8c7d-b79a-4c84-81cd-b0d2932bcc3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:30.573237 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508c8c7d-b79a-4c84-81cd-b0d2932bcc3f None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:30.574281 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:30.575003 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 29/55] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:16:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:16:30.580357 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508c8c7d-b79a-4c84-81cd-b0d2932bcc3f None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:30.628120 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcf07d4-e685-419f-a239-97c8ffc1055c None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:30.660886 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e008813-1acc-4839-9b4e-3bd25ce1ab4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:30.661474 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e008813-1acc-4839-9b4e-3bd25ce1ab4d None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:30.661754 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e008813-1acc-4839-9b4e-3bd25ce1ab4d None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:30.662023 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e008813-1acc-4839-9b4e-3bd25ce1ab4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:30.662770 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e008813-1acc-4839-9b4e-3bd25ce1ab4d None admin] RBAC: Adding query filter params (role.id=fb48693810be495fb4b1893a79429b78, scope.domain.id=default, user.id=7f20260f94904e78a150a9644ed5191c) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:16:30.663105 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e008813-1acc-4839-9b4e-3bd25ce1ab4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:30.664570 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e008813-1acc-4839-9b4e-3bd25ce1ab4d None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:30.671818 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 27/56] 10.222.0.26 () {56 vars in 1322 bytes} [Fri Aug 12 01:16:30 2022] GET /identity/v3/role_assignments?user.id=7f20260f94904e78a150a9644ed5191c&scope.domain.id=default&role.id=fb48693810be495fb4b1893a79429b78 => generated 530 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:16:30.682487 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508c8c7d-b79a-4c84-81cd-b0d2932bcc3f None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:30.720074 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23066b72-8331-46ce-a7fe-c2b387c35ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:30.720617 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23066b72-8331-46ce-a7fe-c2b387c35ac4 None admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:30.720896 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23066b72-8331-46ce-a7fe-c2b387c35ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:30.721168 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23066b72-8331-46ce-a7fe-c2b387c35ac4 None admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:30.721828 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23066b72-8331-46ce-a7fe-c2b387c35ac4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:30.723359 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23066b72-8331-46ce-a7fe-c2b387c35ac4 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:30.755157 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 30/57] 10.222.0.26 () {60 vars in 1140 bytes} [Fri Aug 12 01:16:30 2022] POST /identity/v3/projects => generated 298 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 01:16:32.639121 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc474ec5-12dc-41f8-9578-a51e99d73acf None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:32.639647 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc474ec5-12dc-41f8-9578-a51e99d73acf None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:32.639647 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc474ec5-12dc-41f8-9578-a51e99d73acf None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:32.640993 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 28/58] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:16:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:16:32.647417 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a014e3-2fb7-4425-adce-c3c79735ded6 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:32.648106 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a014e3-2fb7-4425-adce-c3c79735ded6 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:32.648384 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a014e3-2fb7-4425-adce-c3c79735ded6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:32.675395 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-04a014e3-2fb7-4425-adce-c3c79735ded6 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:16:32.676652 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-04a014e3-2fb7-4425-adce-c3c79735ded6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:16:32.688263 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:32.753516 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 31/59] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:16:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 01:16:33.020577 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc474ec5-12dc-41f8-9578-a51e99d73acf None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:33.132524 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc474ec5-12dc-41f8-9578-a51e99d73acf None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:33.141753 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:33.172870 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54216039-8abf-4da6-b0bc-4c4146dde389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:33.173496 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54216039-8abf-4da6-b0bc-4c4146dde389 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:33.173773 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54216039-8abf-4da6-b0bc-4c4146dde389 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:33.174043 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54216039-8abf-4da6-b0bc-4c4146dde389 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:33.175266 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54216039-8abf-4da6-b0bc-4c4146dde389 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:33.176722 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54216039-8abf-4da6-b0bc-4c4146dde389 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:33.178336 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 29/60] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:16:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:16:33.184571 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a014e3-2fb7-4425-adce-c3c79735ded6 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:33.289177 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a014e3-2fb7-4425-adce-c3c79735ded6 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:33.324792 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3982ff-436d-4b92-a98c-89548e22530d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:33.325384 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3982ff-436d-4b92-a98c-89548e22530d None admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:33.325663 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3982ff-436d-4b92-a98c-89548e22530d None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:33.325936 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3982ff-436d-4b92-a98c-89548e22530d None admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:33.326678 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3982ff-436d-4b92-a98c-89548e22530d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:33.328109 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3982ff-436d-4b92-a98c-89548e22530d None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:33.357752 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 32/61] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Aug 12 01:16:33 2022] POST /identity/v3/users => generated 275 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:16:36.346214 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b3370-8f62-4f43-918a-db9d9dd68775 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:36.346214 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b3370-8f62-4f43-918a-db9d9dd68775 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:36.346214 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b3370-8f62-4f43-918a-db9d9dd68775 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:36.347158 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 30/62] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:16:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:16:36.351274 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a484d623-dd63-4c6d-bafe-49119880c745 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:36.351984 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a484d623-dd63-4c6d-bafe-49119880c745 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:36.352400 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a484d623-dd63-4c6d-bafe-49119880c745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:36.360467 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:36.375786 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-a484d623-dd63-4c6d-bafe-49119880c745 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:16:36.376974 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-a484d623-dd63-4c6d-bafe-49119880c745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:16:36.444087 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc702b-be20-4b6d-aaf0-bc5922224b15 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:36.444367 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc702b-be20-4b6d-aaf0-bc5922224b15 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:36.444644 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc702b-be20-4b6d-aaf0-bc5922224b15 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:36.445977 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 31/63] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:16:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 01:16:36.451322 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9191dfeb-0001-42aa-9c2f-63fe732dea2a None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:36.451669 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9191dfeb-0001-42aa-9c2f-63fe732dea2a None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:36.451946 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9191dfeb-0001-42aa-9c2f-63fe732dea2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:36.456179 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 33/64] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:16:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 01:16:36.484049 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-9191dfeb-0001-42aa-9c2f-63fe732dea2a None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:16:36.485256 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-9191dfeb-0001-42aa-9c2f-63fe732dea2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:16:36.606064 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 32/65] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:16:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 01:16:36.691073 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b776360c-aaf5-40ef-b331-4e31a1d9f939 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:36.691413 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b776360c-aaf5-40ef-b331-4e31a1d9f939 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:36.691634 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b776360c-aaf5-40ef-b331-4e31a1d9f939 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:36.692994 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 34/66] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:16:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:16:36.698385 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d17b6-e1c1-4511-88e2-33aa8ace2ae9 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:36.698670 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d17b6-e1c1-4511-88e2-33aa8ace2ae9 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:36.698957 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d17b6-e1c1-4511-88e2-33aa8ace2ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:36.723125 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-e33d17b6-e1c1-4511-88e2-33aa8ace2ae9 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:16:36.724290 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-e33d17b6-e1c1-4511-88e2-33aa8ace2ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:16:36.776088 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b776360c-aaf5-40ef-b331-4e31a1d9f939 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:36.809223 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 33/67] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:16:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 01:16:36.932270 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b776360c-aaf5-40ef-b331-4e31a1d9f939 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:36.948097 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d17b6-e1c1-4511-88e2-33aa8ace2ae9 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:36.965166 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:36.972337 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce0ae84-f568-4cff-9546-2a6c2e9178ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:36.972987 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce0ae84-f568-4cff-9546-2a6c2e9178ed None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:36.973267 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce0ae84-f568-4cff-9546-2a6c2e9178ed None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:36.973562 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce0ae84-f568-4cff-9546-2a6c2e9178ed None admin] PATH_INFO: `/v3/roles/member` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:36.992219 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce0ae84-f568-4cff-9546-2a6c2e9178ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:16:36.997127 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-3ce0ae84-f568-4cff-9546-2a6c2e9178ed None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 01:16:36.997127 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:16:36.997127 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:16:36.997127 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:16:36.997127 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:16:36.997127 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:16:36.997127 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:16:36.997127 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:16:36.997127 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:16:36.997127 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:16:36.997127 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:16:36.997127 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:16:36.997127 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:16:36.997127 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:16:36.997127 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:16:36.997127 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:16:36.998049 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:16:36.998049 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:16:36.998049 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:16:36.998049 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:16:36.998049 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:16:36.998049 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:16:36.998049 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:16:36.998049 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:16:36.998049 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:16:36.998049 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:16:36.998049 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:16:36.998049 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:16:36.998049 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:16:36.998049 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:16:36.998049 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:16:36.998049 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:16:36.998806 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:16:36.998806 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:16:36.998806 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:16:36.998806 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:16:36.998806 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:16:36.998806 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:16:36.998806 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:16:36.998806 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:16:36.998806 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:16:36.998806 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:16:36.998806 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 01:16:36.998806 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:16:36.998806 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 35/68] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 01:16:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 01:16:37.008574 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce0ae84-f568-4cff-9546-2a6c2e9178ed None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:37.022472 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:37.099496 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d17b6-e1c1-4511-88e2-33aa8ace2ae9 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:37.116409 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce0ae84-f568-4cff-9546-2a6c2e9178ed None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:37.136343 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606ffb66-b9ec-4053-be34-03ab02bfee64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:37.136989 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ffb66-b9ec-4053-be34-03ab02bfee64 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:37.137267 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ffb66-b9ec-4053-be34-03ab02bfee64 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:37.137536 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ffb66-b9ec-4053-be34-03ab02bfee64 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:37.149996 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606ffb66-b9ec-4053-be34-03ab02bfee64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:16:37.150343 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91fe9af-91e9-4799-aca9-c2c6f57b25f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:37.150724 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91fe9af-91e9-4799-aca9-c2c6f57b25f5 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:37.150999 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91fe9af-91e9-4799-aca9-c2c6f57b25f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:37.151260 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91fe9af-91e9-4799-aca9-c2c6f57b25f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:37.151930 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91fe9af-91e9-4799-aca9-c2c6f57b25f5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:16:37.152233 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91fe9af-91e9-4799-aca9-c2c6f57b25f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:37.153613 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91fe9af-91e9-4799-aca9-c2c6f57b25f5 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:37.156324 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-606ffb66-b9ec-4053-be34-03ab02bfee64 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 01:16:37.156324 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:16:37.156324 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:16:37.156324 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:16:37.156324 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:16:37.156324 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:16:37.156324 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:16:37.156324 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:16:37.156324 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:16:37.156324 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:16:37.156324 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:16:37.156324 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:16:37.156324 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:16:37.156324 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:16:37.156324 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:16:37.156324 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:16:37.157205 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:16:37.157205 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:16:37.157205 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:16:37.157205 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:16:37.157205 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:16:37.157205 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:16:37.157205 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:16:37.157205 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:16:37.157205 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:16:37.157205 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:16:37.157205 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:16:37.157205 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:16:37.157205 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:16:37.157205 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:16:37.157205 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:16:37.157205 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:16:37.157983 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:16:37.157983 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:16:37.157983 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:16:37.157983 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:16:37.157983 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:16:37.157983 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:16:37.157983 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:16:37.157983 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:16:37.157983 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:16:37.157983 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:16:37.157983 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 01:16:37.157983 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:16:37.157983 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 34/69] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Aug 12 01:16:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 01:16:37.159510 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d398802-a728-4543-a05f-13f6b3feee93 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:37.159767 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d398802-a728-4543-a05f-13f6b3feee93 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:37.160043 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d398802-a728-4543-a05f-13f6b3feee93 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:37.161453 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 35/70] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:16:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:16:37.162764 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 36/71] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Aug 12 01:16:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:16:37.164011 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e677651-68c9-4b5e-b86d-3fc2201769bc None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:37.164492 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e677651-68c9-4b5e-b86d-3fc2201769bc None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:37.164948 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e677651-68c9-4b5e-b86d-3fc2201769bc None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:37.167106 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91fe9af-91e9-4799-aca9-c2c6f57b25f5 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:37.171545 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 36/72] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:16:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:16:37.171545 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e677651-68c9-4b5e-b86d-3fc2201769bc None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:37.222724 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:37.263517 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:37.270764 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e677651-68c9-4b5e-b86d-3fc2201769bc None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:37.271226 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91fe9af-91e9-4799-aca9-c2c6f57b25f5 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:37.307036 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e502f0-61c6-4000-8aaa-872d85cfbfd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:37.307898 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e502f0-61c6-4000-8aaa-872d85cfbfd0 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:37.308328 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e502f0-61c6-4000-8aaa-872d85cfbfd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:37.308546 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3706793-6ae7-4624-b83b-03ec3cfeddbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:37.308685 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e502f0-61c6-4000-8aaa-872d85cfbfd0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:37.309166 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3706793-6ae7-4624-b83b-03ec3cfeddbc None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:37.309441 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3706793-6ae7-4624-b83b-03ec3cfeddbc None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:37.309709 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3706793-6ae7-4624-b83b-03ec3cfeddbc None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:37.310409 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3706793-6ae7-4624-b83b-03ec3cfeddbc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:16:37.310727 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3706793-6ae7-4624-b83b-03ec3cfeddbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:37.312126 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3706793-6ae7-4624-b83b-03ec3cfeddbc None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:37.318795 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e502f0-61c6-4000-8aaa-872d85cfbfd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:16:37.320401 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 37/73] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 01:16:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:16:37.321786 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88a732-2ca5-43d1-b3f2-47e29fde4e4e None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:37.322193 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88a732-2ca5-43d1-b3f2-47e29fde4e4e None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:37.322467 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88a732-2ca5-43d1-b3f2-47e29fde4e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:37.323941 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-21e502f0-61c6-4000-8aaa-872d85cfbfd0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 01:16:37.323941 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:16:37.323941 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:16:37.323941 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:16:37.323941 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:16:37.323941 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:16:37.323941 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:16:37.323941 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:16:37.323941 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:16:37.323941 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:16:37.323941 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:16:37.323941 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:16:37.323941 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:16:37.323941 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:16:37.323941 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:16:37.323941 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:16:37.324726 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:16:37.324726 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:16:37.324726 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:16:37.324726 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:16:37.324726 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:16:37.324726 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:16:37.324726 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:16:37.324726 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:16:37.324726 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:16:37.324726 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:16:37.324726 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:16:37.324726 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:16:37.324726 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:16:37.324726 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:16:37.324726 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:16:37.324726 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:16:37.325457 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:16:37.325457 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:16:37.325457 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:16:37.325457 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:16:37.325457 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:16:37.325457 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:16:37.325457 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:16:37.325457 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:16:37.325457 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:16:37.325457 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:16:37.325457 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 01:16:37.325457 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:16:37.325457 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 37/74] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Aug 12 01:16:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:16:37.326058 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e502f0-61c6-4000-8aaa-872d85cfbfd0 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:37.346193 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-ed88a732-2ca5-43d1-b3f2-47e29fde4e4e None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:16:37.347411 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-ed88a732-2ca5-43d1-b3f2-47e29fde4e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:16:37.413696 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 38/75] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:16:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 01:16:37.414792 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b35c6c-f25c-4e9e-8b5e-0893d328d37e None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:37.415079 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b35c6c-f25c-4e9e-8b5e-0893d328d37e None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:37.415339 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b35c6c-f25c-4e9e-8b5e-0893d328d37e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:37.427591 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e502f0-61c6-4000-8aaa-872d85cfbfd0 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:37.432990 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-46b35c6c-f25c-4e9e-8b5e-0893d328d37e None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:16:37.434194 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-46b35c6c-f25c-4e9e-8b5e-0893d328d37e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:16:37.444428 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:37.469719 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fde6d9-30ca-44ec-b678-6e7f23170fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:37.470409 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fde6d9-30ca-44ec-b678-6e7f23170fb8 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:37.470738 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fde6d9-30ca-44ec-b678-6e7f23170fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:37.470953 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fde6d9-30ca-44ec-b678-6e7f23170fb8 None admin] PATH_INFO: `/v3/users/5f6ec5f1c46f46ccb2adc6dd83aafb22` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:37.488793 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fde6d9-30ca-44ec-b678-6e7f23170fb8 None admin] RBAC: Authorizing `identity:get_user(user_id=5f6ec5f1c46f46ccb2adc6dd83aafb22)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:37.490320 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fde6d9-30ca-44ec-b678-6e7f23170fb8 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:37.497281 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 38/76] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 01:16:37 2022] GET /identity/v3/users/5f6ec5f1c46f46ccb2adc6dd83aafb22 => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:16:37.497281 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fde6d9-30ca-44ec-b678-6e7f23170fb8 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:37.522279 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 39/77] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:16:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 01:16:37.522279 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b35c6c-f25c-4e9e-8b5e-0893d328d37e None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:37.562102 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:37.607418 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fde6d9-30ca-44ec-b678-6e7f23170fb8 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:37.651041 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c879049-fc9a-4625-b4b4-299500d092b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:37.651684 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c879049-fc9a-4625-b4b4-299500d092b7 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:37.651970 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c879049-fc9a-4625-b4b4-299500d092b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:37.652243 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c879049-fc9a-4625-b4b4-299500d092b7 None admin] PATH_INFO: `/v3/users/7f20260f94904e78a150a9644ed5191c` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:37.653491 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c879049-fc9a-4625-b4b4-299500d092b7 None admin] RBAC: Authorizing `identity:get_user(user_id=7f20260f94904e78a150a9644ed5191c)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:37.654990 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c879049-fc9a-4625-b4b4-299500d092b7 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:37.661280 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 39/78] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 01:16:37 2022] GET /identity/v3/users/7f20260f94904e78a150a9644ed5191c => generated 247 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:16:37.661280 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c879049-fc9a-4625-b4b4-299500d092b7 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:37.668950 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b35c6c-f25c-4e9e-8b5e-0893d328d37e None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:37.705993 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdee8db-e5fd-4fbb-8c40-89d213bfda40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:37.706643 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdee8db-e5fd-4fbb-8c40-89d213bfda40 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:37.706924 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdee8db-e5fd-4fbb-8c40-89d213bfda40 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:37.707193 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdee8db-e5fd-4fbb-8c40-89d213bfda40 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:37.707406 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:37.707860 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdee8db-e5fd-4fbb-8c40-89d213bfda40 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:16:37.708339 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdee8db-e5fd-4fbb-8c40-89d213bfda40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:37.709600 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdee8db-e5fd-4fbb-8c40-89d213bfda40 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:37.718478 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 40/79] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 01:16:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:16:37.719125 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdee8db-e5fd-4fbb-8c40-89d213bfda40 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:37.769802 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c879049-fc9a-4625-b4b4-299500d092b7 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:37.803272 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:37.806656 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bb22a9-0e2f-4fe8-b5e7-d05efad0d01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:37.807281 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb22a9-0e2f-4fe8-b5e7-d05efad0d01c None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:37.807587 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb22a9-0e2f-4fe8-b5e7-d05efad0d01c None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:37.807831 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb22a9-0e2f-4fe8-b5e7-d05efad0d01c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:37.824387 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdee8db-e5fd-4fbb-8c40-89d213bfda40 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:37.857002 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea10349-36ee-4402-bfdd-33802f810435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:37.857607 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea10349-36ee-4402-bfdd-33802f810435 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:37.857884 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea10349-36ee-4402-bfdd-33802f810435 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:37.858177 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea10349-36ee-4402-bfdd-33802f810435 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:37.875982 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bb22a9-0e2f-4fe8-b5e7-d05efad0d01c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:37.877456 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bb22a9-0e2f-4fe8-b5e7-d05efad0d01c None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:37.922350 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:37.926784 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea10349-36ee-4402-bfdd-33802f810435 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:37.928293 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea10349-36ee-4402-bfdd-33802f810435 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:37.981757 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 40/80] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 01:16:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 01:16:37.982825 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bb22a9-0e2f-4fe8-b5e7-d05efad0d01c None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:38.010436 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:38.030306 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 41/81] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 01:16:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 01:16:38.031280 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea10349-36ee-4402-bfdd-33802f810435 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:38.084070 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bb22a9-0e2f-4fe8-b5e7-d05efad0d01c None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:38.118211 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec6f0eb-8f10-4c5d-8cba-87afb6efb2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:38.118955 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6f0eb-8f10-4c5d-8cba-87afb6efb2c6 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:38.119228 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6f0eb-8f10-4c5d-8cba-87afb6efb2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:38.119505 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6f0eb-8f10-4c5d-8cba-87afb6efb2c6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:38.120613 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec6f0eb-8f10-4c5d-8cba-87afb6efb2c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:38.122049 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec6f0eb-8f10-4c5d-8cba-87afb6efb2c6 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:38.123643 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 41/82] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:16:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:16:38.124395 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec6f0eb-8f10-4c5d-8cba-87afb6efb2c6 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:38.128035 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea10349-36ee-4402-bfdd-33802f810435 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:38.136255 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:38.162132 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b719ef-3fd7-47f9-b3a3-82f280da1c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:38.162766 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b719ef-3fd7-47f9-b3a3-82f280da1c8e None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:38.163045 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b719ef-3fd7-47f9-b3a3-82f280da1c8e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:38.163316 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b719ef-3fd7-47f9-b3a3-82f280da1c8e None admin] PATH_INFO: `/v3/users/5f6ec5f1c46f46ccb2adc6dd83aafb22` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:38.164442 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b719ef-3fd7-47f9-b3a3-82f280da1c8e None admin] RBAC: Authorizing `identity:get_user(user_id=5f6ec5f1c46f46ccb2adc6dd83aafb22)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:38.166176 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b719ef-3fd7-47f9-b3a3-82f280da1c8e None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:38.167765 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 42/83] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 01:16:38 2022] GET /identity/v3/users/5f6ec5f1c46f46ccb2adc6dd83aafb22 => generated 275 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:16:38.168533 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b719ef-3fd7-47f9-b3a3-82f280da1c8e None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:38.216733 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:38.224798 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec6f0eb-8f10-4c5d-8cba-87afb6efb2c6 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:38.260077 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b7141b-4091-4b3b-a72d-7b2e993768d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:38.260713 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7141b-4091-4b3b-a72d-7b2e993768d0 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:38.260985 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7141b-4091-4b3b-a72d-7b2e993768d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:38.261246 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7141b-4091-4b3b-a72d-7b2e993768d0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:38.266682 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b719ef-3fd7-47f9-b3a3-82f280da1c8e None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:38.271241 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b7141b-4091-4b3b-a72d-7b2e993768d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:16:38.275970 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-a8b7141b-4091-4b3b-a72d-7b2e993768d0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 01:16:38.275970 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:16:38.275970 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:16:38.275970 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:16:38.275970 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:16:38.275970 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:16:38.275970 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:16:38.275970 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:16:38.275970 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:16:38.275970 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:16:38.275970 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:16:38.275970 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:16:38.275970 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:16:38.275970 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:16:38.275970 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:16:38.275970 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:16:38.276811 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:16:38.276811 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:16:38.276811 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:16:38.276811 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:16:38.276811 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:16:38.276811 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:16:38.276811 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:16:38.276811 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:16:38.276811 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:16:38.276811 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:16:38.276811 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:16:38.276811 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:16:38.276811 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:16:38.276811 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:16:38.276811 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:16:38.276811 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:16:38.277562 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:16:38.277562 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:16:38.277562 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:16:38.277562 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:16:38.277562 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:16:38.277562 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:16:38.277562 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:16:38.277562 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:16:38.277562 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:16:38.277562 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:16:38.277562 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 01:16:38.277562 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:16:38.277562 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 42/84] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 01:16:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:16:38.278681 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b7141b-4091-4b3b-a72d-7b2e993768d0 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:38.304887 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3feb68b-a235-4be7-accc-ec254498736e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:38.305449 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3feb68b-a235-4be7-accc-ec254498736e None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:38.305721 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3feb68b-a235-4be7-accc-ec254498736e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:38.306097 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3feb68b-a235-4be7-accc-ec254498736e None admin] PATH_INFO: `/v3/projects/d979106c8a164d55aa33fdb5ea995c7a` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:38.307258 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3feb68b-a235-4be7-accc-ec254498736e None admin] RBAC: Authorizing `identity:get_project(project_id=d979106c8a164d55aa33fdb5ea995c7a)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:38.308684 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3feb68b-a235-4be7-accc-ec254498736e None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:38.310316 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 43/85] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 01:16:38 2022] GET /identity/v3/projects/d979106c8a164d55aa33fdb5ea995c7a => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:16:38.311039 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3feb68b-a235-4be7-accc-ec254498736e None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:38.347233 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:38.379944 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b7141b-4091-4b3b-a72d-7b2e993768d0 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:38.409192 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3feb68b-a235-4be7-accc-ec254498736e None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:38.412679 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1ef872-ece7-45b0-bf77-2adb5214451c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:38.413313 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ef872-ece7-45b0-bf77-2adb5214451c None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:38.413593 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ef872-ece7-45b0-bf77-2adb5214451c None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:38.413866 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ef872-ece7-45b0-bf77-2adb5214451c None admin] PATH_INFO: `/v3/projects/d979106c8a164d55aa33fdb5ea995c7a` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:38.415018 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1ef872-ece7-45b0-bf77-2adb5214451c None admin] RBAC: Authorizing `identity:get_project(project_id=d979106c8a164d55aa33fdb5ea995c7a)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:38.416492 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1ef872-ece7-45b0-bf77-2adb5214451c None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:38.418143 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 43/86] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 01:16:38 2022] GET /identity/v3/projects/d979106c8a164d55aa33fdb5ea995c7a => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:16:38.423783 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1ef872-ece7-45b0-bf77-2adb5214451c None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:38.427338 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:38.445547 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1941d14-b4b7-4ce8-b516-c468469ebec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:38.446194 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1941d14-b4b7-4ce8-b516-c468469ebec5 None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:38.446556 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1941d14-b4b7-4ce8-b516-c468469ebec5 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:38.446804 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1941d14-b4b7-4ce8-b516-c468469ebec5 None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:38.447441 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1941d14-b4b7-4ce8-b516-c468469ebec5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:38.448874 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1941d14-b4b7-4ce8-b516-c468469ebec5 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:38.476337 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 44/87] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Aug 12 01:16:38 2022] POST /identity/v3/users => generated 289 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:16:38.478539 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1941d14-b4b7-4ce8-b516-c468469ebec5 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:38.539412 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1ef872-ece7-45b0-bf77-2adb5214451c None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:38.590653 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d027a8-1866-4e10-ab85-d1afd66338e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:38.591535 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d027a8-1866-4e10-ab85-d1afd66338e4 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:38.591952 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d027a8-1866-4e10-ab85-d1afd66338e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:38.592291 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1941d14-b4b7-4ce8-b516-c468469ebec5 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:38.592506 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d027a8-1866-4e10-ab85-d1afd66338e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:38.597214 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:38.632902 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b32712-6849-466a-8520-68429f6c33da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:38.633635 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b32712-6849-466a-8520-68429f6c33da None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:38.634250 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b32712-6849-466a-8520-68429f6c33da None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:38.634572 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b32712-6849-466a-8520-68429f6c33da None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:38.635266 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b32712-6849-466a-8520-68429f6c33da None admin] RBAC: Adding query filter params (name=member) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:16:38.635596 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b32712-6849-466a-8520-68429f6c33da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:38.636994 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b32712-6849-466a-8520-68429f6c33da None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:38.646831 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 45/88] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Aug 12 01:16:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:16:38.647667 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b32712-6849-466a-8520-68429f6c33da None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:38.679850 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d027a8-1866-4e10-ab85-d1afd66338e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:38.681835 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d027a8-1866-4e10-ab85-d1afd66338e4 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:38.686294 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:38.768719 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b32712-6849-466a-8520-68429f6c33da None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:38.803107 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 44/89] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 01:16:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 01:16:38.803836 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d027a8-1866-4e10-ab85-d1afd66338e4 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:38.810136 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a0e017-962a-4c72-9b6d-c6d15e174da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:38.810136 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0e017-962a-4c72-9b6d-c6d15e174da0 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:38.810136 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0e017-962a-4c72-9b6d-c6d15e174da0 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:38.810136 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0e017-962a-4c72-9b6d-c6d15e174da0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:38.810473 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a0e017-962a-4c72-9b6d-c6d15e174da0 None admin] RBAC: Adding query filter params (role.id=13af81971c1c428eae0a571a22ea583d, scope.project.id=d979106c8a164d55aa33fdb5ea995c7a, user.id=5f6ec5f1c46f46ccb2adc6dd83aafb22) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:16:38.810473 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a0e017-962a-4c72-9b6d-c6d15e174da0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:38.810473 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a0e017-962a-4c72-9b6d-c6d15e174da0 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:38.816205 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 46/90] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 01:16:38 2022] GET /identity/v3/role_assignments?user.id=5f6ec5f1c46f46ccb2adc6dd83aafb22&scope.project.id=d979106c8a164d55aa33fdb5ea995c7a&role.id=13af81971c1c428eae0a571a22ea583d => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:16:38.817013 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a0e017-962a-4c72-9b6d-c6d15e174da0 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:38.850651 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:38.918743 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d027a8-1866-4e10-ab85-d1afd66338e4 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:38.960793 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:38.967389 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a0e017-962a-4c72-9b6d-c6d15e174da0 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:38.969899 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434e846b-5407-4373-bc2b-af3b533a7222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:38.971308 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e846b-5407-4373-bc2b-af3b533a7222 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:38.971308 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e846b-5407-4373-bc2b-af3b533a7222 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:38.971308 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e846b-5407-4373-bc2b-af3b533a7222 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:38.971970 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434e846b-5407-4373-bc2b-af3b533a7222 None admin] RBAC: Adding query filter params (role.id=fb48693810be495fb4b1893a79429b78, scope.project.id=d979106c8a164d55aa33fdb5ea995c7a, user.id=7f20260f94904e78a150a9644ed5191c) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:16:38.972339 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434e846b-5407-4373-bc2b-af3b533a7222 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:38.974088 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434e846b-5407-4373-bc2b-af3b533a7222 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:38.981864 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 45/91] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 01:16:38 2022] GET /identity/v3/role_assignments?user.id=7f20260f94904e78a150a9644ed5191c&scope.project.id=d979106c8a164d55aa33fdb5ea995c7a&role.id=fb48693810be495fb4b1893a79429b78 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:16:38.982676 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434e846b-5407-4373-bc2b-af3b533a7222 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:39.065282 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b356e-7ce0-421c-b7f6-f803f06595fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:39.065946 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b356e-7ce0-421c-b7f6-f803f06595fe None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:39.066249 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b356e-7ce0-421c-b7f6-f803f06595fe None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:39.066523 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b356e-7ce0-421c-b7f6-f803f06595fe None admin] PATH_INFO: `/v3/users/5f6ec5f1c46f46ccb2adc6dd83aafb22` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:39.068551 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03b356e-7ce0-421c-b7f6-f803f06595fe None admin] RBAC: Authorizing `identity:get_user(user_id=5f6ec5f1c46f46ccb2adc6dd83aafb22)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:39.071985 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03b356e-7ce0-421c-b7f6-f803f06595fe None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:39.074373 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 47/92] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 01:16:38 2022] GET /identity/v3/users/5f6ec5f1c46f46ccb2adc6dd83aafb22 => generated 275 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:16:39.080407 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b356e-7ce0-421c-b7f6-f803f06595fe None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:39.204476 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b356e-7ce0-421c-b7f6-f803f06595fe None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:39.207067 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:39.215669 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434e846b-5407-4373-bc2b-af3b533a7222 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:39.282509 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73157cec-6014-4452-b300-f4967f59c9a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:39.283168 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73157cec-6014-4452-b300-f4967f59c9a6 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:39.283448 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73157cec-6014-4452-b300-f4967f59c9a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:39.283720 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73157cec-6014-4452-b300-f4967f59c9a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:39.291955 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531a1353-8657-428a-91d0-d89b954aa37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:39.292614 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a1353-8657-428a-91d0-d89b954aa37d None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:39.292893 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a1353-8657-428a-91d0-d89b954aa37d None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:39.293171 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a1353-8657-428a-91d0-d89b954aa37d None admin] PATH_INFO: `/v3/projects/d979106c8a164d55aa33fdb5ea995c7a` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:39.295302 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531a1353-8657-428a-91d0-d89b954aa37d None admin] RBAC: Authorizing `identity:get_project(project_id=d979106c8a164d55aa33fdb5ea995c7a)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:39.296771 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531a1353-8657-428a-91d0-d89b954aa37d None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:39.307386 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 46/93] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 01:16:38 2022] GET /identity/v3/projects/d979106c8a164d55aa33fdb5ea995c7a => generated 298 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:16:39.314898 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531a1353-8657-428a-91d0-d89b954aa37d None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:39.365870 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:39.427769 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73157cec-6014-4452-b300-f4967f59c9a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:39.430039 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73157cec-6014-4452-b300-f4967f59c9a6 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:39.580964 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531a1353-8657-428a-91d0-d89b954aa37d None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:39.611410 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 48/94] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 01:16:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 12 01:16:39.617127 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73157cec-6014-4452-b300-f4967f59c9a6 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:39.666837 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3416f494-ee6a-4575-a0ad-1f11c7df3e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:39.667707 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416f494-ee6a-4575-a0ad-1f11c7df3e4d None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:39.668126 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416f494-ee6a-4575-a0ad-1f11c7df3e4d None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:39.668643 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416f494-ee6a-4575-a0ad-1f11c7df3e4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:39.669833 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3416f494-ee6a-4575-a0ad-1f11c7df3e4d None admin] RBAC: Adding query filter params (role.id=bab2af60c26640acbd0c4db2f9796cfb, scope.project.id=d979106c8a164d55aa33fdb5ea995c7a, user.id=5f6ec5f1c46f46ccb2adc6dd83aafb22) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:16:39.670328 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3416f494-ee6a-4575-a0ad-1f11c7df3e4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:39.671926 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3416f494-ee6a-4575-a0ad-1f11c7df3e4d None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:39.680514 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 47/95] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 01:16:39 2022] GET /identity/v3/role_assignments?user.id=5f6ec5f1c46f46ccb2adc6dd83aafb22&scope.project.id=d979106c8a164d55aa33fdb5ea995c7a&role.id=bab2af60c26640acbd0c4db2f9796cfb => generated 259 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:16:39.722864 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:39.780811 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73157cec-6014-4452-b300-f4967f59c9a6 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:39.831117 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aa9404-ba8a-47c5-8f28-4d1233bd12ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:39.831778 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa9404-ba8a-47c5-8f28-4d1233bd12ea None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:39.832058 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa9404-ba8a-47c5-8f28-4d1233bd12ea None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:39.832333 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa9404-ba8a-47c5-8f28-4d1233bd12ea None admin] PATH_INFO: `/v3/projects/b934d2629fc5478a95bfd0633b589a39` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:39.834915 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aa9404-ba8a-47c5-8f28-4d1233bd12ea None admin] RBAC: Authorizing `identity:get_project(project_id=b934d2629fc5478a95bfd0633b589a39)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:39.836394 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aa9404-ba8a-47c5-8f28-4d1233bd12ea None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:39.838595 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 49/96] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 01:16:39 2022] GET /identity/v3/projects/b934d2629fc5478a95bfd0633b589a39 => generated 312 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:16:39.844805 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3416f494-ee6a-4575-a0ad-1f11c7df3e4d None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:39.899042 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:39.994827 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3416f494-ee6a-4575-a0ad-1f11c7df3e4d None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:40.042285 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb993b7-fd9b-4ea1-ac4e-d0ed888535d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:40.043186 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb993b7-fd9b-4ea1-ac4e-d0ed888535d2 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:40.043657 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb993b7-fd9b-4ea1-ac4e-d0ed888535d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:40.044129 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb993b7-fd9b-4ea1-ac4e-d0ed888535d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:40.045352 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb993b7-fd9b-4ea1-ac4e-d0ed888535d2 None admin] RBAC: Adding query filter params (role.id=13af81971c1c428eae0a571a22ea583d, scope.project.id=b934d2629fc5478a95bfd0633b589a39, user.id=5f6ec5f1c46f46ccb2adc6dd83aafb22) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:16:40.045865 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb993b7-fd9b-4ea1-ac4e-d0ed888535d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:40.047541 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb993b7-fd9b-4ea1-ac4e-d0ed888535d2 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:40.058905 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 48/97] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 01:16:39 2022] GET /identity/v3/role_assignments?user.id=5f6ec5f1c46f46ccb2adc6dd83aafb22&scope.project.id=b934d2629fc5478a95bfd0633b589a39&role.id=13af81971c1c428eae0a571a22ea583d => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:16:40.729973 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd09e1-ceb0-4604-b85d-95bcea5d3c63 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:40.730527 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd09e1-ceb0-4604-b85d-95bcea5d3c63 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:40.730601 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd09e1-ceb0-4604-b85d-95bcea5d3c63 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:40.731882 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 50/98] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:16:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:16:40.747236 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574afb9-200d-47c2-a3e8-a3c84a283994 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:40.747627 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574afb9-200d-47c2-a3e8-a3c84a283994 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:40.747699 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574afb9-200d-47c2-a3e8-a3c84a283994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:40.771806 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-1574afb9-200d-47c2-a3e8-a3c84a283994 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:16:40.773040 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-1574afb9-200d-47c2-a3e8-a3c84a283994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:16:40.859069 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 49/99] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:16:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 01:16:41.126054 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdd09e1-ceb0-4604-b85d-95bcea5d3c63 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:41.256615 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdd09e1-ceb0-4604-b85d-95bcea5d3c63 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:41.292118 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80026cc6-ca22-4906-a233-0ac60d70bc54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:41.292758 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80026cc6-ca22-4906-a233-0ac60d70bc54 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:41.293032 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80026cc6-ca22-4906-a233-0ac60d70bc54 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:41.293299 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80026cc6-ca22-4906-a233-0ac60d70bc54 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:41.295521 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:41.305030 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80026cc6-ca22-4906-a233-0ac60d70bc54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:16:41.309942 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-80026cc6-ca22-4906-a233-0ac60d70bc54 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 01:16:41.309942 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:16:41.309942 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:16:41.309942 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:16:41.309942 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:16:41.309942 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:16:41.309942 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:16:41.309942 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:16:41.309942 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:16:41.309942 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:16:41.309942 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:16:41.309942 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:16:41.309942 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:16:41.309942 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:16:41.309942 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:16:41.309942 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:16:41.310800 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:16:41.310800 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:16:41.310800 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:16:41.310800 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:16:41.310800 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:16:41.310800 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:16:41.310800 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:16:41.310800 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:16:41.310800 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:16:41.310800 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:16:41.310800 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:16:41.310800 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:16:41.310800 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:16:41.310800 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:16:41.310800 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:16:41.310800 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:16:41.311538 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:16:41.311538 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:16:41.311538 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:16:41.311538 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:16:41.311538 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:16:41.311538 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:16:41.311538 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:16:41.311538 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:16:41.311538 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:16:41.311538 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:16:41.311538 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 01:16:41.311538 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:16:41.311538 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 51/100] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 01:16:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:16:41.316954 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1574afb9-200d-47c2-a3e8-a3c84a283994 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:41.345970 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:41.426015 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1574afb9-200d-47c2-a3e8-a3c84a283994 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:41.465538 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd3a26a-9518-49b2-9eae-06edc661344b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:41.466177 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3a26a-9518-49b2-9eae-06edc661344b None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:41.466459 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3a26a-9518-49b2-9eae-06edc661344b None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:41.466731 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3a26a-9518-49b2-9eae-06edc661344b None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:41.467460 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd3a26a-9518-49b2-9eae-06edc661344b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:16:41.467764 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd3a26a-9518-49b2-9eae-06edc661344b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:41.469125 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd3a26a-9518-49b2-9eae-06edc661344b None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:41.478447 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 50/101] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Aug 12 01:16:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:16:41.484426 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80026cc6-ca22-4906-a233-0ac60d70bc54 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:41.615831 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80026cc6-ca22-4906-a233-0ac60d70bc54 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:41.658393 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9538113b-5a51-4980-9d43-8748d188116e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:41.659032 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538113b-5a51-4980-9d43-8748d188116e None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:41.659309 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538113b-5a51-4980-9d43-8748d188116e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:41.659575 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538113b-5a51-4980-9d43-8748d188116e None admin] PATH_INFO: `/v3/users/2630819f4ef249b7a6c4325ce54d0d0a` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:41.678959 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9538113b-5a51-4980-9d43-8748d188116e None admin] RBAC: Authorizing `identity:get_user(user_id=2630819f4ef249b7a6c4325ce54d0d0a)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:41.680416 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9538113b-5a51-4980-9d43-8748d188116e None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:41.682132 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 52/102] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 01:16:41 2022] GET /identity/v3/users/2630819f4ef249b7a6c4325ce54d0d0a => generated 289 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:16:41.688043 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd3a26a-9518-49b2-9eae-06edc661344b None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:41.804295 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:41.817436 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd3a26a-9518-49b2-9eae-06edc661344b None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:41.828655 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f72d1e-4ba3-409a-a93a-c2cfca3a8e35 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:41.829823 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f72d1e-4ba3-409a-a93a-c2cfca3a8e35 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:41.830340 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f72d1e-4ba3-409a-a93a-c2cfca3a8e35 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:41.832476 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 53/103] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:16:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 01:16:41.839621 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17191e6-4453-4bec-8641-346dd49a4cb2 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:41.839903 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17191e6-4453-4bec-8641-346dd49a4cb2 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:41.840180 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17191e6-4453-4bec-8641-346dd49a4cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:41.866340 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-f17191e6-4453-4bec-8641-346dd49a4cb2 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:16:41.867555 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f17191e6-4453-4bec-8641-346dd49a4cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:16:41.871959 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bb8fdd-79da-48d8-9a52-4e61fb469b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:41.872876 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb8fdd-79da-48d8-9a52-4e61fb469b30 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:41.873376 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb8fdd-79da-48d8-9a52-4e61fb469b30 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:41.873844 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb8fdd-79da-48d8-9a52-4e61fb469b30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:41.946999 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:41.970556 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 54/104] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:16:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 01:16:41.972249 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a1693-ca70-47a6-bfa3-ea82ef5dbcc0 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:41.972730 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a1693-ca70-47a6-bfa3-ea82ef5dbcc0 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:41.973218 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a1693-ca70-47a6-bfa3-ea82ef5dbcc0 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:41.974668 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 55/105] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:16:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:16:41.987547 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352f17b-dcd2-4325-9c5f-3cf88363ae57 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:41.987835 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352f17b-dcd2-4325-9c5f-3cf88363ae57 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:41.988101 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352f17b-dcd2-4325-9c5f-3cf88363ae57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:42.007207 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bb8fdd-79da-48d8-9a52-4e61fb469b30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:42.008679 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bb8fdd-79da-48d8-9a52-4e61fb469b30 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:42.031175 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-9352f17b-dcd2-4325-9c5f-3cf88363ae57 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:16:42.032534 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-9352f17b-dcd2-4325-9c5f-3cf88363ae57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:16:42.148832 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 56/106] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:16:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 01:16:42.200517 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:42.215695 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca79884-a860-4933-8b68-8e1ac452058f None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:42.215984 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca79884-a860-4933-8b68-8e1ac452058f None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:42.216248 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca79884-a860-4933-8b68-8e1ac452058f None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:42.216805 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 51/107] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 01:16:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 01:16:42.217572 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 57/108] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:16:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 01:16:42.222916 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bb8fdd-79da-48d8-9a52-4e61fb469b30 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:42.233853 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02481552-9ee7-4a48-a9aa-c64750129dc0 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:42.234170 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02481552-9ee7-4a48-a9aa-c64750129dc0 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:42.234440 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02481552-9ee7-4a48-a9aa-c64750129dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:42.271822 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-02481552-9ee7-4a48-a9aa-c64750129dc0 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:16:42.272999 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-02481552-9ee7-4a48-a9aa-c64750129dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:16:42.378921 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bb8fdd-79da-48d8-9a52-4e61fb469b30 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:42.420604 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996e808d-68d1-4599-8e14-60dd62a31bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:42.421642 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e808d-68d1-4599-8e14-60dd62a31bd0 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:42.422136 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e808d-68d1-4599-8e14-60dd62a31bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:42.422630 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e808d-68d1-4599-8e14-60dd62a31bd0 None admin] PATH_INFO: `/v3/projects/d979106c8a164d55aa33fdb5ea995c7a` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:42.423946 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996e808d-68d1-4599-8e14-60dd62a31bd0 None admin] RBAC: Authorizing `identity:get_project(project_id=d979106c8a164d55aa33fdb5ea995c7a)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:42.425578 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996e808d-68d1-4599-8e14-60dd62a31bd0 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:42.427534 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 52/109] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 01:16:42 2022] GET /identity/v3/projects/d979106c8a164d55aa33fdb5ea995c7a => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:16:42.428919 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedac36e-60f2-4118-a40f-94a6b7577705 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:42.429273 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 58/110] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:16:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 01:16:42.429633 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedac36e-60f2-4118-a40f-94a6b7577705 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:42.430149 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedac36e-60f2-4118-a40f-94a6b7577705 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:42.431734 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 53/111] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:16:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:16:42.433424 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02481552-9ee7-4a48-a9aa-c64750129dc0 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:42.442421 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ed484-250b-442c-9a86-00085efaeb21 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:42.442996 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ed484-250b-442c-9a86-00085efaeb21 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:42.443475 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ed484-250b-442c-9a86-00085efaeb21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:42.462232 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-0d1ed484-250b-442c-9a86-00085efaeb21 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:16:42.463506 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-0d1ed484-250b-442c-9a86-00085efaeb21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:16:42.495818 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:42.518483 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:42.532196 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 54/112] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:16:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 01:16:42.533169 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ed484-250b-442c-9a86-00085efaeb21 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:42.633366 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02481552-9ee7-4a48-a9aa-c64750129dc0 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:42.646425 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ed484-250b-442c-9a86-00085efaeb21 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:42.673509 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4cb213-e414-4fc5-b783-a2fef1097565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:42.674257 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4cb213-e414-4fc5-b783-a2fef1097565 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:42.674640 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4cb213-e414-4fc5-b783-a2fef1097565 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:42.674917 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4cb213-e414-4fc5-b783-a2fef1097565 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:42.675659 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4cb213-e414-4fc5-b783-a2fef1097565 None admin] RBAC: Adding query filter params (role.id=d3ac26b4075941a7a84580ef43d093f6, scope.project.id=d979106c8a164d55aa33fdb5ea995c7a, user.id=2630819f4ef249b7a6c4325ce54d0d0a) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:16:42.675971 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4cb213-e414-4fc5-b783-a2fef1097565 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:42.677635 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4cb213-e414-4fc5-b783-a2fef1097565 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:42.682316 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4351a345-5900-4180-84b4-7b2afc6aec36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:42.682961 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4351a345-5900-4180-84b4-7b2afc6aec36 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:42.683300 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4351a345-5900-4180-84b4-7b2afc6aec36 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:42.683472 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 59/113] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 01:16:42 2022] GET /identity/v3/role_assignments?user.id=2630819f4ef249b7a6c4325ce54d0d0a&scope.project.id=d979106c8a164d55aa33fdb5ea995c7a&role.id=d3ac26b4075941a7a84580ef43d093f6 => generated 259 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:16:42.683880 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4351a345-5900-4180-84b4-7b2afc6aec36 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:42.684319 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4cb213-e414-4fc5-b783-a2fef1097565 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:42.696312 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4351a345-5900-4180-84b4-7b2afc6aec36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:16:42.701277 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-4351a345-5900-4180-84b4-7b2afc6aec36 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 01:16:42.701277 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:16:42.701277 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:16:42.701277 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:16:42.701277 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:16:42.701277 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:16:42.701277 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:16:42.701277 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:16:42.701277 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:16:42.701277 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:16:42.701277 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:16:42.701277 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:16:42.701277 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:16:42.701277 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:16:42.701277 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:16:42.701277 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:16:42.702173 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:16:42.702173 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:16:42.702173 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:16:42.702173 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:16:42.702173 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:16:42.702173 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:16:42.702173 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:16:42.702173 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:16:42.702173 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:16:42.702173 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:16:42.702173 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:16:42.702173 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:16:42.702173 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:16:42.702173 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:16:42.702173 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:16:42.702173 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:16:42.703359 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:16:42.703359 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:16:42.703359 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:16:42.703359 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:16:42.703359 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:16:42.703359 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:16:42.703359 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:16:42.703359 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:16:42.703359 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:16:42.703359 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:16:42.703359 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 01:16:42.703359 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:16:42.703359 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 55/114] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Aug 12 01:16:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:16:42.708433 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4351a345-5900-4180-84b4-7b2afc6aec36 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:42.771990 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:42.801795 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4cb213-e414-4fc5-b783-a2fef1097565 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:42.810422 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:42.841725 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e791b4eb-8e88-4b5a-a6a3-834def5a2821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:42.842492 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791b4eb-8e88-4b5a-a6a3-834def5a2821 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:42.842787 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791b4eb-8e88-4b5a-a6a3-834def5a2821 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:42.843060 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791b4eb-8e88-4b5a-a6a3-834def5a2821 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:42.844246 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e791b4eb-8e88-4b5a-a6a3-834def5a2821 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:42.845886 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e791b4eb-8e88-4b5a-a6a3-834def5a2821 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:42.852253 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 60/115] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:16:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:16:42.853587 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e791b4eb-8e88-4b5a-a6a3-834def5a2821 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:42.904015 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4351a345-5900-4180-84b4-7b2afc6aec36 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:42.956506 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807573dd-3908-44a5-94bf-815358244271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:42.957179 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807573dd-3908-44a5-94bf-815358244271 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:42.957457 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807573dd-3908-44a5-94bf-815358244271 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:42.957729 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807573dd-3908-44a5-94bf-815358244271 None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:42.958475 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807573dd-3908-44a5-94bf-815358244271 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:16:42.958778 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807573dd-3908-44a5-94bf-815358244271 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:42.960707 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807573dd-3908-44a5-94bf-815358244271 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:42.973172 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 56/116] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 01:16:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:16:42.978465 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807573dd-3908-44a5-94bf-815358244271 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:42.979938 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e791b4eb-8e88-4b5a-a6a3-834def5a2821 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:43.023539 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44628c5-8cb7-482a-8bb2-991b86d6512e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:43.024266 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44628c5-8cb7-482a-8bb2-991b86d6512e None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:43.024729 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44628c5-8cb7-482a-8bb2-991b86d6512e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:43.025190 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44628c5-8cb7-482a-8bb2-991b86d6512e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:43.039330 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44628c5-8cb7-482a-8bb2-991b86d6512e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:16:43.046952 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-c44628c5-8cb7-482a-8bb2-991b86d6512e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 01:16:43.046952 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:16:43.046952 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:16:43.046952 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:16:43.046952 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:16:43.046952 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:16:43.046952 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:16:43.046952 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:16:43.046952 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:16:43.046952 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:16:43.046952 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:16:43.046952 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:16:43.046952 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:16:43.046952 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:16:43.046952 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:16:43.046952 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:16:43.047823 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:16:43.047823 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:16:43.047823 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:16:43.047823 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:16:43.047823 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:16:43.047823 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:16:43.047823 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:16:43.047823 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:16:43.047823 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:16:43.047823 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:16:43.047823 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:16:43.047823 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:16:43.047823 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:16:43.047823 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:16:43.047823 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:16:43.047823 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:16:43.048688 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:16:43.048688 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:16:43.048688 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:16:43.048688 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:16:43.048688 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:16:43.048688 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:16:43.048688 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:16:43.048688 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:16:43.048688 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:16:43.048688 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:16:43.048688 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 01:16:43.048688 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:16:43.048688 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 61/117] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 01:16:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:16:43.049299 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44628c5-8cb7-482a-8bb2-991b86d6512e None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:43.098337 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:43.121746 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807573dd-3908-44a5-94bf-815358244271 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:43.134875 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:43.168815 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb788f-0b47-4038-b319-d9353f81776e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:43.169953 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb788f-0b47-4038-b319-d9353f81776e None admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:43.170361 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb788f-0b47-4038-b319-d9353f81776e None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:43.170730 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb788f-0b47-4038-b319-d9353f81776e None admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:43.171475 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bb788f-0b47-4038-b319-d9353f81776e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:43.173015 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bb788f-0b47-4038-b319-d9353f81776e None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:43.187755 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44628c5-8cb7-482a-8bb2-991b86d6512e None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:43.202377 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 57/118] 10.222.0.26 () {60 vars in 1141 bytes} [Fri Aug 12 01:16:42 2022] POST /identity/v3/projects => generated 302 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:16:43.203062 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb788f-0b47-4038-b319-d9353f81776e None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:43.231518 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef4d691-0a20-41d0-8ab6-0b73f3df3379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:43.232234 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4d691-0a20-41d0-8ab6-0b73f3df3379 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:43.232787 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4d691-0a20-41d0-8ab6-0b73f3df3379 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:43.232896 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4d691-0a20-41d0-8ab6-0b73f3df3379 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:43.245257 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef4d691-0a20-41d0-8ab6-0b73f3df3379 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:16:43.250445 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-4ef4d691-0a20-41d0-8ab6-0b73f3df3379 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 01:16:43.250445 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:16:43.250445 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:16:43.250445 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:16:43.250445 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:16:43.250445 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:16:43.250445 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:16:43.250445 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:16:43.250445 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:16:43.250445 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:16:43.250445 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:16:43.250445 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:16:43.250445 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:16:43.250445 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:16:43.250445 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:16:43.250445 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:16:43.251365 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:16:43.251365 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:16:43.251365 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:16:43.251365 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:16:43.251365 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:16:43.251365 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:16:43.251365 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:16:43.251365 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:16:43.251365 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:16:43.251365 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:16:43.251365 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:16:43.251365 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:16:43.251365 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:16:43.251365 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:16:43.251365 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:16:43.251365 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:16:43.252137 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:16:43.252137 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:16:43.252137 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:16:43.252137 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:16:43.252137 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:16:43.252137 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:16:43.252137 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:16:43.252137 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:16:43.252137 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:16:43.252137 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:16:43.252137 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 01:16:43.252137 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:16:43.252137 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 62/119] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Aug 12 01:16:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:16:43.252772 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef4d691-0a20-41d0-8ab6-0b73f3df3379 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:43.338081 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb788f-0b47-4038-b319-d9353f81776e None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:43.364128 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:43.372768 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef4d691-0a20-41d0-8ab6-0b73f3df3379 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:43.378864 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4857b823-c3e2-4dc6-8fcb-afd12976e40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:43.379757 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4857b823-c3e2-4dc6-8fcb-afd12976e40a None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:43.380235 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4857b823-c3e2-4dc6-8fcb-afd12976e40a None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:43.381581 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4857b823-c3e2-4dc6-8fcb-afd12976e40a None admin] PATH_INFO: `/v3/users/7f20260f94904e78a150a9644ed5191c` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:43.383002 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4857b823-c3e2-4dc6-8fcb-afd12976e40a None admin] RBAC: Authorizing `identity:get_user(user_id=7f20260f94904e78a150a9644ed5191c)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:43.384863 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4857b823-c3e2-4dc6-8fcb-afd12976e40a None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:43.386750 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 58/120] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 01:16:43 2022] GET /identity/v3/users/7f20260f94904e78a150a9644ed5191c => generated 247 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:16:43.388132 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632aa966-7514-488e-9358-cf5d7b65e084 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:43.388616 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632aa966-7514-488e-9358-cf5d7b65e084 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:43.389085 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632aa966-7514-488e-9358-cf5d7b65e084 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:43.390535 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 59/121] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:16:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:16:43.391416 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632aa966-7514-488e-9358-cf5d7b65e084 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:43.416872 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d711d72b-b929-440a-bf6c-950af1225368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:43.417517 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d711d72b-b929-440a-bf6c-950af1225368 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:43.417791 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d711d72b-b929-440a-bf6c-950af1225368 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:43.418067 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d711d72b-b929-440a-bf6c-950af1225368 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:43.418946 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d711d72b-b929-440a-bf6c-950af1225368 None admin] RBAC: Adding query filter params (name=member) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:16:43.419565 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d711d72b-b929-440a-bf6c-950af1225368 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:43.421307 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d711d72b-b929-440a-bf6c-950af1225368 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:43.431775 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:43.435591 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 63/122] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Aug 12 01:16:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:16:43.435591 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d711d72b-b929-440a-bf6c-950af1225368 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:43.526892 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632aa966-7514-488e-9358-cf5d7b65e084 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:43.563008 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d711d72b-b929-440a-bf6c-950af1225368 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:43.574484 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687835c6-0515-45ac-bcd3-9d8c146aa9bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:43.575419 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687835c6-0515-45ac-bcd3-9d8c146aa9bd None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:43.575890 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687835c6-0515-45ac-bcd3-9d8c146aa9bd None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:43.576363 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687835c6-0515-45ac-bcd3-9d8c146aa9bd None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:43.577242 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687835c6-0515-45ac-bcd3-9d8c146aa9bd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:16:43.577737 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687835c6-0515-45ac-bcd3-9d8c146aa9bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:43.579345 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687835c6-0515-45ac-bcd3-9d8c146aa9bd None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:43.593584 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 60/123] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 01:16:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:16:43.595225 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf10ad6-fe3a-4903-94d7-ae950d17fe05 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:43.595721 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf10ad6-fe3a-4903-94d7-ae950d17fe05 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:43.596197 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf10ad6-fe3a-4903-94d7-ae950d17fe05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:43.601585 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9051ffa-eb74-4fc8-8210-a2121bb4cec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:43.602386 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9051ffa-eb74-4fc8-8210-a2121bb4cec1 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:43.602887 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9051ffa-eb74-4fc8-8210-a2121bb4cec1 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:43.603196 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9051ffa-eb74-4fc8-8210-a2121bb4cec1 None admin] PATH_INFO: `/v3/projects/d979106c8a164d55aa33fdb5ea995c7a` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:43.605765 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9051ffa-eb74-4fc8-8210-a2121bb4cec1 None admin] RBAC: Authorizing `identity:get_project(project_id=d979106c8a164d55aa33fdb5ea995c7a)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:43.607269 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9051ffa-eb74-4fc8-8210-a2121bb4cec1 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:43.609137 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 64/124] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 01:16:43 2022] GET /identity/v3/projects/d979106c8a164d55aa33fdb5ea995c7a => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:16:43.609742 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9051ffa-eb74-4fc8-8210-a2121bb4cec1 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:43.618375 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-ebf10ad6-fe3a-4903-94d7-ae950d17fe05 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:16:43.620623 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-ebf10ad6-fe3a-4903-94d7-ae950d17fe05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:16:43.641349 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:43.699448 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 61/125] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:16:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 01:16:43.707680 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf10ad6-fe3a-4903-94d7-ae950d17fe05 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:43.743615 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:43.765327 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9051ffa-eb74-4fc8-8210-a2121bb4cec1 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:43.833727 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc9f6c4-5962-45e5-83cf-7d05c468daa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:43.834928 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc9f6c4-5962-45e5-83cf-7d05c468daa7 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:43.835518 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc9f6c4-5962-45e5-83cf-7d05c468daa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:43.835998 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc9f6c4-5962-45e5-83cf-7d05c468daa7 None admin] PATH_INFO: `/v3/users/5f6ec5f1c46f46ccb2adc6dd83aafb22` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:43.838282 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc9f6c4-5962-45e5-83cf-7d05c468daa7 None admin] RBAC: Authorizing `identity:get_user(user_id=5f6ec5f1c46f46ccb2adc6dd83aafb22)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:43.840143 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc9f6c4-5962-45e5-83cf-7d05c468daa7 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:43.842247 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 65/126] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 01:16:43 2022] GET /identity/v3/users/5f6ec5f1c46f46ccb2adc6dd83aafb22 => generated 275 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:16:43.844582 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc9f6c4-5962-45e5-83cf-7d05c468daa7 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:43.917078 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf10ad6-fe3a-4903-94d7-ae950d17fe05 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:43.954717 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:43.963468 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc9f6c4-5962-45e5-83cf-7d05c468daa7 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:44.003401 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0086c9b8-7cde-420a-9acb-9e0c45e8eac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:44.004207 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086c9b8-7cde-420a-9acb-9e0c45e8eac7 None admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:44.004550 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086c9b8-7cde-420a-9acb-9e0c45e8eac7 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:44.004889 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086c9b8-7cde-420a-9acb-9e0c45e8eac7 None admin] PATH_INFO: `/v3/projects/d979106c8a164d55aa33fdb5ea995c7a/users/7f20260f94904e78a150a9644ed5191c/roles/fb48693810be495fb4b1893a79429b78` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:44.007107 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0086c9b8-7cde-420a-9acb-9e0c45e8eac7 None admin] RBAC: Authorizing `identity:create_grant(project_id=d979106c8a164d55aa33fdb5ea995c7a, user_id=7f20260f94904e78a150a9644ed5191c, role_id=fb48693810be495fb4b1893a79429b78)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:44.008811 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0086c9b8-7cde-420a-9acb-9e0c45e8eac7 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:44.018430 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61930b60-6b72-4e16-84fd-059848b260e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:44.019161 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61930b60-6b72-4e16-84fd-059848b260e6 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:44.019526 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61930b60-6b72-4e16-84fd-059848b260e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:44.019868 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61930b60-6b72-4e16-84fd-059848b260e6 None admin] PATH_INFO: `/v3/users/5f6ec5f1c46f46ccb2adc6dd83aafb22` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:44.021185 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61930b60-6b72-4e16-84fd-059848b260e6 None admin] RBAC: Authorizing `identity:get_user(user_id=5f6ec5f1c46f46ccb2adc6dd83aafb22)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:44.022762 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61930b60-6b72-4e16-84fd-059848b260e6 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:44.024609 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 62/127] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 01:16:43 2022] GET /identity/v3/users/5f6ec5f1c46f46ccb2adc6dd83aafb22 => generated 275 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:16:44.025282 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61930b60-6b72-4e16-84fd-059848b260e6 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:44.026950 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 66/128] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Aug 12 01:16:43 2022] PUT /identity/v3/projects/d979106c8a164d55aa33fdb5ea995c7a/users/7f20260f94904e78a150a9644ed5191c/roles/fb48693810be495fb4b1893a79429b78 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:16:44.028096 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0086c9b8-7cde-420a-9acb-9e0c45e8eac7 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:44.133572 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:44.149234 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61930b60-6b72-4e16-84fd-059848b260e6 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:44.178130 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0086c9b8-7cde-420a-9acb-9e0c45e8eac7 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:44.191573 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03877d14-dace-4d4b-9959-2a20edf28334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:44.192310 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03877d14-dace-4d4b-9959-2a20edf28334 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:44.192790 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03877d14-dace-4d4b-9959-2a20edf28334 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:44.192944 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03877d14-dace-4d4b-9959-2a20edf28334 None admin] PATH_INFO: `/v3/projects/d979106c8a164d55aa33fdb5ea995c7a` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:44.194228 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03877d14-dace-4d4b-9959-2a20edf28334 None admin] RBAC: Authorizing `identity:get_project(project_id=d979106c8a164d55aa33fdb5ea995c7a)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:44.195760 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03877d14-dace-4d4b-9959-2a20edf28334 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:44.198014 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 63/129] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 01:16:44 2022] GET /identity/v3/projects/d979106c8a164d55aa33fdb5ea995c7a => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:16:44.198761 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03877d14-dace-4d4b-9959-2a20edf28334 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:44.231439 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7bacfe-048f-4858-98cf-3fb43b04d234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:44.232684 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7bacfe-048f-4858-98cf-3fb43b04d234 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:44.233131 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7bacfe-048f-4858-98cf-3fb43b04d234 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:44.233812 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7bacfe-048f-4858-98cf-3fb43b04d234 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:44.249990 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7bacfe-048f-4858-98cf-3fb43b04d234 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:16:44.257093 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-3e7bacfe-048f-4858-98cf-3fb43b04d234 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 01:16:44.257093 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:16:44.257093 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:16:44.257093 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:16:44.257093 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:16:44.257093 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:16:44.257093 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:16:44.257093 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:16:44.257093 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:16:44.257093 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:16:44.257093 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:16:44.257093 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:16:44.257093 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:16:44.257093 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:16:44.257093 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:16:44.257093 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:16:44.257947 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:16:44.257947 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:16:44.257947 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:16:44.257947 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:16:44.257947 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:16:44.257947 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:16:44.257947 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:16:44.257947 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:16:44.257947 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:16:44.257947 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:16:44.257947 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:16:44.257947 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:16:44.257947 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:16:44.257947 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:16:44.257947 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:16:44.257947 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:16:44.258843 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:16:44.258843 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:16:44.258843 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:16:44.258843 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:16:44.258843 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:16:44.258843 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:16:44.258843 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:16:44.258843 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:16:44.258843 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:16:44.258843 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:16:44.258843 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 01:16:44.258843 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:16:44.261996 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 67/130] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 01:16:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:16:44.267064 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7bacfe-048f-4858-98cf-3fb43b04d234 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:44.284132 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:44.333550 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03877d14-dace-4d4b-9959-2a20edf28334 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:44.380351 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d83c73a-4db5-4cfe-9d1d-ddc1fa221f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:44.381258 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d83c73a-4db5-4cfe-9d1d-ddc1fa221f21 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:44.381996 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d83c73a-4db5-4cfe-9d1d-ddc1fa221f21 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:44.382308 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d83c73a-4db5-4cfe-9d1d-ddc1fa221f21 None admin] PATH_INFO: `/v3/projects/d979106c8a164d55aa33fdb5ea995c7a` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:44.383879 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d83c73a-4db5-4cfe-9d1d-ddc1fa221f21 None admin] RBAC: Authorizing `identity:get_project(project_id=d979106c8a164d55aa33fdb5ea995c7a)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:44.386081 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d83c73a-4db5-4cfe-9d1d-ddc1fa221f21 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:44.387820 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 64/131] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 01:16:44 2022] GET /identity/v3/projects/d979106c8a164d55aa33fdb5ea995c7a => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:16:44.389162 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d83c73a-4db5-4cfe-9d1d-ddc1fa221f21 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:44.407991 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7bacfe-048f-4858-98cf-3fb43b04d234 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:44.431600 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:44.448899 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d05944-7e88-4312-8a63-27378182121f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:44.449581 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d05944-7e88-4312-8a63-27378182121f None admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:44.449859 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d05944-7e88-4312-8a63-27378182121f None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:44.450179 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d05944-7e88-4312-8a63-27378182121f None admin] PATH_INFO: `/v3/projects/d979106c8a164d55aa33fdb5ea995c7a/users/5f6ec5f1c46f46ccb2adc6dd83aafb22/roles/13af81971c1c428eae0a571a22ea583d` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:44.452253 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d05944-7e88-4312-8a63-27378182121f None admin] RBAC: Authorizing `identity:create_grant(project_id=d979106c8a164d55aa33fdb5ea995c7a, user_id=5f6ec5f1c46f46ccb2adc6dd83aafb22, role_id=13af81971c1c428eae0a571a22ea583d)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:44.453778 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d05944-7e88-4312-8a63-27378182121f None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:44.472717 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 68/132] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Aug 12 01:16:44 2022] PUT /identity/v3/projects/d979106c8a164d55aa33fdb5ea995c7a/users/5f6ec5f1c46f46ccb2adc6dd83aafb22/roles/13af81971c1c428eae0a571a22ea583d => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:16:44.473939 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d05944-7e88-4312-8a63-27378182121f None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:44.564140 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d83c73a-4db5-4cfe-9d1d-ddc1fa221f21 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:44.575524 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:44.627132 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d05944-7e88-4312-8a63-27378182121f None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:44.661110 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdf20cb-c357-434c-a209-4fe08eea898b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:44.662197 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf20cb-c357-434c-a209-4fe08eea898b None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:44.662755 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf20cb-c357-434c-a209-4fe08eea898b None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:44.663740 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf20cb-c357-434c-a209-4fe08eea898b None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:44.670155 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdf20cb-c357-434c-a209-4fe08eea898b None admin] RBAC: Adding query filter params (name=member) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:16:44.672046 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdf20cb-c357-434c-a209-4fe08eea898b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:44.673830 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdf20cb-c357-434c-a209-4fe08eea898b None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:44.694260 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 65/133] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Aug 12 01:16:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:16:44.702017 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdf20cb-c357-434c-a209-4fe08eea898b None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:44.726904 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccc06a5-6fa8-46d2-aa65-85118f8958ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:44.727701 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccc06a5-6fa8-46d2-aa65-85118f8958ad None admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:44.728564 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccc06a5-6fa8-46d2-aa65-85118f8958ad None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:44.728843 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccc06a5-6fa8-46d2-aa65-85118f8958ad None admin] PATH_INFO: `/v3/projects/d979106c8a164d55aa33fdb5ea995c7a/users/5f6ec5f1c46f46ccb2adc6dd83aafb22/roles/bab2af60c26640acbd0c4db2f9796cfb` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:44.731042 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccc06a5-6fa8-46d2-aa65-85118f8958ad None admin] RBAC: Authorizing `identity:create_grant(project_id=d979106c8a164d55aa33fdb5ea995c7a, user_id=5f6ec5f1c46f46ccb2adc6dd83aafb22, role_id=bab2af60c26640acbd0c4db2f9796cfb)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:44.732514 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccc06a5-6fa8-46d2-aa65-85118f8958ad None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:44.758003 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 69/134] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Aug 12 01:16:44 2022] PUT /identity/v3/projects/d979106c8a164d55aa33fdb5ea995c7a/users/5f6ec5f1c46f46ccb2adc6dd83aafb22/roles/bab2af60c26640acbd0c4db2f9796cfb => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:16:44.827016 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:44.848180 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdf20cb-c357-434c-a209-4fe08eea898b None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:44.897367 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344be9d6-beda-4e19-8445-8993e08c182e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:44.898294 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344be9d6-beda-4e19-8445-8993e08c182e None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:44.898729 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344be9d6-beda-4e19-8445-8993e08c182e None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:44.899151 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344be9d6-beda-4e19-8445-8993e08c182e None admin] PATH_INFO: `/v3/users/5f6ec5f1c46f46ccb2adc6dd83aafb22` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:44.901077 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344be9d6-beda-4e19-8445-8993e08c182e None admin] RBAC: Authorizing `identity:get_user(user_id=5f6ec5f1c46f46ccb2adc6dd83aafb22)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:44.902862 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344be9d6-beda-4e19-8445-8993e08c182e None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:44.904703 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 66/135] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 01:16:44 2022] GET /identity/v3/users/5f6ec5f1c46f46ccb2adc6dd83aafb22 => generated 275 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:16:44.912392 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccc06a5-6fa8-46d2-aa65-85118f8958ad None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:45.035614 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccc06a5-6fa8-46d2-aa65-85118f8958ad None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:45.069231 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c8546-d2da-4228-8ca5-2cf6125ebffb None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:45.070060 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c8546-d2da-4228-8ca5-2cf6125ebffb None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:45.070590 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c8546-d2da-4228-8ca5-2cf6125ebffb None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:45.072477 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 67/136] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:16:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:16:45.076797 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:45.078507 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802affc8-0968-46cb-abb6-c4a09b619207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:45.079276 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802affc8-0968-46cb-abb6-c4a09b619207 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:45.079556 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802affc8-0968-46cb-abb6-c4a09b619207 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:45.079844 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802affc8-0968-46cb-abb6-c4a09b619207 None admin] PATH_INFO: `/v3/projects/b934d2629fc5478a95bfd0633b589a39` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:45.080161 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c82543-b640-4ae2-ad15-ab0c35259a8e None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:45.081342 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c82543-b640-4ae2-ad15-ab0c35259a8e None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:45.081817 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c82543-b640-4ae2-ad15-ab0c35259a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:45.088277 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802affc8-0968-46cb-abb6-c4a09b619207 None admin] RBAC: Authorizing `identity:get_project(project_id=b934d2629fc5478a95bfd0633b589a39)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:45.088277 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802affc8-0968-46cb-abb6-c4a09b619207 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:45.089650 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 70/137] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 01:16:44 2022] GET /identity/v3/projects/b934d2629fc5478a95bfd0633b589a39 => generated 312 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:16:45.095581 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802affc8-0968-46cb-abb6-c4a09b619207 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:45.114946 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-f3c82543-b640-4ae2-ad15-ab0c35259a8e None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:16:45.116484 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-f3c82543-b640-4ae2-ad15-ab0c35259a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:16:45.222960 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 68/138] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:16:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 01:16:45.246612 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802affc8-0968-46cb-abb6-c4a09b619207 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:45.291489 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5492497b-19ad-49a5-87f5-27c036194c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:45.292166 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5492497b-19ad-49a5-87f5-27c036194c75 None admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:45.292447 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5492497b-19ad-49a5-87f5-27c036194c75 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:45.292721 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5492497b-19ad-49a5-87f5-27c036194c75 None admin] PATH_INFO: `/v3/projects/b934d2629fc5478a95bfd0633b589a39/users/5f6ec5f1c46f46ccb2adc6dd83aafb22/roles/13af81971c1c428eae0a571a22ea583d` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:45.294998 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5492497b-19ad-49a5-87f5-27c036194c75 None admin] RBAC: Authorizing `identity:create_grant(project_id=b934d2629fc5478a95bfd0633b589a39, user_id=5f6ec5f1c46f46ccb2adc6dd83aafb22, role_id=13af81971c1c428eae0a571a22ea583d)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:45.296445 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5492497b-19ad-49a5-87f5-27c036194c75 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:45.319070 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 71/139] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Aug 12 01:16:45 2022] PUT /identity/v3/projects/b934d2629fc5478a95bfd0633b589a39/users/5f6ec5f1c46f46ccb2adc6dd83aafb22/roles/13af81971c1c428eae0a571a22ea583d => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 01:16:45.530312 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c82543-b640-4ae2-ad15-ab0c35259a8e None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:45.558664 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da26e3f6-d4fa-46e0-b852-4367c72bf59e None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:45.558975 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da26e3f6-d4fa-46e0-b852-4367c72bf59e None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:45.559229 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da26e3f6-d4fa-46e0-b852-4367c72bf59e None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:45.560906 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 72/140] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:16:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:16:45.566965 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77395ca-efb1-45b4-ad42-f5cca4d83a07 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:45.567256 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77395ca-efb1-45b4-ad42-f5cca4d83a07 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:45.567544 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77395ca-efb1-45b4-ad42-f5cca4d83a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:45.607380 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-f77395ca-efb1-45b4-ad42-f5cca4d83a07 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:16:45.608636 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f77395ca-efb1-45b4-ad42-f5cca4d83a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:16:45.656973 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:45.683254 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c82543-b640-4ae2-ad15-ab0c35259a8e None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:45.710002 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:45.723957 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 73/141] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:16:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 01:16:45.759082 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5783478-57cb-4faf-a27a-bdc8368e2afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:45.759969 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5783478-57cb-4faf-a27a-bdc8368e2afb None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:45.760391 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5783478-57cb-4faf-a27a-bdc8368e2afb None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:45.760827 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5783478-57cb-4faf-a27a-bdc8368e2afb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:45.774217 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5783478-57cb-4faf-a27a-bdc8368e2afb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:16:45.779305 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-a5783478-57cb-4faf-a27a-bdc8368e2afb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 01:16:45.779305 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:16:45.779305 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:16:45.779305 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:16:45.779305 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:16:45.779305 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:16:45.779305 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:16:45.779305 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:16:45.779305 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:16:45.779305 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:16:45.779305 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:16:45.779305 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:16:45.779305 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:16:45.779305 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:16:45.779305 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:16:45.779305 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:16:45.780335 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:16:45.780335 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:16:45.780335 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:16:45.780335 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:16:45.780335 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:16:45.780335 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:16:45.780335 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:16:45.780335 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:16:45.780335 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:16:45.780335 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:16:45.780335 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:16:45.780335 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:16:45.780335 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:16:45.780335 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:16:45.780335 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:16:45.780335 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:16:45.781279 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:16:45.781279 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:16:45.781279 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:16:45.781279 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:16:45.781279 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:16:45.781279 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:16:45.781279 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:16:45.781279 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:16:45.781279 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:16:45.781279 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:16:45.781279 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 01:16:45.781279 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:16:45.788046 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 69/142] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 01:16:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:16:45.789671 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77395ca-efb1-45b4-ad42-f5cca4d83a07 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:45.937951 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77395ca-efb1-45b4-ad42-f5cca4d83a07 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:45.971682 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beeaa39-f9db-4954-8ba2-dedd2a774c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:45.972297 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beeaa39-f9db-4954-8ba2-dedd2a774c44 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:45.972576 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beeaa39-f9db-4954-8ba2-dedd2a774c44 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:45.972845 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beeaa39-f9db-4954-8ba2-dedd2a774c44 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:45.973510 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beeaa39-f9db-4954-8ba2-dedd2a774c44 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:16:45.973811 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beeaa39-f9db-4954-8ba2-dedd2a774c44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:45.975463 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beeaa39-f9db-4954-8ba2-dedd2a774c44 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:45.984021 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 74/143] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Aug 12 01:16:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:16:45.989941 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5783478-57cb-4faf-a27a-bdc8368e2afb None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:46.150765 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5783478-57cb-4faf-a27a-bdc8368e2afb None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:46.187063 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bba715-cee1-4b5f-b2cf-7429a4f917b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:46.187700 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bba715-cee1-4b5f-b2cf-7429a4f917b2 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:46.187978 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bba715-cee1-4b5f-b2cf-7429a4f917b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:46.188246 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bba715-cee1-4b5f-b2cf-7429a4f917b2 None admin] PATH_INFO: `/v3/users/2630819f4ef249b7a6c4325ce54d0d0a` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:46.189368 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bba715-cee1-4b5f-b2cf-7429a4f917b2 None admin] RBAC: Authorizing `identity:get_user(user_id=2630819f4ef249b7a6c4325ce54d0d0a)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:46.190897 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bba715-cee1-4b5f-b2cf-7429a4f917b2 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:46.192477 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 70/144] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 01:16:45 2022] GET /identity/v3/users/2630819f4ef249b7a6c4325ce54d0d0a => generated 289 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:16:46.198187 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beeaa39-f9db-4954-8ba2-dedd2a774c44 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:46.236682 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bba715-cee1-4b5f-b2cf-7429a4f917b2 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:46.252639 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:46.273108 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:46.343038 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beeaa39-f9db-4954-8ba2-dedd2a774c44 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:46.347737 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bba715-cee1-4b5f-b2cf-7429a4f917b2 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:46.385879 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a5ed51-d4e2-4c97-b0d3-1f2eac78f2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:46.387042 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a5ed51-d4e2-4c97-b0d3-1f2eac78f2dc None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:46.387517 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a5ed51-d4e2-4c97-b0d3-1f2eac78f2dc None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:46.387967 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a5ed51-d4e2-4c97-b0d3-1f2eac78f2dc None admin] PATH_INFO: `/v3/domains/default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:46.389253 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a5ed51-d4e2-4c97-b0d3-1f2eac78f2dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:46.391016 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a5ed51-d4e2-4c97-b0d3-1f2eac78f2dc None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:46.392920 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 71/145] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:16:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:16:46.398478 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a5ed51-d4e2-4c97-b0d3-1f2eac78f2dc None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:46.404936 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcbb841-c428-40a0-ab5f-9b06b7b7bf63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:46.405520 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcbb841-c428-40a0-ab5f-9b06b7b7bf63 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:46.405791 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcbb841-c428-40a0-ab5f-9b06b7b7bf63 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:46.406055 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcbb841-c428-40a0-ab5f-9b06b7b7bf63 None admin] PATH_INFO: `/v3/projects/d979106c8a164d55aa33fdb5ea995c7a` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:46.410800 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcbb841-c428-40a0-ab5f-9b06b7b7bf63 None admin] RBAC: Authorizing `identity:get_project(project_id=d979106c8a164d55aa33fdb5ea995c7a)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:46.412282 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcbb841-c428-40a0-ab5f-9b06b7b7bf63 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:46.413936 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 75/146] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 01:16:46 2022] GET /identity/v3/projects/d979106c8a164d55aa33fdb5ea995c7a => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:16:46.434848 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcbb841-c428-40a0-ab5f-9b06b7b7bf63 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:46.504022 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:46.525422 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a5ed51-d4e2-4c97-b0d3-1f2eac78f2dc None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:46.561264 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28310a43-a856-4018-a80b-d7c1b78e9e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:46.562319 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28310a43-a856-4018-a80b-d7c1b78e9e5b None admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:46.562804 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28310a43-a856-4018-a80b-d7c1b78e9e5b None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:46.563318 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28310a43-a856-4018-a80b-d7c1b78e9e5b None admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:46.564139 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28310a43-a856-4018-a80b-d7c1b78e9e5b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:46.565859 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28310a43-a856-4018-a80b-d7c1b78e9e5b None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:46.594457 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 72/147] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Aug 12 01:16:46 2022] POST /identity/v3/users => generated 283 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 01:16:46.651885 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcbb841-c428-40a0-ab5f-9b06b7b7bf63 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:46.684773 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:46.703922 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad5f1ff-ba16-44c8-bb4b-0784cfab1c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:46.704975 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad5f1ff-ba16-44c8-bb4b-0784cfab1c89 None admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:46.705434 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad5f1ff-ba16-44c8-bb4b-0784cfab1c89 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:46.705880 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad5f1ff-ba16-44c8-bb4b-0784cfab1c89 None admin] PATH_INFO: `/v3/projects/d979106c8a164d55aa33fdb5ea995c7a/users/2630819f4ef249b7a6c4325ce54d0d0a/roles/d3ac26b4075941a7a84580ef43d093f6` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:46.711646 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad5f1ff-ba16-44c8-bb4b-0784cfab1c89 None admin] RBAC: Authorizing `identity:create_grant(project_id=d979106c8a164d55aa33fdb5ea995c7a, user_id=2630819f4ef249b7a6c4325ce54d0d0a, role_id=d3ac26b4075941a7a84580ef43d093f6)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:46.713959 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad5f1ff-ba16-44c8-bb4b-0784cfab1c89 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:46.733016 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 76/148] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Aug 12 01:16:46 2022] PUT /identity/v3/projects/d979106c8a164d55aa33fdb5ea995c7a/users/2630819f4ef249b7a6c4325ce54d0d0a/roles/d3ac26b4075941a7a84580ef43d093f6 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 01:16:47.101414 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995c196-9be6-48c3-8f27-1ab062e13acf None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:47.101778 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995c196-9be6-48c3-8f27-1ab062e13acf None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:47.101962 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995c196-9be6-48c3-8f27-1ab062e13acf None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:47.103463 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 73/149] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:16:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:16:47.109646 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0170fd88-3f35-441a-a0d4-0098a5de0611 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:47.110589 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0170fd88-3f35-441a-a0d4-0098a5de0611 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:47.111139 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0170fd88-3f35-441a-a0d4-0098a5de0611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:47.134447 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-0170fd88-3f35-441a-a0d4-0098a5de0611 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:16:47.136100 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-0170fd88-3f35-441a-a0d4-0098a5de0611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:16:47.228145 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 77/150] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:16:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 01:16:47.326379 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f5deb-35c0-475e-b8f3-a41fa7541919 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:47.326876 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f5deb-35c0-475e-b8f3-a41fa7541919 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:47.326976 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f5deb-35c0-475e-b8f3-a41fa7541919 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:47.328257 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 74/151] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:16:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:16:47.348172 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc3d6f9-90cb-42b2-875f-95611495d75d None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:47.348776 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc3d6f9-90cb-42b2-875f-95611495d75d None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:47.349241 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc3d6f9-90cb-42b2-875f-95611495d75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:47.374326 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-cfc3d6f9-90cb-42b2-875f-95611495d75d None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:16:47.375805 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-cfc3d6f9-90cb-42b2-875f-95611495d75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:16:47.463559 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 78/152] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:16:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 01:16:47.649230 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78f5deb-35c0-475e-b8f3-a41fa7541919 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:47.690416 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cffedd0-1e57-4cba-add8-a48de345fc4c None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:47.691101 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cffedd0-1e57-4cba-add8-a48de345fc4c None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:47.691583 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cffedd0-1e57-4cba-add8-a48de345fc4c None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:47.693156 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 79/153] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:16:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 01:16:47.699376 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0be3cb-a9d2-43dd-8932-e7ab35b230b0 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:47.699902 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0be3cb-a9d2-43dd-8932-e7ab35b230b0 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:47.700374 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0be3cb-a9d2-43dd-8932-e7ab35b230b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:47.728638 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-fc0be3cb-a9d2-43dd-8932-e7ab35b230b0 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:16:47.733092 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-fc0be3cb-a9d2-43dd-8932-e7ab35b230b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:16:47.811384 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:47.852206 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78f5deb-35c0-475e-b8f3-a41fa7541919 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:47.872509 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 80/154] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:16:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 01:16:47.873364 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0be3cb-a9d2-43dd-8932-e7ab35b230b0 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:47.902498 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e27f5e-bd46-4e14-89fe-d17ddbe631e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:47.903473 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e27f5e-bd46-4e14-89fe-d17ddbe631e3 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:47.903945 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e27f5e-bd46-4e14-89fe-d17ddbe631e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:47.904419 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e27f5e-bd46-4e14-89fe-d17ddbe631e3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:47.911266 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:47.926326 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e27f5e-bd46-4e14-89fe-d17ddbe631e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:16:47.932191 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-e0e27f5e-bd46-4e14-89fe-d17ddbe631e3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 01:16:47.932191 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:16:47.932191 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:16:47.932191 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:16:47.932191 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:16:47.932191 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:16:47.932191 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:16:47.932191 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:16:47.932191 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:16:47.932191 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:16:47.932191 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:16:47.932191 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:16:47.932191 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:16:47.932191 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:16:47.932191 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:16:47.932191 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:16:47.933049 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:16:47.933049 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:16:47.933049 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:16:47.933049 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:16:47.933049 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:16:47.933049 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:16:47.933049 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:16:47.933049 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:16:47.933049 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:16:47.933049 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:16:47.933049 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:16:47.933049 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:16:47.933049 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:16:47.933049 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:16:47.933049 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:16:47.933049 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:16:47.933806 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:16:47.933806 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:16:47.933806 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:16:47.933806 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:16:47.933806 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:16:47.933806 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:16:47.933806 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:16:47.933806 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:16:47.933806 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:16:47.933806 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:16:47.933806 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 01:16:47.933806 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:16:47.936734 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 75/155] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Aug 12 01:16:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:16:47.942142 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e27f5e-bd46-4e14-89fe-d17ddbe631e3 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:48.080991 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0be3cb-a9d2-43dd-8932-e7ab35b230b0 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:48.086140 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e27f5e-bd46-4e14-89fe-d17ddbe631e3 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:48.155272 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3709faa-5631-414c-93e3-aa57579057f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:48.157107 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3709faa-5631-414c-93e3-aa57579057f6 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:48.157648 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3709faa-5631-414c-93e3-aa57579057f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:48.159284 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3709faa-5631-414c-93e3-aa57579057f6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:48.163345 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c18d342-3e01-4520-8457-e4d5c449bc3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:48.163951 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c18d342-3e01-4520-8457-e4d5c449bc3b None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:48.164252 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c18d342-3e01-4520-8457-e4d5c449bc3b None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:48.164494 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c18d342-3e01-4520-8457-e4d5c449bc3b None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:48.165249 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c18d342-3e01-4520-8457-e4d5c449bc3b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:16:48.165728 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c18d342-3e01-4520-8457-e4d5c449bc3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:48.167462 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c18d342-3e01-4520-8457-e4d5c449bc3b None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:48.183430 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3709faa-5631-414c-93e3-aa57579057f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:16:48.191500 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 76/156] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 01:16:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:16:48.193107 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-b3709faa-5631-414c-93e3-aa57579057f6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 01:16:48.193107 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:16:48.193107 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:16:48.193107 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:16:48.193107 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:16:48.193107 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:16:48.193107 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:16:48.193107 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:16:48.193107 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:16:48.193107 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:16:48.193107 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:16:48.193107 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:16:48.193107 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:16:48.193107 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:16:48.193107 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:16:48.193107 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:16:48.193954 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:16:48.193954 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:16:48.193954 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:16:48.193954 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:16:48.193954 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:16:48.193954 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:16:48.193954 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:16:48.193954 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:16:48.193954 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:16:48.193954 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:16:48.193954 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:16:48.193954 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:16:48.193954 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:16:48.193954 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:16:48.193954 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:16:48.193954 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:16:48.194992 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:16:48.194992 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:16:48.194992 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:16:48.194992 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:16:48.194992 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:16:48.194992 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:16:48.194992 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:16:48.194992 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:16:48.194992 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:16:48.194992 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:16:48.194992 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 01:16:48.194992 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:16:48.197069 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c18d342-3e01-4520-8457-e4d5c449bc3b None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:48.197886 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 81/157] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 01:16:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:16:48.203558 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3709faa-5631-414c-93e3-aa57579057f6 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:48.249016 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:48.303095 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:48.350507 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3709faa-5631-414c-93e3-aa57579057f6 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:48.363458 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c18d342-3e01-4520-8457-e4d5c449bc3b None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:48.402408 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42c1032-7910-4020-8321-4cda99f0b498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:48.403028 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c1032-7910-4020-8321-4cda99f0b498 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:48.403293 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c1032-7910-4020-8321-4cda99f0b498 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:48.403560 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c1032-7910-4020-8321-4cda99f0b498 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:48.404236 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42c1032-7910-4020-8321-4cda99f0b498 None admin] RBAC: Adding query filter params (name=member) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:16:48.404536 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42c1032-7910-4020-8321-4cda99f0b498 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:48.405968 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42c1032-7910-4020-8321-4cda99f0b498 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:48.409367 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2fc866-c224-44aa-8d34-62fa85c734fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:48.410002 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2fc866-c224-44aa-8d34-62fa85c734fe None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:48.410306 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2fc866-c224-44aa-8d34-62fa85c734fe None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:48.410572 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2fc866-c224-44aa-8d34-62fa85c734fe None admin] PATH_INFO: `/v3/users/7f20260f94904e78a150a9644ed5191c` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:48.412425 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2fc866-c224-44aa-8d34-62fa85c734fe None admin] RBAC: Authorizing `identity:get_user(user_id=7f20260f94904e78a150a9644ed5191c)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:48.413840 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2fc866-c224-44aa-8d34-62fa85c734fe None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:48.415551 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 77/158] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 01:16:48 2022] GET /identity/v3/users/7f20260f94904e78a150a9644ed5191c => generated 247 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:16:48.416415 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2fc866-c224-44aa-8d34-62fa85c734fe None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:48.423594 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 82/159] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Aug 12 01:16:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:16:48.426292 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb96dc8-891d-4fd8-b84f-5cbc2f7cdbf5 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:48.426843 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb96dc8-891d-4fd8-b84f-5cbc2f7cdbf5 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:48.429793 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb96dc8-891d-4fd8-b84f-5cbc2f7cdbf5 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:48.432122 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 83/160] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:16:48 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:16:48.438094 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb96dc8-891d-4fd8-b84f-5cbc2f7cdbf5 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:48.536057 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2fc866-c224-44aa-8d34-62fa85c734fe None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:48.551317 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:48.563122 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb96dc8-891d-4fd8-b84f-5cbc2f7cdbf5 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:48.566517 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:48.576160 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b3282-8f12-4778-b1d6-b1eb2b93665f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:48.576807 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b3282-8f12-4778-b1d6-b1eb2b93665f None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:48.577082 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b3282-8f12-4778-b1d6-b1eb2b93665f None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:48.577349 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b3282-8f12-4778-b1d6-b1eb2b93665f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:48.589271 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8b3282-8f12-4778-b1d6-b1eb2b93665f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:16:48.594219 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-bf8b3282-8f12-4778-b1d6-b1eb2b93665f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 01:16:48.594219 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:16:48.594219 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:16:48.594219 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:16:48.594219 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:16:48.594219 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:16:48.594219 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:16:48.594219 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:16:48.594219 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:16:48.594219 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:16:48.594219 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:16:48.594219 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:16:48.594219 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:16:48.594219 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:16:48.594219 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:16:48.594219 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:16:48.595229 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:16:48.595229 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:16:48.595229 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:16:48.595229 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:16:48.595229 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:16:48.595229 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:16:48.595229 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:16:48.595229 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:16:48.595229 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:16:48.595229 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:16:48.595229 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:16:48.595229 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:16:48.595229 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:16:48.595229 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:16:48.595229 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:16:48.595229 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:16:48.596129 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:16:48.596129 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:16:48.596129 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:16:48.596129 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:16:48.596129 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:16:48.596129 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:16:48.596129 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:16:48.596129 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:16:48.596129 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:16:48.596129 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:16:48.596129 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 01:16:48.596129 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:16:48.596129 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 78/161] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Aug 12 01:16:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:16:48.596896 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b3282-8f12-4778-b1d6-b1eb2b93665f None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:48.604430 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80d1c32-8f12-440c-bf61-e51b3459f83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:48.605176 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d1c32-8f12-440c-bf61-e51b3459f83a None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:48.605548 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d1c32-8f12-440c-bf61-e51b3459f83a None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:48.605912 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d1c32-8f12-440c-bf61-e51b3459f83a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:48.678437 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80d1c32-8f12-440c-bf61-e51b3459f83a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:48.679992 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80d1c32-8f12-440c-bf61-e51b3459f83a None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:48.704084 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b3282-8f12-4778-b1d6-b1eb2b93665f None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:48.740238 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414bdbc9-43d5-4c76-a675-54adfd3547f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:48.740871 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414bdbc9-43d5-4c76-a675-54adfd3547f4 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:48.741146 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414bdbc9-43d5-4c76-a675-54adfd3547f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:48.741415 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414bdbc9-43d5-4c76-a675-54adfd3547f4 None admin] PATH_INFO: `/v3/users/5f6ec5f1c46f46ccb2adc6dd83aafb22` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:48.742630 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414bdbc9-43d5-4c76-a675-54adfd3547f4 None admin] RBAC: Authorizing `identity:get_user(user_id=5f6ec5f1c46f46ccb2adc6dd83aafb22)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:48.744241 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414bdbc9-43d5-4c76-a675-54adfd3547f4 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:48.746224 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 79/162] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 01:16:48 2022] GET /identity/v3/users/5f6ec5f1c46f46ccb2adc6dd83aafb22 => generated 275 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:16:48.747399 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3bd6b-04f5-4a59-aeca-99c2b327fff1 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:48.747681 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3bd6b-04f5-4a59-aeca-99c2b327fff1 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:48.747954 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3bd6b-04f5-4a59-aeca-99c2b327fff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:48.767165 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-93b3bd6b-04f5-4a59-aeca-99c2b327fff1 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:16:48.768465 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-93b3bd6b-04f5-4a59-aeca-99c2b327fff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:16:48.776323 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:48.788040 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 84/163] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 01:16:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 01:16:48.789165 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80d1c32-8f12-440c-bf61-e51b3459f83a None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:48.825563 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:48.844855 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 80/164] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:16:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 01:16:48.850365 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b3bd6b-04f5-4a59-aeca-99c2b327fff1 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:48.910717 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80d1c32-8f12-440c-bf61-e51b3459f83a None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:48.952211 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088798ee-9a56-4e50-941f-872736c4a8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:48.954448 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088798ee-9a56-4e50-941f-872736c4a8d3 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:48.955720 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088798ee-9a56-4e50-941f-872736c4a8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:48.956188 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088798ee-9a56-4e50-941f-872736c4a8d3 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:48.957056 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088798ee-9a56-4e50-941f-872736c4a8d3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:16:48.959032 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088798ee-9a56-4e50-941f-872736c4a8d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:48.960619 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088798ee-9a56-4e50-941f-872736c4a8d3 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:48.982044 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 85/165] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 01:16:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:16:48.985421 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088798ee-9a56-4e50-941f-872736c4a8d3 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:48.994550 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b3bd6b-04f5-4a59-aeca-99c2b327fff1 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:49.064175 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd27567-c49d-45fd-9084-45c4708e8425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:49.064795 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd27567-c49d-45fd-9084-45c4708e8425 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:49.065069 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd27567-c49d-45fd-9084-45c4708e8425 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:49.065335 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd27567-c49d-45fd-9084-45c4708e8425 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:49.107490 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:49.170996 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:49.192343 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088798ee-9a56-4e50-941f-872736c4a8d3 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:49.203032 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd27567-c49d-45fd-9084-45c4708e8425 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:49.204458 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd27567-c49d-45fd-9084-45c4708e8425 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:49.266285 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e94e83b-f0c4-405f-a627-c7ff6d789787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:49.266960 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94e83b-f0c4-405f-a627-c7ff6d789787 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:49.267236 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94e83b-f0c4-405f-a627-c7ff6d789787 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:49.267503 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94e83b-f0c4-405f-a627-c7ff6d789787 None admin] PATH_INFO: `/v3/projects/d979106c8a164d55aa33fdb5ea995c7a` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:49.268679 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e94e83b-f0c4-405f-a627-c7ff6d789787 None admin] RBAC: Authorizing `identity:get_project(project_id=d979106c8a164d55aa33fdb5ea995c7a)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:49.270246 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e94e83b-f0c4-405f-a627-c7ff6d789787 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:49.271924 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 86/166] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 01:16:48 2022] GET /identity/v3/projects/d979106c8a164d55aa33fdb5ea995c7a => generated 298 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:16:49.273785 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e94e83b-f0c4-405f-a627-c7ff6d789787 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:49.405405 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 81/167] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 01:16:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 01:16:49.406343 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd27567-c49d-45fd-9084-45c4708e8425 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:49.496204 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e94e83b-f0c4-405f-a627-c7ff6d789787 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:49.537328 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:49.569580 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce55ff4-0fed-4509-a5d2-262c3e037fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:49.570245 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce55ff4-0fed-4509-a5d2-262c3e037fda None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:49.570523 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce55ff4-0fed-4509-a5d2-262c3e037fda None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:49.570792 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce55ff4-0fed-4509-a5d2-262c3e037fda None admin] PATH_INFO: `/v3/users/5f6ec5f1c46f46ccb2adc6dd83aafb22` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:49.571958 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce55ff4-0fed-4509-a5d2-262c3e037fda None admin] RBAC: Authorizing `identity:get_user(user_id=5f6ec5f1c46f46ccb2adc6dd83aafb22)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:49.573423 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce55ff4-0fed-4509-a5d2-262c3e037fda None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:49.575054 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 87/168] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 01:16:49 2022] GET /identity/v3/users/5f6ec5f1c46f46ccb2adc6dd83aafb22 => generated 275 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:16:49.579829 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce55ff4-0fed-4509-a5d2-262c3e037fda None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:49.615421 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:49.650889 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd27567-c49d-45fd-9084-45c4708e8425 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:49.728247 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39715ec-94c1-4d40-b830-fa2ec420fe6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:49.728877 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39715ec-94c1-4d40-b830-fa2ec420fe6a None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:49.729178 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39715ec-94c1-4d40-b830-fa2ec420fe6a None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:49.729473 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39715ec-94c1-4d40-b830-fa2ec420fe6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:49.730274 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39715ec-94c1-4d40-b830-fa2ec420fe6a None admin] RBAC: Adding query filter params (role.id=fb48693810be495fb4b1893a79429b78, scope.project.id=d979106c8a164d55aa33fdb5ea995c7a, user.id=7f20260f94904e78a150a9644ed5191c) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:16:49.730594 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39715ec-94c1-4d40-b830-fa2ec420fe6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:49.732077 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39715ec-94c1-4d40-b830-fa2ec420fe6a None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:49.748875 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 82/169] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 01:16:49 2022] GET /identity/v3/role_assignments?user.id=7f20260f94904e78a150a9644ed5191c&scope.project.id=d979106c8a164d55aa33fdb5ea995c7a&role.id=fb48693810be495fb4b1893a79429b78 => generated 608 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:16:49.749671 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39715ec-94c1-4d40-b830-fa2ec420fe6a None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:49.782209 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce55ff4-0fed-4509-a5d2-262c3e037fda None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:49.859895 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4cd3fb-48bd-4677-8e76-3638bd31b3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:49.860854 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4cd3fb-48bd-4677-8e76-3638bd31b3f5 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:49.861135 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4cd3fb-48bd-4677-8e76-3638bd31b3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:49.861405 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4cd3fb-48bd-4677-8e76-3638bd31b3f5 None admin] PATH_INFO: `/v3/projects/d979106c8a164d55aa33fdb5ea995c7a` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:49.862701 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4cd3fb-48bd-4677-8e76-3638bd31b3f5 None admin] RBAC: Authorizing `identity:get_project(project_id=d979106c8a164d55aa33fdb5ea995c7a)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:49.864225 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4cd3fb-48bd-4677-8e76-3638bd31b3f5 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:49.870359 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 88/170] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 01:16:49 2022] GET /identity/v3/projects/d979106c8a164d55aa33fdb5ea995c7a => generated 298 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:16:49.871427 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4cd3fb-48bd-4677-8e76-3638bd31b3f5 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:49.997284 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:50.004822 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39715ec-94c1-4d40-b830-fa2ec420fe6a None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:50.050241 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4cd3fb-48bd-4677-8e76-3638bd31b3f5 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:50.092799 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53bc7a7-bfa7-4f8a-993d-67c3b4eb0113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:50.093794 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53bc7a7-bfa7-4f8a-993d-67c3b4eb0113 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:50.094320 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53bc7a7-bfa7-4f8a-993d-67c3b4eb0113 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:50.094901 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53bc7a7-bfa7-4f8a-993d-67c3b4eb0113 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:50.104492 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aa7f7b-31d3-449e-b127-b065da3e6b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:50.105150 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa7f7b-31d3-449e-b127-b065da3e6b92 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:50.105419 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa7f7b-31d3-449e-b127-b065da3e6b92 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:50.105683 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa7f7b-31d3-449e-b127-b065da3e6b92 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:50.126862 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aa7f7b-31d3-449e-b127-b065da3e6b92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:16:50.132054 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-01aa7f7b-31d3-449e-b127-b065da3e6b92 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 01:16:50.132054 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:16:50.132054 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:16:50.132054 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:16:50.132054 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:16:50.132054 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:16:50.132054 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:16:50.132054 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:16:50.132054 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:16:50.132054 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:16:50.132054 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:16:50.132054 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:16:50.132054 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:16:50.132054 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:16:50.132054 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:16:50.132054 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:16:50.132956 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:16:50.132956 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:16:50.132956 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:16:50.132956 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:16:50.132956 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:16:50.132956 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:16:50.132956 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:16:50.132956 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:16:50.132956 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:16:50.132956 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:16:50.132956 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:16:50.132956 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:16:50.132956 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:16:50.132956 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:16:50.132956 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:16:50.132956 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:16:50.133900 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:16:50.133900 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:16:50.133900 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:16:50.133900 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:16:50.133900 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:16:50.133900 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:16:50.133900 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:16:50.133900 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:16:50.133900 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:16:50.133900 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:16:50.133900 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 01:16:50.133900 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:16:50.133900 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 83/171] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 01:16:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 384 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:16:50.139485 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b1db5-29bd-42b0-91f3-1ede4fe81d62 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:50.139485 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b1db5-29bd-42b0-91f3-1ede4fe81d62 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:50.139485 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b1db5-29bd-42b0-91f3-1ede4fe81d62 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:50.139485 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 84/172] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:16:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:16:50.139485 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922b1db5-29bd-42b0-91f3-1ede4fe81d62 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:50.156401 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:50.263154 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53bc7a7-bfa7-4f8a-993d-67c3b4eb0113 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:50.264592 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53bc7a7-bfa7-4f8a-993d-67c3b4eb0113 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:50.267041 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922b1db5-29bd-42b0-91f3-1ede4fe81d62 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:50.310210 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15892ce-b829-4414-b7ab-03b250621d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:50.311663 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15892ce-b829-4414-b7ab-03b250621d9f None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:50.312202 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15892ce-b829-4414-b7ab-03b250621d9f None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:50.312738 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15892ce-b829-4414-b7ab-03b250621d9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:50.313669 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15892ce-b829-4414-b7ab-03b250621d9f None admin] RBAC: Adding query filter params (role.id=13af81971c1c428eae0a571a22ea583d, scope.project.id=d979106c8a164d55aa33fdb5ea995c7a, user.id=5f6ec5f1c46f46ccb2adc6dd83aafb22) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:16:50.314240 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15892ce-b829-4414-b7ab-03b250621d9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:50.316180 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15892ce-b829-4414-b7ab-03b250621d9f None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:50.323791 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 85/173] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 01:16:50 2022] GET /identity/v3/role_assignments?user.id=5f6ec5f1c46f46ccb2adc6dd83aafb22&scope.project.id=d979106c8a164d55aa33fdb5ea995c7a&role.id=13af81971c1c428eae0a571a22ea583d => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:16:50.325113 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15892ce-b829-4414-b7ab-03b250621d9f None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:50.408307 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:50.416596 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:50.457575 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15892ce-b829-4414-b7ab-03b250621d9f None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:50.499597 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd7f5b-a87d-4be1-b9c0-2547975d5796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:50.500490 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd7f5b-a87d-4be1-b9c0-2547975d5796 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:50.500966 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd7f5b-a87d-4be1-b9c0-2547975d5796 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:50.501452 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd7f5b-a87d-4be1-b9c0-2547975d5796 None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:50.502359 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febd7f5b-a87d-4be1-b9c0-2547975d5796 None admin] RBAC: Adding query filter params (name=member) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:16:50.502881 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febd7f5b-a87d-4be1-b9c0-2547975d5796 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:50.504483 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febd7f5b-a87d-4be1-b9c0-2547975d5796 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:50.515379 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 86/174] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Aug 12 01:16:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:16:50.517385 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706ae60-c3a7-442e-82c6-9d51c230f546 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:50.517863 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706ae60-c3a7-442e-82c6-9d51c230f546 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:50.518362 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706ae60-c3a7-442e-82c6-9d51c230f546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:50.533214 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 89/175] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 01:16:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 662 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 01:16:50.534794 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adecaa7-7930-4563-b92a-1b2a00c870f4 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:50.534794 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adecaa7-7930-4563-b92a-1b2a00c870f4 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:50.536487 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adecaa7-7930-4563-b92a-1b2a00c870f4 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:50.537753 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 90/176] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:16:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:16:50.538476 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adecaa7-7930-4563-b92a-1b2a00c870f4 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:50.541282 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-5706ae60-c3a7-442e-82c6-9d51c230f546 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:16:50.542802 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-5706ae60-c3a7-442e-82c6-9d51c230f546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:16:50.639148 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 87/177] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:16:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 01:16:50.640410 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5706ae60-c3a7-442e-82c6-9d51c230f546 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:50.695782 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adecaa7-7930-4563-b92a-1b2a00c870f4 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:50.712277 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:50.758007 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5706ae60-c3a7-442e-82c6-9d51c230f546 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:50.789672 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85856c7-51ba-413f-9a07-8ae8d60d28a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:50.790302 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85856c7-51ba-413f-9a07-8ae8d60d28a4 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:50.790583 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85856c7-51ba-413f-9a07-8ae8d60d28a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:50.790914 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85856c7-51ba-413f-9a07-8ae8d60d28a4 None admin] PATH_INFO: `/v3/users/5f6ec5f1c46f46ccb2adc6dd83aafb22` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:50.792018 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85856c7-51ba-413f-9a07-8ae8d60d28a4 None admin] RBAC: Authorizing `identity:get_user(user_id=5f6ec5f1c46f46ccb2adc6dd83aafb22)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:50.793481 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85856c7-51ba-413f-9a07-8ae8d60d28a4 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:50.795440 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 91/178] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 01:16:50 2022] GET /identity/v3/users/5f6ec5f1c46f46ccb2adc6dd83aafb22 => generated 275 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:16:50.801097 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e6251-25dd-434d-b20c-dc377cfd6f6e None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:50.801522 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e6251-25dd-434d-b20c-dc377cfd6f6e None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:50.801964 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e6251-25dd-434d-b20c-dc377cfd6f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:50.804363 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010fb829-2081-4515-a25b-6c36cc44a767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:50.805418 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010fb829-2081-4515-a25b-6c36cc44a767 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:50.805896 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010fb829-2081-4515-a25b-6c36cc44a767 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:50.806417 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010fb829-2081-4515-a25b-6c36cc44a767 None admin] PATH_INFO: `/v3/projects/d979106c8a164d55aa33fdb5ea995c7a` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:50.807886 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010fb829-2081-4515-a25b-6c36cc44a767 None admin] RBAC: Authorizing `identity:get_project(project_id=d979106c8a164d55aa33fdb5ea995c7a)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:50.809677 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010fb829-2081-4515-a25b-6c36cc44a767 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:50.811717 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 88/179] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 01:16:50 2022] GET /identity/v3/projects/d979106c8a164d55aa33fdb5ea995c7a => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:16:50.812747 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010fb829-2081-4515-a25b-6c36cc44a767 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:50.833969 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-6b2e6251-25dd-434d-b20c-dc377cfd6f6e None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:16:50.835215 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-6b2e6251-25dd-434d-b20c-dc377cfd6f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:16:50.886639 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:50.933174 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010fb829-2081-4515-a25b-6c36cc44a767 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:50.968353 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:50.974675 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e0cda8-d594-4171-a40e-b8afbc0cff15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:50.975832 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0cda8-d594-4171-a40e-b8afbc0cff15 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:50.976374 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0cda8-d594-4171-a40e-b8afbc0cff15 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:50.976878 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0cda8-d594-4171-a40e-b8afbc0cff15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:51.009422 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 92/180] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:16:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 01:16:51.010214 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e6251-25dd-434d-b20c-dc377cfd6f6e None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:51.054279 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e0cda8-d594-4171-a40e-b8afbc0cff15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:51.056136 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e0cda8-d594-4171-a40e-b8afbc0cff15 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:51.161261 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 89/181] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 01:16:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 01:16:51.162488 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e0cda8-d594-4171-a40e-b8afbc0cff15 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:51.179802 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e6251-25dd-434d-b20c-dc377cfd6f6e None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:51.201699 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:51.223389 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f19fca5-afd3-4bb6-9292-69e2e5d07698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:51.224358 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19fca5-afd3-4bb6-9292-69e2e5d07698 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:51.224830 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19fca5-afd3-4bb6-9292-69e2e5d07698 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:51.225363 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19fca5-afd3-4bb6-9292-69e2e5d07698 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:51.226344 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f19fca5-afd3-4bb6-9292-69e2e5d07698 None admin] RBAC: Adding query filter params (role.id=bab2af60c26640acbd0c4db2f9796cfb, scope.project.id=d979106c8a164d55aa33fdb5ea995c7a, user.id=5f6ec5f1c46f46ccb2adc6dd83aafb22) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:16:51.226845 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f19fca5-afd3-4bb6-9292-69e2e5d07698 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:51.228571 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f19fca5-afd3-4bb6-9292-69e2e5d07698 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:51.234974 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 93/182] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 01:16:51 2022] GET /identity/v3/role_assignments?user.id=5f6ec5f1c46f46ccb2adc6dd83aafb22&scope.project.id=d979106c8a164d55aa33fdb5ea995c7a&role.id=bab2af60c26640acbd0c4db2f9796cfb => generated 608 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:16:51.236062 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f19fca5-afd3-4bb6-9292-69e2e5d07698 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:51.260729 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:51.312673 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e0cda8-d594-4171-a40e-b8afbc0cff15 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:51.360441 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f19fca5-afd3-4bb6-9292-69e2e5d07698 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:51.392646 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f97ea5-d707-4082-ad23-e5cc80cbe11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:51.393639 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f97ea5-d707-4082-ad23-e5cc80cbe11a None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:51.394073 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f97ea5-d707-4082-ad23-e5cc80cbe11a None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:51.394503 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f97ea5-d707-4082-ad23-e5cc80cbe11a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:51.405045 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23e8ca1-1b20-45c7-be45-12c39e3cd321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:51.405960 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e8ca1-1b20-45c7-be45-12c39e3cd321 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:51.406339 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e8ca1-1b20-45c7-be45-12c39e3cd321 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:51.406792 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e8ca1-1b20-45c7-be45-12c39e3cd321 None admin] PATH_INFO: `/v3/projects/b934d2629fc5478a95bfd0633b589a39` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:51.408101 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23e8ca1-1b20-45c7-be45-12c39e3cd321 None admin] RBAC: Authorizing `identity:get_project(project_id=b934d2629fc5478a95bfd0633b589a39)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:51.409858 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23e8ca1-1b20-45c7-be45-12c39e3cd321 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:51.412437 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f97ea5-d707-4082-ad23-e5cc80cbe11a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:16:51.413114 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 94/183] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 01:16:51 2022] GET /identity/v3/projects/b934d2629fc5478a95bfd0633b589a39 => generated 312 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:16:51.414224 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f10168-bc99-46d7-ac3a-5cb2981d52fa None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:51.414597 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f10168-bc99-46d7-ac3a-5cb2981d52fa None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:51.414878 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f10168-bc99-46d7-ac3a-5cb2981d52fa None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:51.416077 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 95/184] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:16:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:16:51.416829 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f10168-bc99-46d7-ac3a-5cb2981d52fa None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:51.419875 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-e4f97ea5-d707-4082-ad23-e5cc80cbe11a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 01:16:51.419875 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:16:51.419875 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:16:51.419875 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:16:51.419875 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:16:51.419875 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:16:51.419875 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:16:51.419875 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:16:51.419875 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:16:51.419875 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:16:51.419875 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:16:51.419875 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:16:51.419875 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:16:51.419875 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:16:51.419875 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:16:51.419875 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:16:51.421091 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:16:51.421091 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:16:51.421091 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:16:51.421091 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:16:51.421091 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:16:51.421091 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:16:51.421091 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:16:51.421091 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:16:51.421091 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:16:51.421091 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:16:51.421091 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:16:51.421091 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:16:51.421091 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:16:51.421091 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:16:51.421091 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:16:51.421091 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:16:51.421869 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:16:51.421869 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:16:51.421869 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:16:51.421869 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:16:51.421869 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:16:51.421869 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:16:51.421869 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:16:51.421869 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:16:51.421869 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:16:51.421869 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:16:51.421869 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 01:16:51.421869 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:16:51.421869 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 90/185] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 01:16:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:16:51.423150 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f97ea5-d707-4082-ad23-e5cc80cbe11a None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:51.524931 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:51.532014 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:51.539359 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f10168-bc99-46d7-ac3a-5cb2981d52fa None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:51.540699 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f97ea5-d707-4082-ad23-e5cc80cbe11a None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:51.574161 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c228614-5b16-4e17-93e3-a49771ec06b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:51.574353 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088cd321-a979-421b-8e2f-9bf69035268c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:51.574716 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c228614-5b16-4e17-93e3-a49771ec06b8 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:51.574821 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088cd321-a979-421b-8e2f-9bf69035268c None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:51.574989 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c228614-5b16-4e17-93e3-a49771ec06b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:51.575082 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088cd321-a979-421b-8e2f-9bf69035268c None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:51.575253 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c228614-5b16-4e17-93e3-a49771ec06b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:51.575338 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088cd321-a979-421b-8e2f-9bf69035268c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:51.576024 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088cd321-a979-421b-8e2f-9bf69035268c None admin] RBAC: Adding query filter params (role.id=13af81971c1c428eae0a571a22ea583d, scope.project.id=b934d2629fc5478a95bfd0633b589a39, user.id=5f6ec5f1c46f46ccb2adc6dd83aafb22) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:16:51.576331 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088cd321-a979-421b-8e2f-9bf69035268c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:51.577785 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088cd321-a979-421b-8e2f-9bf69035268c None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:51.583725 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 91/186] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 01:16:51 2022] GET /identity/v3/role_assignments?user.id=5f6ec5f1c46f46ccb2adc6dd83aafb22&scope.project.id=b934d2629fc5478a95bfd0633b589a39&role.id=13af81971c1c428eae0a571a22ea583d => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:16:51.584851 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8036e89-d2d5-4717-904f-3d851173680a None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:51.585127 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8036e89-d2d5-4717-904f-3d851173680a None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:51.585392 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8036e89-d2d5-4717-904f-3d851173680a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:51.595527 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c228614-5b16-4e17-93e3-a49771ec06b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:16:51.600494 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-9c228614-5b16-4e17-93e3-a49771ec06b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 01:16:51.600494 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:16:51.600494 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:16:51.600494 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:16:51.600494 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:16:51.600494 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:16:51.600494 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:16:51.600494 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:16:51.600494 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:16:51.600494 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:16:51.600494 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:16:51.600494 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:16:51.600494 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:16:51.600494 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:16:51.600494 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:16:51.600494 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:16:51.601443 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:16:51.601443 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:16:51.601443 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:16:51.601443 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:16:51.601443 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:16:51.601443 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:16:51.601443 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:16:51.601443 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:16:51.601443 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:16:51.601443 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:16:51.601443 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:16:51.601443 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:16:51.601443 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:16:51.601443 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:16:51.601443 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:16:51.601443 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:16:51.602313 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:16:51.602313 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:16:51.602313 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:16:51.602313 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:16:51.602313 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:16:51.602313 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:16:51.602313 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:16:51.602313 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:16:51.602313 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:16:51.602313 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:16:51.602313 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 01:16:51.602313 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:16:51.602907 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 96/187] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Aug 12 01:16:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:16:51.603950 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c228614-5b16-4e17-93e3-a49771ec06b8 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:51.604123 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-e8036e89-d2d5-4717-904f-3d851173680a None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:16:51.605356 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-e8036e89-d2d5-4717-904f-3d851173680a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:16:51.685471 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 92/188] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:16:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 01:16:51.686863 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc25281f-e7bc-4659-b311-993f9fc57f60 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:51.687151 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc25281f-e7bc-4659-b311-993f9fc57f60 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:51.687419 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc25281f-e7bc-4659-b311-993f9fc57f60 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:51.688682 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 93/189] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:16:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:16:51.689387 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc25281f-e7bc-4659-b311-993f9fc57f60 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:51.733204 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c228614-5b16-4e17-93e3-a49771ec06b8 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:51.772157 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4141c83d-3dad-413b-8a07-66b3a74b4866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:51.773193 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4141c83d-3dad-413b-8a07-66b3a74b4866 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:51.773471 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4141c83d-3dad-413b-8a07-66b3a74b4866 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:51.773737 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4141c83d-3dad-413b-8a07-66b3a74b4866 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:51.777305 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4141c83d-3dad-413b-8a07-66b3a74b4866 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:16:51.777305 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4141c83d-3dad-413b-8a07-66b3a74b4866 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:51.777601 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4141c83d-3dad-413b-8a07-66b3a74b4866 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:51.793538 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 97/190] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Aug 12 01:16:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:16:51.794968 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40725958-a831-46eb-bfab-bb61711e9f92 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:51.795248 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40725958-a831-46eb-bfab-bb61711e9f92 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:51.795513 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40725958-a831-46eb-bfab-bb61711e9f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:51.799347 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:51.814741 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-40725958-a831-46eb-bfab-bb61711e9f92 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:16:51.815914 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-40725958-a831-46eb-bfab-bb61711e9f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:16:51.819065 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:51.823463 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc25281f-e7bc-4659-b311-993f9fc57f60 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:51.865343 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae670ea-c13a-4461-a3ff-a76ad183998f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:51.865970 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae670ea-c13a-4461-a3ff-a76ad183998f None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:51.866538 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae670ea-c13a-4461-a3ff-a76ad183998f None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:51.866639 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae670ea-c13a-4461-a3ff-a76ad183998f None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:51.867270 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae670ea-c13a-4461-a3ff-a76ad183998f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:16:51.867560 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae670ea-c13a-4461-a3ff-a76ad183998f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:51.869139 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae670ea-c13a-4461-a3ff-a76ad183998f None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:51.877478 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 94/191] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 01:16:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:16:51.878377 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae670ea-c13a-4461-a3ff-a76ad183998f None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:51.891201 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 98/192] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:16:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 01:16:51.899496 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40725958-a831-46eb-bfab-bb61711e9f92 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:51.985613 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae670ea-c13a-4461-a3ff-a76ad183998f None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:52.020290 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49347dde-617a-4fd9-b25d-dfc184f60269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:52.020981 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49347dde-617a-4fd9-b25d-dfc184f60269 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:52.021265 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49347dde-617a-4fd9-b25d-dfc184f60269 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:52.021528 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40725958-a831-46eb-bfab-bb61711e9f92 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:52.021648 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49347dde-617a-4fd9-b25d-dfc184f60269 None admin] PATH_INFO: `/v3/users/2630819f4ef249b7a6c4325ce54d0d0a` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:52.022688 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49347dde-617a-4fd9-b25d-dfc184f60269 None admin] RBAC: Authorizing `identity:get_user(user_id=2630819f4ef249b7a6c4325ce54d0d0a)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:52.024316 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49347dde-617a-4fd9-b25d-dfc184f60269 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:52.030665 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 95/193] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 01:16:51 2022] GET /identity/v3/users/2630819f4ef249b7a6c4325ce54d0d0a => generated 289 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:16:52.030665 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49347dde-617a-4fd9-b25d-dfc184f60269 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:52.051227 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:52.057515 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f432c03e-9c4b-43bd-9405-802525bdabfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:52.058164 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f432c03e-9c4b-43bd-9405-802525bdabfb None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:52.058437 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f432c03e-9c4b-43bd-9405-802525bdabfb None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:52.058704 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f432c03e-9c4b-43bd-9405-802525bdabfb None admin] PATH_INFO: `/v3/users/36485c2294d549aa80ad8856a97be348` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:52.068782 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:52.072511 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f432c03e-9c4b-43bd-9405-802525bdabfb None admin] RBAC: Authorizing `identity:get_user(user_id=36485c2294d549aa80ad8856a97be348)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:52.075494 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f432c03e-9c4b-43bd-9405-802525bdabfb None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:52.077153 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 99/194] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 01:16:51 2022] GET /identity/v3/users/36485c2294d549aa80ad8856a97be348 => generated 283 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:16:52.081631 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f432c03e-9c4b-43bd-9405-802525bdabfb None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:52.143332 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49347dde-617a-4fd9-b25d-dfc184f60269 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:52.177206 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b9ae52-0170-41c0-9b35-a4dae04616f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:52.177829 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9ae52-0170-41c0-9b35-a4dae04616f4 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:52.178099 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9ae52-0170-41c0-9b35-a4dae04616f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:52.178392 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9ae52-0170-41c0-9b35-a4dae04616f4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:52.179014 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f432c03e-9c4b-43bd-9405-802525bdabfb None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:52.188178 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b9ae52-0170-41c0-9b35-a4dae04616f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:16:52.193217 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-73b9ae52-0170-41c0-9b35-a4dae04616f4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 01:16:52.193217 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:16:52.193217 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:16:52.193217 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:16:52.193217 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:16:52.193217 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:16:52.193217 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:16:52.193217 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:16:52.193217 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:16:52.193217 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:16:52.193217 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:16:52.193217 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:16:52.193217 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:16:52.193217 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:16:52.193217 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:16:52.193217 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:16:52.194252 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:16:52.194252 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:16:52.194252 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:16:52.194252 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:16:52.194252 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:16:52.194252 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:16:52.194252 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:16:52.194252 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:16:52.194252 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:16:52.194252 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:16:52.194252 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:16:52.194252 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:16:52.194252 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:16:52.194252 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:16:52.194252 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:16:52.194252 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:16:52.195266 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:16:52.195266 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:16:52.195266 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:16:52.195266 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:16:52.195266 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:16:52.195266 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:16:52.195266 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:16:52.195266 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:16:52.195266 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:16:52.195266 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:16:52.195266 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 01:16:52.195266 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:16:52.195266 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 96/195] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Aug 12 01:16:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:16:52.195266 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b9ae52-0170-41c0-9b35-a4dae04616f4 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:52.212685 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8505a7de-77f7-48e4-9a53-cc4e9b4eec26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:52.213272 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505a7de-77f7-48e4-9a53-cc4e9b4eec26 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:52.213547 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505a7de-77f7-48e4-9a53-cc4e9b4eec26 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:52.213814 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505a7de-77f7-48e4-9a53-cc4e9b4eec26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:52.269777 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:52.277131 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:52.280675 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8505a7de-77f7-48e4-9a53-cc4e9b4eec26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:52.282737 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8505a7de-77f7-48e4-9a53-cc4e9b4eec26 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:52.293782 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b9ae52-0170-41c0-9b35-a4dae04616f4 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:52.326039 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f620c5-9699-462b-90f2-f250ebb2f6b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:52.326643 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f620c5-9699-462b-90f2-f250ebb2f6b9 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:52.326916 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f620c5-9699-462b-90f2-f250ebb2f6b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:52.327180 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f620c5-9699-462b-90f2-f250ebb2f6b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:52.379922 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 100/196] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 01:16:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 01:16:52.380876 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8505a7de-77f7-48e4-9a53-cc4e9b4eec26 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:52.392350 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f620c5-9699-462b-90f2-f250ebb2f6b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:52.393843 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f620c5-9699-462b-90f2-f250ebb2f6b9 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:52.468298 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:52.476418 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:52.482272 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8505a7de-77f7-48e4-9a53-cc4e9b4eec26 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:52.496889 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 97/197] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 01:16:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 01:16:52.497736 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f620c5-9699-462b-90f2-f250ebb2f6b9 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:52.518107 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff0bca-cb0d-4f49-bf2d-532f206bf3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:52.518787 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff0bca-cb0d-4f49-bf2d-532f206bf3ec None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:52.519057 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff0bca-cb0d-4f49-bf2d-532f206bf3ec None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:52.519324 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff0bca-cb0d-4f49-bf2d-532f206bf3ec None admin] PATH_INFO: `/v3/domains/default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:52.520429 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ff0bca-cb0d-4f49-bf2d-532f206bf3ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:52.521933 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ff0bca-cb0d-4f49-bf2d-532f206bf3ec None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:52.523522 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 101/198] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:16:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:16:52.524562 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff0bca-cb0d-4f49-bf2d-532f206bf3ec None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:52.597535 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f620c5-9699-462b-90f2-f250ebb2f6b9 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:52.620813 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff0bca-cb0d-4f49-bf2d-532f206bf3ec None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:52.629784 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c8e5fa-30ad-4c32-89ab-67ef77bf5e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:52.630415 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8e5fa-30ad-4c32-89ab-67ef77bf5e1e None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:52.630691 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8e5fa-30ad-4c32-89ab-67ef77bf5e1e None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:52.630962 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8e5fa-30ad-4c32-89ab-67ef77bf5e1e None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:52.631620 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c8e5fa-30ad-4c32-89ab-67ef77bf5e1e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:16:52.631920 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c8e5fa-30ad-4c32-89ab-67ef77bf5e1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:52.633322 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c8e5fa-30ad-4c32-89ab-67ef77bf5e1e None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:52.641102 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 98/199] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 01:16:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:16:52.641877 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c8e5fa-30ad-4c32-89ab-67ef77bf5e1e None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:52.658307 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774f13b9-4d5c-4657-9819-320b1782a1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:52.658866 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f13b9-4d5c-4657-9819-320b1782a1dc None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:52.659138 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f13b9-4d5c-4657-9819-320b1782a1dc None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:52.659424 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f13b9-4d5c-4657-9819-320b1782a1dc None admin] PATH_INFO: `/v3/projects/d979106c8a164d55aa33fdb5ea995c7a` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:52.660652 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774f13b9-4d5c-4657-9819-320b1782a1dc None admin] RBAC: Authorizing `identity:get_project(project_id=d979106c8a164d55aa33fdb5ea995c7a)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:52.661980 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774f13b9-4d5c-4657-9819-320b1782a1dc None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:52.663635 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 102/200] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 01:16:52 2022] GET /identity/v3/projects/d979106c8a164d55aa33fdb5ea995c7a => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:16:52.664364 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774f13b9-4d5c-4657-9819-320b1782a1dc None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:52.685971 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:52.699101 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:52.746405 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c8e5fa-30ad-4c32-89ab-67ef77bf5e1e None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:52.778849 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774f13b9-4d5c-4657-9819-320b1782a1dc None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:52.786434 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c2dcbc-78ed-4eae-83bf-ea05ab36ba93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:52.787080 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2dcbc-78ed-4eae-83bf-ea05ab36ba93 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:52.787372 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2dcbc-78ed-4eae-83bf-ea05ab36ba93 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:52.787637 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2dcbc-78ed-4eae-83bf-ea05ab36ba93 None admin] PATH_INFO: `/v3/projects/45a8fcf9582d42ccaffc8d521078eab0` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:52.788995 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c2dcbc-78ed-4eae-83bf-ea05ab36ba93 None admin] RBAC: Authorizing `identity:get_project(project_id=45a8fcf9582d42ccaffc8d521078eab0)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:52.790886 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c2dcbc-78ed-4eae-83bf-ea05ab36ba93 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:52.792520 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 99/201] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 01:16:52 2022] GET /identity/v3/projects/45a8fcf9582d42ccaffc8d521078eab0 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:16:52.793370 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c2dcbc-78ed-4eae-83bf-ea05ab36ba93 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:52.817243 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb0dcb0-55a6-4e43-a759-3304f8dc6420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:52.817853 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb0dcb0-55a6-4e43-a759-3304f8dc6420 None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:52.818166 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb0dcb0-55a6-4e43-a759-3304f8dc6420 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:52.818432 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb0dcb0-55a6-4e43-a759-3304f8dc6420 None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:52.819092 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb0dcb0-55a6-4e43-a759-3304f8dc6420 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:52.820526 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb0dcb0-55a6-4e43-a759-3304f8dc6420 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:52.841490 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 103/202] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Aug 12 01:16:52 2022] POST /identity/v3/users => generated 297 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:16:52.841490 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb0dcb0-55a6-4e43-a759-3304f8dc6420 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:52.906539 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c2dcbc-78ed-4eae-83bf-ea05ab36ba93 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:52.914650 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:52.942003 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:52.947702 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea209ff-42fb-4b69-843e-290b371ab0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:52.948595 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea209ff-42fb-4b69-843e-290b371ab0f7 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:52.948930 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea209ff-42fb-4b69-843e-290b371ab0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:52.949278 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea209ff-42fb-4b69-843e-290b371ab0f7 None admin] PATH_INFO: `/v3/users/36485c2294d549aa80ad8856a97be348` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:52.950513 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea209ff-42fb-4b69-843e-290b371ab0f7 None admin] RBAC: Authorizing `identity:get_user(user_id=36485c2294d549aa80ad8856a97be348)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:52.951982 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea209ff-42fb-4b69-843e-290b371ab0f7 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:52.953628 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 100/203] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 01:16:52 2022] GET /identity/v3/users/36485c2294d549aa80ad8856a97be348 => generated 283 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:16:52.953628 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea209ff-42fb-4b69-843e-290b371ab0f7 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:52.960221 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb0dcb0-55a6-4e43-a759-3304f8dc6420 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:52.999004 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7718c3-a32f-4664-a3a9-ed1837738474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:52.999638 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7718c3-a32f-4664-a3a9-ed1837738474 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:52.999913 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7718c3-a32f-4664-a3a9-ed1837738474 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:53.000185 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7718c3-a32f-4664-a3a9-ed1837738474 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:53.000928 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7718c3-a32f-4664-a3a9-ed1837738474 None admin] RBAC: Adding query filter params (role.id=d3ac26b4075941a7a84580ef43d093f6, scope.project.id=d979106c8a164d55aa33fdb5ea995c7a, user.id=2630819f4ef249b7a6c4325ce54d0d0a) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:16:53.001242 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7718c3-a32f-4664-a3a9-ed1837738474 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:53.002788 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7718c3-a32f-4664-a3a9-ed1837738474 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:53.011787 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 104/204] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 01:16:52 2022] GET /identity/v3/role_assignments?user.id=2630819f4ef249b7a6c4325ce54d0d0a&scope.project.id=d979106c8a164d55aa33fdb5ea995c7a&role.id=d3ac26b4075941a7a84580ef43d093f6 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:16:53.012876 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7718c3-a32f-4664-a3a9-ed1837738474 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:53.077247 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea209ff-42fb-4b69-843e-290b371ab0f7 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:53.130341 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea3f333-ad0a-4cb6-8661-31592230c0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:53.131252 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3f333-ad0a-4cb6-8661-31592230c0f3 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:53.131667 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3f333-ad0a-4cb6-8661-31592230c0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:53.132068 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3f333-ad0a-4cb6-8661-31592230c0f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:53.132975 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea3f333-ad0a-4cb6-8661-31592230c0f3 None admin] RBAC: Adding query filter params (role.id=fb48693810be495fb4b1893a79429b78, scope.project.id=45a8fcf9582d42ccaffc8d521078eab0, user.id=36485c2294d549aa80ad8856a97be348) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:16:53.133477 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea3f333-ad0a-4cb6-8661-31592230c0f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:53.135161 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea3f333-ad0a-4cb6-8661-31592230c0f3 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:53.141597 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 101/205] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 01:16:52 2022] GET /identity/v3/role_assignments?user.id=36485c2294d549aa80ad8856a97be348&scope.project.id=45a8fcf9582d42ccaffc8d521078eab0&role.id=fb48693810be495fb4b1893a79429b78 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:16:53.161684 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7718c3-a32f-4664-a3a9-ed1837738474 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:53.211186 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4fbc51-51ca-4309-ac3d-031d7272fb83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:53.212042 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4fbc51-51ca-4309-ac3d-031d7272fb83 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:53.212716 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4fbc51-51ca-4309-ac3d-031d7272fb83 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:53.212991 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4fbc51-51ca-4309-ac3d-031d7272fb83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:53.244439 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:53.297575 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4fbc51-51ca-4309-ac3d-031d7272fb83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:53.299098 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4fbc51-51ca-4309-ac3d-031d7272fb83 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:53.412264 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 105/206] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 01:16:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 01:16:53.419211 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea3f333-ad0a-4cb6-8661-31592230c0f3 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:53.466424 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:53.531852 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea3f333-ad0a-4cb6-8661-31592230c0f3 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:53.567471 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918df5ef-a197-4a8c-a6a0-8947edb830b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:53.568106 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918df5ef-a197-4a8c-a6a0-8947edb830b6 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:53.568383 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918df5ef-a197-4a8c-a6a0-8947edb830b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:53.568651 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918df5ef-a197-4a8c-a6a0-8947edb830b6 None admin] PATH_INFO: `/v3/projects/45a8fcf9582d42ccaffc8d521078eab0` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:53.569766 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918df5ef-a197-4a8c-a6a0-8947edb830b6 None admin] RBAC: Authorizing `identity:get_project(project_id=45a8fcf9582d42ccaffc8d521078eab0)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:53.571478 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918df5ef-a197-4a8c-a6a0-8947edb830b6 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:53.573330 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 102/207] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 01:16:53 2022] GET /identity/v3/projects/45a8fcf9582d42ccaffc8d521078eab0 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:16:53.579047 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4fbc51-51ca-4309-ac3d-031d7272fb83 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:53.636198 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:53.684757 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4fbc51-51ca-4309-ac3d-031d7272fb83 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:53.720237 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eb9f08-38f4-4546-86d1-cbde02df7e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:53.721159 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb9f08-38f4-4546-86d1-cbde02df7e24 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:53.721710 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb9f08-38f4-4546-86d1-cbde02df7e24 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:53.722169 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb9f08-38f4-4546-86d1-cbde02df7e24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:53.723073 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eb9f08-38f4-4546-86d1-cbde02df7e24 None admin] RBAC: Adding query filter params (role.id=bab2af60c26640acbd0c4db2f9796cfb, scope.project.id=45a8fcf9582d42ccaffc8d521078eab0, user.id=36485c2294d549aa80ad8856a97be348) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:16:53.723540 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eb9f08-38f4-4546-86d1-cbde02df7e24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:53.725153 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eb9f08-38f4-4546-86d1-cbde02df7e24 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:53.733454 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 106/208] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 01:16:53 2022] GET /identity/v3/role_assignments?user.id=36485c2294d549aa80ad8856a97be348&scope.project.id=45a8fcf9582d42ccaffc8d521078eab0&role.id=bab2af60c26640acbd0c4db2f9796cfb => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:16:54.967536 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1cde2-8740-445a-9bb0-c24beef177a8 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:54.968520 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1cde2-8740-445a-9bb0-c24beef177a8 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:54.969001 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1cde2-8740-445a-9bb0-c24beef177a8 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:54.970575 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 103/209] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:16:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:16:54.975772 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381af9a-fab3-43f2-adba-c8f8fd29b1b9 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:54.976148 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381af9a-fab3-43f2-adba-c8f8fd29b1b9 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:54.976305 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381af9a-fab3-43f2-adba-c8f8fd29b1b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:54.994692 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-c381af9a-fab3-43f2-adba-c8f8fd29b1b9 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:16:54.995869 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c381af9a-fab3-43f2-adba-c8f8fd29b1b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:16:55.066809 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 107/210] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:16:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 01:16:55.155606 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3bd06a-926a-4c9b-ab7b-80849a0126e3 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:55.155940 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3bd06a-926a-4c9b-ab7b-80849a0126e3 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:55.156351 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3bd06a-926a-4c9b-ab7b-80849a0126e3 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:55.158096 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 104/211] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:16:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:16:55.163083 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9270565-3f13-414d-89bc-9c41c469c1d5 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:55.163367 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9270565-3f13-414d-89bc-9c41c469c1d5 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:55.163669 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9270565-3f13-414d-89bc-9c41c469c1d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:55.183087 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-f9270565-3f13-414d-89bc-9c41c469c1d5 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:16:55.184270 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f9270565-3f13-414d-89bc-9c41c469c1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:16:55.188683 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf6062-816e-4d2c-85cc-efc633da7b93 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:55.188959 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf6062-816e-4d2c-85cc-efc633da7b93 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:55.189230 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf6062-816e-4d2c-85cc-efc633da7b93 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:55.190818 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 105/212] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:16:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:16:55.195887 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0737aa5f-e264-4175-9cd8-db27ccc24141 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:55.196166 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0737aa5f-e264-4175-9cd8-db27ccc24141 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:55.196438 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0737aa5f-e264-4175-9cd8-db27ccc24141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:55.214830 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-0737aa5f-e264-4175-9cd8-db27ccc24141 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:16:55.216193 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-0737aa5f-e264-4175-9cd8-db27ccc24141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:16:55.230357 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:55.254456 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 108/213] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:16:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 01:16:55.297254 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 106/214] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:16:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 01:16:55.344764 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9270565-3f13-414d-89bc-9c41c469c1d5 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:55.458100 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9270565-3f13-414d-89bc-9c41c469c1d5 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:55.494894 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e585bd-6c7d-4e06-9b91-c551b16b2699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:55.495538 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e585bd-6c7d-4e06-9b91-c551b16b2699 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:55.495810 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e585bd-6c7d-4e06-9b91-c551b16b2699 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:55.496074 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e585bd-6c7d-4e06-9b91-c551b16b2699 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:55.506868 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e585bd-6c7d-4e06-9b91-c551b16b2699 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:16:55.511729 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-d1e585bd-6c7d-4e06-9b91-c551b16b2699 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 01:16:55.511729 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:16:55.511729 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:16:55.511729 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:16:55.511729 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:16:55.511729 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:16:55.511729 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:16:55.511729 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:16:55.511729 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:16:55.511729 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:16:55.511729 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:16:55.511729 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:16:55.511729 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:16:55.511729 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:16:55.511729 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:16:55.511729 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:16:55.512578 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:16:55.512578 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:16:55.512578 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:16:55.512578 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:16:55.512578 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:16:55.512578 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:16:55.512578 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:16:55.512578 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:16:55.512578 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:16:55.512578 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:16:55.512578 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:16:55.512578 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:16:55.512578 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:16:55.512578 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:16:55.512578 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:16:55.512578 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:16:55.513525 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:16:55.513525 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:16:55.513525 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:16:55.513525 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:16:55.513525 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:16:55.513525 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:16:55.513525 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:16:55.513525 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:16:55.513525 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:16:55.513525 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:16:55.513525 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 01:16:55.513525 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:16:55.513525 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 109/215] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 01:16:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:16:55.518891 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0737aa5f-e264-4175-9cd8-db27ccc24141 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:55.538952 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e585bd-6c7d-4e06-9b91-c551b16b2699 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:55.554668 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:55.582421 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:55.625840 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0737aa5f-e264-4175-9cd8-db27ccc24141 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:55.644839 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e585bd-6c7d-4e06-9b91-c551b16b2699 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:55.660386 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510a528e-19c1-4a5e-8768-8bbef652c1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:55.661004 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a528e-19c1-4a5e-8768-8bbef652c1c8 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:55.661278 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a528e-19c1-4a5e-8768-8bbef652c1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:55.661550 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a528e-19c1-4a5e-8768-8bbef652c1c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:55.662258 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510a528e-19c1-4a5e-8768-8bbef652c1c8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:16:55.662566 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510a528e-19c1-4a5e-8768-8bbef652c1c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:55.663964 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510a528e-19c1-4a5e-8768-8bbef652c1c8 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:55.672562 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 107/216] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Aug 12 01:16:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:16:55.673268 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510a528e-19c1-4a5e-8768-8bbef652c1c8 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:55.683768 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc656493-53f1-4788-a4f0-c07f65713863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:55.684440 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc656493-53f1-4788-a4f0-c07f65713863 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:55.684712 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc656493-53f1-4788-a4f0-c07f65713863 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:55.684969 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc656493-53f1-4788-a4f0-c07f65713863 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:55.694973 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc656493-53f1-4788-a4f0-c07f65713863 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:16:55.699658 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-dc656493-53f1-4788-a4f0-c07f65713863 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 01:16:55.699658 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:16:55.699658 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:16:55.699658 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:16:55.699658 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:16:55.699658 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:16:55.699658 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:16:55.699658 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:16:55.699658 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:16:55.699658 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:16:55.699658 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:16:55.699658 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:16:55.699658 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:16:55.699658 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:16:55.699658 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:16:55.699658 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:16:55.700679 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:16:55.700679 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:16:55.700679 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:16:55.700679 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:16:55.700679 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:16:55.700679 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:16:55.700679 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:16:55.700679 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:16:55.700679 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:16:55.700679 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:16:55.700679 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:16:55.700679 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:16:55.700679 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:16:55.700679 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:16:55.700679 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:16:55.700679 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:16:55.701439 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:16:55.701439 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:16:55.701439 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:16:55.701439 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:16:55.701439 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:16:55.701439 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:16:55.701439 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:16:55.701439 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:16:55.701439 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:16:55.701439 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:16:55.701439 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 01:16:55.701439 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:16:55.701439 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 110/217] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Aug 12 01:16:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 01:16:55.702076 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b190d-ec2c-46c2-835e-15602145af61 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:55.702175 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b190d-ec2c-46c2-835e-15602145af61 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:55.702735 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b190d-ec2c-46c2-835e-15602145af61 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:55.703729 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 111/218] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:16:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:16:55.704287 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b190d-ec2c-46c2-835e-15602145af61 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:55.774506 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:55.778249 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510a528e-19c1-4a5e-8768-8bbef652c1c8 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:55.799368 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:55.804855 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b190d-ec2c-46c2-835e-15602145af61 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:55.813097 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2260e-abfa-48cb-9710-218fb1946b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:55.813733 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2260e-abfa-48cb-9710-218fb1946b6b None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:55.814000 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2260e-abfa-48cb-9710-218fb1946b6b None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:55.814288 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2260e-abfa-48cb-9710-218fb1946b6b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:55.815411 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a2260e-abfa-48cb-9710-218fb1946b6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:55.816860 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a2260e-abfa-48cb-9710-218fb1946b6b None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:55.818460 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 108/219] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:16:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:16:55.819495 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2260e-abfa-48cb-9710-218fb1946b6b None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:55.842756 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035460af-7a5c-40b7-b24a-7f85533022ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:55.843403 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035460af-7a5c-40b7-b24a-7f85533022ec None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:55.843676 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035460af-7a5c-40b7-b24a-7f85533022ec None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:55.843931 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035460af-7a5c-40b7-b24a-7f85533022ec None admin] PATH_INFO: `/v3/users/1d3dbca38dba42dc90cf8983aaddd5be` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:55.857085 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035460af-7a5c-40b7-b24a-7f85533022ec None admin] RBAC: Authorizing `identity:get_user(user_id=1d3dbca38dba42dc90cf8983aaddd5be)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:55.858620 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035460af-7a5c-40b7-b24a-7f85533022ec None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:55.860226 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 112/220] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 01:16:55 2022] GET /identity/v3/users/1d3dbca38dba42dc90cf8983aaddd5be => generated 297 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:16:55.861340 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6edb305-04f1-47fc-b249-5b69848ee171 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:55.861621 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6edb305-04f1-47fc-b249-5b69848ee171 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:55.861892 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6edb305-04f1-47fc-b249-5b69848ee171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:55.879144 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-c6edb305-04f1-47fc-b249-5b69848ee171 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:16:55.880363 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c6edb305-04f1-47fc-b249-5b69848ee171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:16:55.924690 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2260e-abfa-48cb-9710-218fb1946b6b None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:55.950615 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 113/221] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:16:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 01:16:55.951438 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6edb305-04f1-47fc-b249-5b69848ee171 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:55.957509 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d45960-6142-41a2-92a1-d096a4ab30f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:55.958136 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d45960-6142-41a2-92a1-d096a4ab30f4 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:55.958427 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d45960-6142-41a2-92a1-d096a4ab30f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:55.958699 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d45960-6142-41a2-92a1-d096a4ab30f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:55.959363 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d45960-6142-41a2-92a1-d096a4ab30f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:16:55.959666 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d45960-6142-41a2-92a1-d096a4ab30f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:55.961071 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d45960-6142-41a2-92a1-d096a4ab30f4 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:55.969588 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 109/222] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 01:16:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:16:55.970420 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d45960-6142-41a2-92a1-d096a4ab30f4 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:56.003207 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:56.043048 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:56.060765 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6edb305-04f1-47fc-b249-5b69848ee171 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:56.080873 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d45960-6142-41a2-92a1-d096a4ab30f4 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:56.095926 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d67c903-5dc4-4600-9bc8-253a4998a3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:56.096536 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d67c903-5dc4-4600-9bc8-253a4998a3e4 None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:56.096803 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d67c903-5dc4-4600-9bc8-253a4998a3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:56.097072 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d67c903-5dc4-4600-9bc8-253a4998a3e4 None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:56.097714 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d67c903-5dc4-4600-9bc8-253a4998a3e4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:56.099216 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d67c903-5dc4-4600-9bc8-253a4998a3e4 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:56.115562 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf580c-3f8b-4579-a546-8c35e7a3848f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:56.116122 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf580c-3f8b-4579-a546-8c35e7a3848f None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:56.116429 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf580c-3f8b-4579-a546-8c35e7a3848f None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:56.116675 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf580c-3f8b-4579-a546-8c35e7a3848f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:56.134155 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 114/223] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Aug 12 01:16:55 2022] POST /identity/v3/users => generated 297 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:16:56.134155 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d67c903-5dc4-4600-9bc8-253a4998a3e4 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:56.194527 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cf580c-3f8b-4579-a546-8c35e7a3848f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:56.196553 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cf580c-3f8b-4579-a546-8c35e7a3848f None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:56.229307 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:56.284124 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d67c903-5dc4-4600-9bc8-253a4998a3e4 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:56.317812 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 110/224] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 01:16:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 01:16:56.322244 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf580c-3f8b-4579-a546-8c35e7a3848f None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:56.328832 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79633457-547e-4269-9488-26852f9b8cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:56.329484 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79633457-547e-4269-9488-26852f9b8cb7 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:56.329762 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79633457-547e-4269-9488-26852f9b8cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:56.330033 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79633457-547e-4269-9488-26852f9b8cb7 None admin] PATH_INFO: `/v3/users/36485c2294d549aa80ad8856a97be348` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:56.331712 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79633457-547e-4269-9488-26852f9b8cb7 None admin] RBAC: Authorizing `identity:get_user(user_id=36485c2294d549aa80ad8856a97be348)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:56.333193 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79633457-547e-4269-9488-26852f9b8cb7 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:56.335963 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 115/225] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 01:16:56 2022] GET /identity/v3/users/36485c2294d549aa80ad8856a97be348 => generated 283 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:16:56.336648 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79633457-547e-4269-9488-26852f9b8cb7 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:56.354571 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:56.447785 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf580c-3f8b-4579-a546-8c35e7a3848f None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:56.464897 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79633457-547e-4269-9488-26852f9b8cb7 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:56.482348 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:56.499414 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf81332-7b2b-409e-9c4d-eff91e8b7760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:56.500078 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf81332-7b2b-409e-9c4d-eff91e8b7760 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:56.500675 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf81332-7b2b-409e-9c4d-eff91e8b7760 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:56.501062 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf81332-7b2b-409e-9c4d-eff91e8b7760 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:56.511379 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07713409-7098-43d4-b8a7-6819fc67981e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:56.511552 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07713409-7098-43d4-b8a7-6819fc67981e None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:56.511761 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07713409-7098-43d4-b8a7-6819fc67981e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:56.512016 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07713409-7098-43d4-b8a7-6819fc67981e None admin] PATH_INFO: `/v3/projects/45a8fcf9582d42ccaffc8d521078eab0` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:56.513141 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07713409-7098-43d4-b8a7-6819fc67981e None admin] RBAC: Authorizing `identity:get_project(project_id=45a8fcf9582d42ccaffc8d521078eab0)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:56.516995 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07713409-7098-43d4-b8a7-6819fc67981e None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:56.516995 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 116/226] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 01:16:56 2022] GET /identity/v3/projects/45a8fcf9582d42ccaffc8d521078eab0 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:16:56.517546 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf81332-7b2b-409e-9c4d-eff91e8b7760 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:16:56.518461 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07713409-7098-43d4-b8a7-6819fc67981e None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:56.522672 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-baf81332-7b2b-409e-9c4d-eff91e8b7760 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 01:16:56.522672 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:16:56.522672 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:16:56.522672 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:16:56.522672 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:16:56.522672 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:16:56.522672 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:16:56.522672 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:16:56.522672 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:16:56.522672 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:16:56.522672 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:16:56.522672 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:16:56.522672 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:16:56.522672 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:16:56.522672 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:16:56.522672 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:16:56.523544 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:16:56.523544 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:16:56.523544 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:16:56.523544 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:16:56.523544 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:16:56.523544 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:16:56.523544 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:16:56.523544 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:16:56.523544 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:16:56.523544 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:16:56.523544 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:16:56.523544 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:16:56.523544 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:16:56.523544 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:16:56.523544 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:16:56.523544 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:16:56.525031 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:16:56.525031 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:16:56.525031 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:16:56.525031 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:16:56.525031 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:16:56.525031 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:16:56.525031 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:16:56.525031 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:16:56.525031 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:16:56.525031 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:16:56.525031 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 01:16:56.525031 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:16:56.525031 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 111/227] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Aug 12 01:16:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:16:56.525031 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf81332-7b2b-409e-9c4d-eff91e8b7760 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:56.615166 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:56.648382 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07713409-7098-43d4-b8a7-6819fc67981e None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:56.666575 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf81332-7b2b-409e-9c4d-eff91e8b7760 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:56.684707 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ea929c-77bf-40f0-9181-7995b1842042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:56.685372 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea929c-77bf-40f0-9181-7995b1842042 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:56.685646 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea929c-77bf-40f0-9181-7995b1842042 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:56.685916 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea929c-77bf-40f0-9181-7995b1842042 None admin] PATH_INFO: `/v3/projects/45a8fcf9582d42ccaffc8d521078eab0` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:56.687080 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ea929c-77bf-40f0-9181-7995b1842042 None admin] RBAC: Authorizing `identity:get_project(project_id=45a8fcf9582d42ccaffc8d521078eab0)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:56.688570 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ea929c-77bf-40f0-9181-7995b1842042 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:56.690336 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 117/228] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 01:16:56 2022] GET /identity/v3/projects/45a8fcf9582d42ccaffc8d521078eab0 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:16:56.690930 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ea929c-77bf-40f0-9181-7995b1842042 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:56.716479 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde1a027-c4e1-4686-8d27-e307d749ef5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:56.717983 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde1a027-c4e1-4686-8d27-e307d749ef5f None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:56.718550 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde1a027-c4e1-4686-8d27-e307d749ef5f None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:56.718828 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde1a027-c4e1-4686-8d27-e307d749ef5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:56.719627 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde1a027-c4e1-4686-8d27-e307d749ef5f None admin] RBAC: Adding query filter params (role.id=13af81971c1c428eae0a571a22ea583d, scope.project.id=45a8fcf9582d42ccaffc8d521078eab0, user.id=1d3dbca38dba42dc90cf8983aaddd5be) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:16:56.719939 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde1a027-c4e1-4686-8d27-e307d749ef5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:56.721463 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde1a027-c4e1-4686-8d27-e307d749ef5f None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:56.729429 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 112/229] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 01:16:56 2022] GET /identity/v3/role_assignments?user.id=1d3dbca38dba42dc90cf8983aaddd5be&scope.project.id=45a8fcf9582d42ccaffc8d521078eab0&role.id=13af81971c1c428eae0a571a22ea583d => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:16:56.738669 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde1a027-c4e1-4686-8d27-e307d749ef5f None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:56.816852 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ea929c-77bf-40f0-9181-7995b1842042 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:56.863877 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd7b18-e866-485e-bf0b-a762e1339b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:56.864906 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd7b18-e866-485e-bf0b-a762e1339b34 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:56.865434 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd7b18-e866-485e-bf0b-a762e1339b34 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:56.865918 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd7b18-e866-485e-bf0b-a762e1339b34 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:56.866826 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dd7b18-e866-485e-bf0b-a762e1339b34 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:16:56.867322 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dd7b18-e866-485e-bf0b-a762e1339b34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:56.869174 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dd7b18-e866-485e-bf0b-a762e1339b34 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:56.878591 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 118/230] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 01:16:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:16:56.884848 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd7b18-e866-485e-bf0b-a762e1339b34 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:56.898455 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:56.906289 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:56.987410 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde1a027-c4e1-4686-8d27-e307d749ef5f None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:57.020265 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd7b18-e866-485e-bf0b-a762e1339b34 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:57.062453 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646fb525-bde1-4045-be41-d42ea67887da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:57.063419 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581f9fa9-981a-45de-aa8c-495d3fbfdb0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:57.064635 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646fb525-bde1-4045-be41-d42ea67887da None admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:57.065455 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f9fa9-981a-45de-aa8c-495d3fbfdb0c None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:57.065924 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646fb525-bde1-4045-be41-d42ea67887da None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:57.066437 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f9fa9-981a-45de-aa8c-495d3fbfdb0c None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:57.066920 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646fb525-bde1-4045-be41-d42ea67887da None admin] PATH_INFO: `/v3/projects/45a8fcf9582d42ccaffc8d521078eab0/users/36485c2294d549aa80ad8856a97be348/roles/fb48693810be495fb4b1893a79429b78` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:57.067375 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f9fa9-981a-45de-aa8c-495d3fbfdb0c None admin] PATH_INFO: `/v3/users/36485c2294d549aa80ad8856a97be348` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:57.069918 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581f9fa9-981a-45de-aa8c-495d3fbfdb0c None admin] RBAC: Authorizing `identity:get_user(user_id=36485c2294d549aa80ad8856a97be348)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:57.070969 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646fb525-bde1-4045-be41-d42ea67887da None admin] RBAC: Authorizing `identity:create_grant(project_id=45a8fcf9582d42ccaffc8d521078eab0, user_id=36485c2294d549aa80ad8856a97be348, role_id=fb48693810be495fb4b1893a79429b78)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:57.074033 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646fb525-bde1-4045-be41-d42ea67887da None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:57.074410 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581f9fa9-981a-45de-aa8c-495d3fbfdb0c None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:57.076234 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 119/231] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 01:16:56 2022] GET /identity/v3/users/36485c2294d549aa80ad8856a97be348 => generated 283 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:16:57.081719 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581f9fa9-981a-45de-aa8c-495d3fbfdb0c None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:57.098678 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 113/232] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Aug 12 01:16:56 2022] PUT /identity/v3/projects/45a8fcf9582d42ccaffc8d521078eab0/users/36485c2294d549aa80ad8856a97be348/roles/fb48693810be495fb4b1893a79429b78 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:16:57.180447 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:57.204693 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581f9fa9-981a-45de-aa8c-495d3fbfdb0c None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:57.240917 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e212e5-7501-4028-9d8a-d6374f64fd17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:57.241924 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e212e5-7501-4028-9d8a-d6374f64fd17 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:57.242589 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e212e5-7501-4028-9d8a-d6374f64fd17 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:57.243085 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e212e5-7501-4028-9d8a-d6374f64fd17 None admin] PATH_INFO: `/v3/projects/45a8fcf9582d42ccaffc8d521078eab0` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:57.244441 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e212e5-7501-4028-9d8a-d6374f64fd17 None admin] RBAC: Authorizing `identity:get_project(project_id=45a8fcf9582d42ccaffc8d521078eab0)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:57.246146 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e212e5-7501-4028-9d8a-d6374f64fd17 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:57.248322 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 120/233] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 01:16:57 2022] GET /identity/v3/projects/45a8fcf9582d42ccaffc8d521078eab0 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:16:57.255260 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646fb525-bde1-4045-be41-d42ea67887da None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:57.382175 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646fb525-bde1-4045-be41-d42ea67887da None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:57.395331 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:57.420128 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e318ce0c-73b5-4e9f-b2f5-99e031d63944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:57.420860 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e318ce0c-73b5-4e9f-b2f5-99e031d63944 None admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:57.421140 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e318ce0c-73b5-4e9f-b2f5-99e031d63944 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:57.421413 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e318ce0c-73b5-4e9f-b2f5-99e031d63944 None admin] PATH_INFO: `/v3/projects/45a8fcf9582d42ccaffc8d521078eab0/users/36485c2294d549aa80ad8856a97be348/roles/bab2af60c26640acbd0c4db2f9796cfb` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:57.423652 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e318ce0c-73b5-4e9f-b2f5-99e031d63944 None admin] RBAC: Authorizing `identity:create_grant(project_id=45a8fcf9582d42ccaffc8d521078eab0, user_id=36485c2294d549aa80ad8856a97be348, role_id=bab2af60c26640acbd0c4db2f9796cfb)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:57.425103 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e318ce0c-73b5-4e9f-b2f5-99e031d63944 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:57.442307 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 114/234] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Aug 12 01:16:57 2022] PUT /identity/v3/projects/45a8fcf9582d42ccaffc8d521078eab0/users/36485c2294d549aa80ad8856a97be348/roles/bab2af60c26640acbd0c4db2f9796cfb => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:16:58.422744 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d735433-396e-4eed-bacf-c314fb0ae60e None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:58.423293 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d735433-396e-4eed-bacf-c314fb0ae60e None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:58.423293 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d735433-396e-4eed-bacf-c314fb0ae60e None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:58.424843 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 121/235] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:16:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:16:58.430367 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a4ce93-31e4-4b3d-90f4-757e05ec4933 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:58.430881 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a4ce93-31e4-4b3d-90f4-757e05ec4933 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:58.430881 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a4ce93-31e4-4b3d-90f4-757e05ec4933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:58.459108 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-e6a4ce93-31e4-4b3d-90f4-757e05ec4933 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:16:58.460323 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-e6a4ce93-31e4-4b3d-90f4-757e05ec4933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:16:58.570153 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 115/236] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:16:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 01:16:58.743389 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe5faa-af89-4ac7-928d-683ee7250da4 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:58.743797 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe5faa-af89-4ac7-928d-683ee7250da4 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:58.743976 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe5faa-af89-4ac7-928d-683ee7250da4 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:58.745564 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 122/237] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:16:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:16:58.750586 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ca4cf-b180-4e5e-a120-c9ae0900b01b None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:58.750871 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ca4cf-b180-4e5e-a120-c9ae0900b01b None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:58.751144 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ca4cf-b180-4e5e-a120-c9ae0900b01b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:58.775036 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-bc9ca4cf-b180-4e5e-a120-c9ae0900b01b None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:16:58.776211 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-bc9ca4cf-b180-4e5e-a120-c9ae0900b01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:16:58.865124 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 116/238] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:16:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 01:16:58.962209 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe5faa-af89-4ac7-928d-683ee7250da4 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:59.048126 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fcd28f-bd54-4492-85e8-be9d20c379ac None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:59.048414 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fcd28f-bd54-4492-85e8-be9d20c379ac None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:59.048572 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fcd28f-bd54-4492-85e8-be9d20c379ac None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:59.050315 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 117/239] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:16:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 01:16:59.055400 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3f60aa-e73f-4134-b7dd-715bd4a8e025 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:59.055663 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3f60aa-e73f-4134-b7dd-715bd4a8e025 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:59.055939 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3f60aa-e73f-4134-b7dd-715bd4a8e025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:59.074049 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-fc3f60aa-e73f-4134-b7dd-715bd4a8e025 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:16:59.075239 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-fc3f60aa-e73f-4134-b7dd-715bd4a8e025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:16:59.105381 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:59.114659 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe5faa-af89-4ac7-928d-683ee7250da4 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:59.181925 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d9ff52-73d6-4b0b-87c8-77466a6b1a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:59.183257 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 118/240] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:16:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 01:16:59.183368 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d9ff52-73d6-4b0b-87c8-77466a6b1a00 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:59.183627 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d9ff52-73d6-4b0b-87c8-77466a6b1a00 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:59.183897 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d9ff52-73d6-4b0b-87c8-77466a6b1a00 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:59.202900 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d9ff52-73d6-4b0b-87c8-77466a6b1a00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:16:59.207238 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3f60aa-e73f-4134-b7dd-715bd4a8e025 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:59.209300 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-36d9ff52-73d6-4b0b-87c8-77466a6b1a00 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 01:16:59.209300 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:16:59.209300 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:16:59.209300 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:16:59.209300 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:16:59.209300 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:16:59.209300 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:16:59.209300 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:16:59.209300 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:16:59.209300 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:16:59.209300 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:16:59.209300 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:16:59.209300 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:16:59.209300 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:16:59.209300 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:16:59.209300 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:16:59.210189 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:16:59.210189 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:16:59.210189 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:16:59.210189 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:16:59.210189 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:16:59.210189 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:16:59.210189 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:16:59.210189 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:16:59.210189 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:16:59.210189 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:16:59.210189 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:16:59.210189 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:16:59.210189 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:16:59.210189 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:16:59.210189 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:16:59.210189 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:16:59.210972 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:16:59.210972 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:16:59.210972 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:16:59.210972 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:16:59.210972 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:16:59.210972 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:16:59.210972 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:16:59.210972 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:16:59.210972 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:16:59.210972 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:16:59.210972 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 01:16:59.210972 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:16:59.210972 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 123/241] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 01:16:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:16:59.214574 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d9ff52-73d6-4b0b-87c8-77466a6b1a00 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:59.218974 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:59.321587 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3f60aa-e73f-4134-b7dd-715bd4a8e025 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:59.376713 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d9ff52-73d6-4b0b-87c8-77466a6b1a00 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:59.387382 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dc9ee1-7a6f-4513-a2cc-dc01c02e3736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:59.388039 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc9ee1-7a6f-4513-a2cc-dc01c02e3736 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:59.388315 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc9ee1-7a6f-4513-a2cc-dc01c02e3736 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:59.388585 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc9ee1-7a6f-4513-a2cc-dc01c02e3736 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:59.394827 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dc9ee1-7a6f-4513-a2cc-dc01c02e3736 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:59.396285 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dc9ee1-7a6f-4513-a2cc-dc01c02e3736 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:59.398206 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 119/242] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:16:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:16:59.405468 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dc9ee1-7a6f-4513-a2cc-dc01c02e3736 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:59.419898 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aa7975-fd26-43cf-855f-c4054db34fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:59.420850 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aa7975-fd26-43cf-855f-c4054db34fcf None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:59.421323 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aa7975-fd26-43cf-855f-c4054db34fcf None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:59.421807 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aa7975-fd26-43cf-855f-c4054db34fcf None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:59.422693 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aa7975-fd26-43cf-855f-c4054db34fcf None admin] RBAC: Adding query filter params (name=reader) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:16:59.423187 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aa7975-fd26-43cf-855f-c4054db34fcf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:59.425370 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aa7975-fd26-43cf-855f-c4054db34fcf None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:59.434798 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 124/243] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Aug 12 01:16:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:16:59.442759 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aa7975-fd26-43cf-855f-c4054db34fcf None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:59.499849 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:59.518546 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:59.557146 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aa7975-fd26-43cf-855f-c4054db34fcf None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:59.592069 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ccb123-b462-4fd1-bd7c-9005ea0b107e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:59.592621 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ccb123-b462-4fd1-bd7c-9005ea0b107e None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:59.592900 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ccb123-b462-4fd1-bd7c-9005ea0b107e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:59.593172 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ccb123-b462-4fd1-bd7c-9005ea0b107e None admin] PATH_INFO: `/v3/users/ce2d903cb3e34957948611665afaa60f` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:59.601711 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dc9ee1-7a6f-4513-a2cc-dc01c02e3736 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:59.607921 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ccb123-b462-4fd1-bd7c-9005ea0b107e None admin] RBAC: Authorizing `identity:get_user(user_id=ce2d903cb3e34957948611665afaa60f)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:59.609376 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ccb123-b462-4fd1-bd7c-9005ea0b107e None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:59.611090 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 125/244] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 01:16:59 2022] GET /identity/v3/users/ce2d903cb3e34957948611665afaa60f => generated 297 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:16:59.612256 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bd426-29cc-4260-bd12-3108c9b551bf None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:59.612530 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bd426-29cc-4260-bd12-3108c9b551bf None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:59.612800 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bd426-29cc-4260-bd12-3108c9b551bf None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:59.614147 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 126/245] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:16:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:16:59.618755 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393bd426-29cc-4260-bd12-3108c9b551bf None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:59.641497 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eef453-66ca-4585-a3c8-b0004a6a0e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:59.642109 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eef453-66ca-4585-a3c8-b0004a6a0e67 None admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:59.642407 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eef453-66ca-4585-a3c8-b0004a6a0e67 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:59.642678 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eef453-66ca-4585-a3c8-b0004a6a0e67 None admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:59.643317 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eef453-66ca-4585-a3c8-b0004a6a0e67 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:59.644755 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eef453-66ca-4585-a3c8-b0004a6a0e67 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:16:59.674341 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 120/246] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Aug 12 01:16:59 2022] POST /identity/v3/users => generated 293 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 01:16:59.675741 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eef453-66ca-4585-a3c8-b0004a6a0e67 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:59.737669 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393bd426-29cc-4260-bd12-3108c9b551bf None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:59.765515 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:59.779023 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3e1c87-dce5-4b47-a908-6d622d30fb7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:59.779774 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e1c87-dce5-4b47-a908-6d622d30fb7a None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:59.780138 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e1c87-dce5-4b47-a908-6d622d30fb7a None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:59.780504 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e1c87-dce5-4b47-a908-6d622d30fb7a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:59.793581 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3e1c87-dce5-4b47-a908-6d622d30fb7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:16:59.799033 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-6a3e1c87-dce5-4b47-a908-6d622d30fb7a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 01:16:59.799033 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:16:59.799033 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:16:59.799033 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:16:59.799033 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:16:59.799033 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:16:59.799033 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:16:59.799033 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:16:59.799033 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:16:59.799033 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:16:59.799033 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:16:59.799033 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:16:59.799033 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:16:59.799033 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:16:59.799033 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:16:59.799033 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:16:59.799955 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:16:59.799955 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:16:59.799955 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:16:59.799955 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:16:59.799955 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:16:59.799955 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:16:59.799955 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:16:59.799955 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:16:59.799955 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:16:59.799955 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:16:59.799955 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:16:59.799955 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:16:59.799955 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:16:59.799955 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:16:59.799955 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:16:59.799955 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:16:59.800822 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:16:59.800822 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:16:59.800822 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:16:59.800822 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:16:59.800822 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:16:59.800822 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:16:59.800822 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:16:59.800822 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:16:59.800822 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:16:59.800822 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:16:59.800822 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 01:16:59.800822 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:16:59.805935 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 127/247] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 01:16:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:16:59.807468 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c66ad9-970e-468c-b322-3553d3d19fe2 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:59.807825 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c66ad9-970e-468c-b322-3553d3d19fe2 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:59.808095 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c66ad9-970e-468c-b322-3553d3d19fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:59.808630 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:16:59.827678 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eef453-66ca-4585-a3c8-b0004a6a0e67 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:16:59.829845 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-86c66ad9-970e-468c-b322-3553d3d19fe2 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:16:59.831110 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-86c66ad9-970e-468c-b322-3553d3d19fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:16:59.877198 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9892b76c-0741-4354-ac4e-71217b535357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:16:59.877779 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9892b76c-0741-4354-ac4e-71217b535357 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:16:59.878054 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9892b76c-0741-4354-ac4e-71217b535357 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:16:59.878371 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9892b76c-0741-4354-ac4e-71217b535357 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:16:59.922162 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 128/248] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:16:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 01:16:59.922761 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c66ad9-970e-468c-b322-3553d3d19fe2 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:16:59.974149 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9892b76c-0741-4354-ac4e-71217b535357 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:16:59.975643 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9892b76c-0741-4354-ac4e-71217b535357 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:00.045711 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c66ad9-970e-468c-b322-3553d3d19fe2 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:00.063578 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:00.092597 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 121/249] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 01:16:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 01:17:00.092848 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:00.097839 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb7b42-8ece-41ca-b837-9246c5646b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:00.098421 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb7b42-8ece-41ca-b837-9246c5646b52 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:00.098708 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb7b42-8ece-41ca-b837-9246c5646b52 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:00.099096 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb7b42-8ece-41ca-b837-9246c5646b52 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:00.099859 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbb7b42-8ece-41ca-b837-9246c5646b52 None admin] RBAC: Adding query filter params (name=member) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:00.100157 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbb7b42-8ece-41ca-b837-9246c5646b52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:00.102037 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbb7b42-8ece-41ca-b837-9246c5646b52 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:00.102433 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e466842e-3722-4ee1-9831-83d2e88321e8 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:00.102824 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e466842e-3722-4ee1-9831-83d2e88321e8 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:00.103123 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e466842e-3722-4ee1-9831-83d2e88321e8 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:00.105560 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 122/250] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:17:00 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:17:00.106142 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e466842e-3722-4ee1-9831-83d2e88321e8 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:00.111437 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 129/251] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Aug 12 01:16:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:00.112651 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d710b36-3080-4e9f-90f6-cf016f31f74b None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:00.112927 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d710b36-3080-4e9f-90f6-cf016f31f74b None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:00.113193 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d710b36-3080-4e9f-90f6-cf016f31f74b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:00.140967 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-2d710b36-3080-4e9f-90f6-cf016f31f74b None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:17:00.142066 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2d710b36-3080-4e9f-90f6-cf016f31f74b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:17:00.249790 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 130/252] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:17:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 01:17:00.251144 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d710b36-3080-4e9f-90f6-cf016f31f74b None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:00.270293 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e466842e-3722-4ee1-9831-83d2e88321e8 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:00.300691 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984bbbe0-f98c-4611-91d6-8caf6ff46464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:00.301447 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984bbbe0-f98c-4611-91d6-8caf6ff46464 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:00.301895 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984bbbe0-f98c-4611-91d6-8caf6ff46464 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:00.302373 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984bbbe0-f98c-4611-91d6-8caf6ff46464 None admin] PATH_INFO: `/v3/projects/45a8fcf9582d42ccaffc8d521078eab0` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:00.304178 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984bbbe0-f98c-4611-91d6-8caf6ff46464 None admin] RBAC: Authorizing `identity:get_project(project_id=45a8fcf9582d42ccaffc8d521078eab0)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:00.306019 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984bbbe0-f98c-4611-91d6-8caf6ff46464 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:00.310399 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 123/253] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 01:17:00 2022] GET /identity/v3/projects/45a8fcf9582d42ccaffc8d521078eab0 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:00.310949 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984bbbe0-f98c-4611-91d6-8caf6ff46464 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:00.432376 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d710b36-3080-4e9f-90f6-cf016f31f74b None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:00.450649 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:00.455201 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:00.514140 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd7efb-6fd8-461c-8245-d19b6210fa4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:00.514140 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd7efb-6fd8-461c-8245-d19b6210fa4f None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:00.514140 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd7efb-6fd8-461c-8245-d19b6210fa4f None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:00.514140 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd7efb-6fd8-461c-8245-d19b6210fa4f None admin] PATH_INFO: `/v3/users/1d3dbca38dba42dc90cf8983aaddd5be` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:00.518139 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fd7efb-6fd8-461c-8245-d19b6210fa4f None admin] RBAC: Authorizing `identity:get_user(user_id=1d3dbca38dba42dc90cf8983aaddd5be)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:00.521348 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fd7efb-6fd8-461c-8245-d19b6210fa4f None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:00.521348 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 131/254] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 01:17:00 2022] GET /identity/v3/users/1d3dbca38dba42dc90cf8983aaddd5be => generated 297 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:00.525506 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd7efb-6fd8-461c-8245-d19b6210fa4f None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:00.573054 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984bbbe0-f98c-4611-91d6-8caf6ff46464 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:00.635973 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f707ae8c-37d0-4cf1-be38-d3040b71fe3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:00.636617 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707ae8c-37d0-4cf1-be38-d3040b71fe3e None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:00.636891 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707ae8c-37d0-4cf1-be38-d3040b71fe3e None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:00.637157 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707ae8c-37d0-4cf1-be38-d3040b71fe3e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:00.649157 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f707ae8c-37d0-4cf1-be38-d3040b71fe3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:17:00.654972 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-f707ae8c-37d0-4cf1-be38-d3040b71fe3e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 01:17:00.654972 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:00.654972 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:00.654972 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:00.654972 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:00.654972 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:00.654972 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:00.654972 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:00.654972 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:00.654972 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:00.654972 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:00.654972 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:00.654972 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:17:00.654972 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:17:00.654972 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:17:00.654972 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:17:00.655832 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:17:00.655832 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:17:00.655832 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:17:00.655832 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:17:00.655832 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:00.655832 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:00.655832 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:00.655832 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:00.655832 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:00.655832 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:00.655832 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:00.655832 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:00.655832 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:00.655832 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:00.655832 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:00.655832 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:00.657062 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:00.657062 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:00.657062 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:00.657062 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:00.657062 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:17:00.657062 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:17:00.657062 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:17:00.657062 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:17:00.657062 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:17:00.657062 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:17:00.657062 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 01:17:00.657062 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:17:00.657062 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 124/255] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Aug 12 01:17:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:00.657903 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f707ae8c-37d0-4cf1-be38-d3040b71fe3e None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:00.688962 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd7efb-6fd8-461c-8245-d19b6210fa4f None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:00.723895 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e580f2-2601-429e-8f25-92ab70d04af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:00.724543 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e580f2-2601-429e-8f25-92ab70d04af8 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:00.724881 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e580f2-2601-429e-8f25-92ab70d04af8 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:00.725155 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e580f2-2601-429e-8f25-92ab70d04af8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:00.725889 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e580f2-2601-429e-8f25-92ab70d04af8 None admin] RBAC: Adding query filter params (role.id=d3ac26b4075941a7a84580ef43d093f6, scope.project.id=45a8fcf9582d42ccaffc8d521078eab0, user.id=ce2d903cb3e34957948611665afaa60f) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:00.726219 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e580f2-2601-429e-8f25-92ab70d04af8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:00.728053 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e580f2-2601-429e-8f25-92ab70d04af8 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:00.733783 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 132/256] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 01:17:00 2022] GET /identity/v3/role_assignments?user.id=ce2d903cb3e34957948611665afaa60f&scope.project.id=45a8fcf9582d42ccaffc8d521078eab0&role.id=d3ac26b4075941a7a84580ef43d093f6 => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:00.734601 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e580f2-2601-429e-8f25-92ab70d04af8 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:00.777273 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:00.868869 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e580f2-2601-429e-8f25-92ab70d04af8 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:00.914975 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a4d552-c3d7-4ecc-8c44-5c98cbb1f76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:00.915636 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a4d552-c3d7-4ecc-8c44-5c98cbb1f76d None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:00.915913 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a4d552-c3d7-4ecc-8c44-5c98cbb1f76d None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:00.916190 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a4d552-c3d7-4ecc-8c44-5c98cbb1f76d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:00.942305 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a4d552-c3d7-4ecc-8c44-5c98cbb1f76d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:17:00.949657 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-65a4d552-c3d7-4ecc-8c44-5c98cbb1f76d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 01:17:00.949657 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:00.949657 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:00.949657 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:00.949657 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:00.949657 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:00.949657 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:00.949657 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:00.949657 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:00.949657 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:00.949657 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:00.949657 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:00.949657 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:17:00.949657 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:17:00.949657 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:17:00.949657 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:17:00.950608 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:17:00.950608 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:17:00.950608 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:17:00.950608 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:17:00.950608 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:00.950608 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:00.950608 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:00.950608 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:00.950608 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:00.950608 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:00.950608 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:00.950608 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:00.950608 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:00.950608 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:00.950608 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:00.950608 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:00.951376 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:00.951376 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:00.951376 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:00.951376 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:00.951376 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:17:00.951376 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:17:00.951376 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:17:00.951376 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:17:00.951376 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:17:00.951376 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:17:00.951376 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 01:17:00.951376 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:17:00.951376 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 133/257] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Aug 12 01:17:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:00.952026 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a4d552-c3d7-4ecc-8c44-5c98cbb1f76d None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:00.987006 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f707ae8c-37d0-4cf1-be38-d3040b71fe3e None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:01.017407 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:01.083452 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32144a75-e4d1-4a44-968c-67520a9e19bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:01.084473 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32144a75-e4d1-4a44-968c-67520a9e19bf None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:01.084473 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32144a75-e4d1-4a44-968c-67520a9e19bf None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:01.085059 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32144a75-e4d1-4a44-968c-67520a9e19bf None admin] PATH_INFO: `/v3/projects/45a8fcf9582d42ccaffc8d521078eab0` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:01.090887 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32144a75-e4d1-4a44-968c-67520a9e19bf None admin] RBAC: Authorizing `identity:get_project(project_id=45a8fcf9582d42ccaffc8d521078eab0)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:01.092360 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32144a75-e4d1-4a44-968c-67520a9e19bf None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:01.094401 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 125/258] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 01:17:00 2022] GET /identity/v3/projects/45a8fcf9582d42ccaffc8d521078eab0 => generated 302 bytes in 437 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:01.095186 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32144a75-e4d1-4a44-968c-67520a9e19bf None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:01.098092 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a4d552-c3d7-4ecc-8c44-5c98cbb1f76d None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:01.100185 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:01.151422 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e285d2b2-d26d-406a-b75e-0378cb81448c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:01.152393 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285d2b2-d26d-406a-b75e-0378cb81448c None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:01.152854 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285d2b2-d26d-406a-b75e-0378cb81448c None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:01.153304 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285d2b2-d26d-406a-b75e-0378cb81448c None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:01.154254 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e285d2b2-d26d-406a-b75e-0378cb81448c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:01.154780 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e285d2b2-d26d-406a-b75e-0378cb81448c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:01.157059 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e285d2b2-d26d-406a-b75e-0378cb81448c None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:01.166902 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 134/259] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 01:17:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:01.167993 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e285d2b2-d26d-406a-b75e-0378cb81448c None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:01.260426 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32144a75-e4d1-4a44-968c-67520a9e19bf None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:01.322484 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e285d2b2-d26d-406a-b75e-0378cb81448c None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:01.338463 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676cf7d3-c0f6-4a64-b606-93f25b09a030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:01.339104 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676cf7d3-c0f6-4a64-b606-93f25b09a030 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:01.339381 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676cf7d3-c0f6-4a64-b606-93f25b09a030 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:01.339649 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676cf7d3-c0f6-4a64-b606-93f25b09a030 None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:01.340317 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676cf7d3-c0f6-4a64-b606-93f25b09a030 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:01.340614 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676cf7d3-c0f6-4a64-b606-93f25b09a030 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:01.341985 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676cf7d3-c0f6-4a64-b606-93f25b09a030 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:01.350368 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 126/260] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 01:17:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:01.351191 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676cf7d3-c0f6-4a64-b606-93f25b09a030 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:01.360689 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d428e7-50d3-4145-b6d6-c768da554f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:01.361715 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d428e7-50d3-4145-b6d6-c768da554f2f None admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:01.362396 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d428e7-50d3-4145-b6d6-c768da554f2f None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:01.362882 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d428e7-50d3-4145-b6d6-c768da554f2f None admin] PATH_INFO: `/v3/projects/45a8fcf9582d42ccaffc8d521078eab0/users/1d3dbca38dba42dc90cf8983aaddd5be/roles/13af81971c1c428eae0a571a22ea583d` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:01.365756 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d428e7-50d3-4145-b6d6-c768da554f2f None admin] RBAC: Authorizing `identity:create_grant(project_id=45a8fcf9582d42ccaffc8d521078eab0, user_id=1d3dbca38dba42dc90cf8983aaddd5be, role_id=13af81971c1c428eae0a571a22ea583d)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:01.368102 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d428e7-50d3-4145-b6d6-c768da554f2f None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:01.391028 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 135/261] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Aug 12 01:17:01 2022] PUT /identity/v3/projects/45a8fcf9582d42ccaffc8d521078eab0/users/1d3dbca38dba42dc90cf8983aaddd5be/roles/13af81971c1c428eae0a571a22ea583d => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:17:01.393228 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d428e7-50d3-4145-b6d6-c768da554f2f None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:01.439981 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:01.457261 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:01.544682 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676cf7d3-c0f6-4a64-b606-93f25b09a030 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:01.603302 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d428e7-50d3-4145-b6d6-c768da554f2f None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:01.619408 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f24b2a9-3dd9-47b5-87bf-4cbf55370183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:01.620726 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24b2a9-3dd9-47b5-87bf-4cbf55370183 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:01.621255 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24b2a9-3dd9-47b5-87bf-4cbf55370183 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:01.621722 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24b2a9-3dd9-47b5-87bf-4cbf55370183 None admin] PATH_INFO: `/v3/users/36485c2294d549aa80ad8856a97be348` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:01.623188 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f24b2a9-3dd9-47b5-87bf-4cbf55370183 None admin] RBAC: Authorizing `identity:get_user(user_id=36485c2294d549aa80ad8856a97be348)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:01.626219 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f24b2a9-3dd9-47b5-87bf-4cbf55370183 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:01.628268 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 127/262] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 01:17:01 2022] GET /identity/v3/users/36485c2294d549aa80ad8856a97be348 => generated 283 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:01.635129 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f24b2a9-3dd9-47b5-87bf-4cbf55370183 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:01.687948 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334e8893-84c9-444a-b9b6-851a714d8c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:01.688598 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e8893-84c9-444a-b9b6-851a714d8c53 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:01.688875 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e8893-84c9-444a-b9b6-851a714d8c53 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:01.689143 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e8893-84c9-444a-b9b6-851a714d8c53 None admin] PATH_INFO: `/v3/users/36485c2294d549aa80ad8856a97be348` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:01.695456 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334e8893-84c9-444a-b9b6-851a714d8c53 None admin] RBAC: Authorizing `identity:get_user(user_id=36485c2294d549aa80ad8856a97be348)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:01.696860 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334e8893-84c9-444a-b9b6-851a714d8c53 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:01.698516 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 136/263] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 01:17:01 2022] GET /identity/v3/users/36485c2294d549aa80ad8856a97be348 => generated 283 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:01.704467 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334e8893-84c9-444a-b9b6-851a714d8c53 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:01.777956 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f24b2a9-3dd9-47b5-87bf-4cbf55370183 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:01.802103 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:01.848242 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81eb63c-f206-487c-9e91-15a03ebd9873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:01.849249 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81eb63c-f206-487c-9e91-15a03ebd9873 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:01.849725 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81eb63c-f206-487c-9e91-15a03ebd9873 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:01.850232 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81eb63c-f206-487c-9e91-15a03ebd9873 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:01.938404 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:01.944147 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81eb63c-f206-487c-9e91-15a03ebd9873 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:01.946011 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81eb63c-f206-487c-9e91-15a03ebd9873 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:01.976299 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334e8893-84c9-444a-b9b6-851a714d8c53 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:02.049080 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 128/264] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 01:17:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 01:17:02.055215 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81eb63c-f206-487c-9e91-15a03ebd9873 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:02.069150 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f680ca6-abcb-44c7-aa1a-3bfc08d0038d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:02.070137 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f680ca6-abcb-44c7-aa1a-3bfc08d0038d None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:02.070666 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f680ca6-abcb-44c7-aa1a-3bfc08d0038d None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:02.071144 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f680ca6-abcb-44c7-aa1a-3bfc08d0038d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:02.076826 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:02.202974 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f680ca6-abcb-44c7-aa1a-3bfc08d0038d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:02.205565 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f680ca6-abcb-44c7-aa1a-3bfc08d0038d None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:02.239039 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81eb63c-f206-487c-9e91-15a03ebd9873 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:02.291616 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ada3c-e126-4da4-bef3-80e0d90521de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:02.292620 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ada3c-e126-4da4-bef3-80e0d90521de None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:02.293094 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ada3c-e126-4da4-bef3-80e0d90521de None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:02.293887 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ada3c-e126-4da4-bef3-80e0d90521de None admin] PATH_INFO: `/v3/projects/45a8fcf9582d42ccaffc8d521078eab0` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:02.295250 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691ada3c-e126-4da4-bef3-80e0d90521de None admin] RBAC: Authorizing `identity:get_project(project_id=45a8fcf9582d42ccaffc8d521078eab0)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:02.296908 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691ada3c-e126-4da4-bef3-80e0d90521de None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:02.298786 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 129/265] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 01:17:02 2022] GET /identity/v3/projects/45a8fcf9582d42ccaffc8d521078eab0 => generated 302 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:17:02.300139 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a717ceb-055a-45f5-9bc8-0bb401b0f06f None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:02.300616 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a717ceb-055a-45f5-9bc8-0bb401b0f06f None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:02.301100 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a717ceb-055a-45f5-9bc8-0bb401b0f06f None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:02.302604 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 130/266] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:17:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:17:02.311190 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a717ceb-055a-45f5-9bc8-0bb401b0f06f None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:02.387686 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:02.410961 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 137/267] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 01:17:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 707 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 12 01:17:02.412238 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ff609e-e0b6-4439-93f5-f86b7aa33ddc None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:02.412515 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ff609e-e0b6-4439-93f5-f86b7aa33ddc None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:02.412779 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ff609e-e0b6-4439-93f5-f86b7aa33ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:02.440315 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-b6ff609e-e0b6-4439-93f5-f86b7aa33ddc None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:17:02.441489 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-b6ff609e-e0b6-4439-93f5-f86b7aa33ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:17:02.456825 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:02.494634 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a717ceb-055a-45f5-9bc8-0bb401b0f06f None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:02.512473 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 138/268] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:17:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 01:17:02.518158 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ff609e-e0b6-4439-93f5-f86b7aa33ddc None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:02.530679 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0becc9-a635-4654-9c28-9b140b26d21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:02.531257 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0becc9-a635-4654-9c28-9b140b26d21e None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:02.531587 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0becc9-a635-4654-9c28-9b140b26d21e None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:02.531860 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0becc9-a635-4654-9c28-9b140b26d21e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:02.532649 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0becc9-a635-4654-9c28-9b140b26d21e None admin] RBAC: Adding query filter params (role.id=fb48693810be495fb4b1893a79429b78, scope.project.id=45a8fcf9582d42ccaffc8d521078eab0, user.id=36485c2294d549aa80ad8856a97be348) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:02.532956 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0becc9-a635-4654-9c28-9b140b26d21e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:02.534544 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0becc9-a635-4654-9c28-9b140b26d21e None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:02.541773 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 131/269] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 01:17:02 2022] GET /identity/v3/role_assignments?user.id=36485c2294d549aa80ad8856a97be348&scope.project.id=45a8fcf9582d42ccaffc8d521078eab0&role.id=fb48693810be495fb4b1893a79429b78 => generated 608 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:02.546170 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e7616d-b36e-4a63-b356-4af2c7d6afa6 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:02.546170 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e7616d-b36e-4a63-b356-4af2c7d6afa6 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:02.546170 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e7616d-b36e-4a63-b356-4af2c7d6afa6 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:02.546170 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 132/270] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:17:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:17:02.550648 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cbe6da-6cc8-407e-b5d2-d4cf87103f9f None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:02.550995 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cbe6da-6cc8-407e-b5d2-d4cf87103f9f None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:02.551273 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cbe6da-6cc8-407e-b5d2-d4cf87103f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:02.585784 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-a7cbe6da-6cc8-407e-b5d2-d4cf87103f9f None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:17:02.588591 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-a7cbe6da-6cc8-407e-b5d2-d4cf87103f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:17:02.711915 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ff609e-e0b6-4439-93f5-f86b7aa33ddc None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:02.753954 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fe9dbd-75fa-47e5-8d5f-65f47c96510f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:02.754634 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe9dbd-75fa-47e5-8d5f-65f47c96510f None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:02.754913 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe9dbd-75fa-47e5-8d5f-65f47c96510f None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:02.755279 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe9dbd-75fa-47e5-8d5f-65f47c96510f None admin] PATH_INFO: `/v3/projects/45a8fcf9582d42ccaffc8d521078eab0` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:02.756425 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fe9dbd-75fa-47e5-8d5f-65f47c96510f None admin] RBAC: Authorizing `identity:get_project(project_id=45a8fcf9582d42ccaffc8d521078eab0)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:02.757943 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fe9dbd-75fa-47e5-8d5f-65f47c96510f None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:02.759777 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 133/272] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:17:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 01:17:02.760223 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 139/272] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 01:17:02 2022] GET /identity/v3/projects/45a8fcf9582d42ccaffc8d521078eab0 => generated 302 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:02.760223 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:02.765692 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cbe6da-6cc8-407e-b5d2-d4cf87103f9f None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:02.868045 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:02.900073 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cbe6da-6cc8-407e-b5d2-d4cf87103f9f None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:02.947851 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e29d15b-264d-45d5-a417-bb5bca4423a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:02.948489 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29d15b-264d-45d5-a417-bb5bca4423a0 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:02.948768 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29d15b-264d-45d5-a417-bb5bca4423a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:02.949039 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29d15b-264d-45d5-a417-bb5bca4423a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:02.949790 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e29d15b-264d-45d5-a417-bb5bca4423a0 None admin] RBAC: Adding query filter params (role.id=bab2af60c26640acbd0c4db2f9796cfb, scope.project.id=45a8fcf9582d42ccaffc8d521078eab0, user.id=36485c2294d549aa80ad8856a97be348) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:02.950100 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e29d15b-264d-45d5-a417-bb5bca4423a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:02.951802 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e29d15b-264d-45d5-a417-bb5bca4423a0 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:02.957379 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fe9dbd-75fa-47e5-8d5f-65f47c96510f None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:02.960262 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 134/273] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 01:17:02 2022] GET /identity/v3/role_assignments?user.id=36485c2294d549aa80ad8856a97be348&scope.project.id=45a8fcf9582d42ccaffc8d521078eab0&role.id=bab2af60c26640acbd0c4db2f9796cfb => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:03.090702 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fe9dbd-75fa-47e5-8d5f-65f47c96510f None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:03.120258 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e29d15b-264d-45d5-a417-bb5bca4423a0 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:03.129404 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326472df-54e1-4c7d-a5f8-18937661bba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:03.130340 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326472df-54e1-4c7d-a5f8-18937661bba2 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:03.130748 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326472df-54e1-4c7d-a5f8-18937661bba2 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:03.131149 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326472df-54e1-4c7d-a5f8-18937661bba2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:03.132429 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326472df-54e1-4c7d-a5f8-18937661bba2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:03.134259 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326472df-54e1-4c7d-a5f8-18937661bba2 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:03.136065 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 140/274] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:17:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:17:03.141657 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326472df-54e1-4c7d-a5f8-18937661bba2 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:03.203379 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:03.252657 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e29d15b-264d-45d5-a417-bb5bca4423a0 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:03.254261 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326472df-54e1-4c7d-a5f8-18937661bba2 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:03.295331 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c06e397-aeb4-491e-a243-270550305e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:03.295969 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c06e397-aeb4-491e-a243-270550305e9e None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:03.296323 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c06e397-aeb4-491e-a243-270550305e9e None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:03.296594 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c06e397-aeb4-491e-a243-270550305e9e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:03.296690 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b466b747-a050-4508-a446-ee86951b4a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:03.297447 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466b747-a050-4508-a446-ee86951b4a11 None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:03.297838 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466b747-a050-4508-a446-ee86951b4a11 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:03.298107 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466b747-a050-4508-a446-ee86951b4a11 None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:03.298794 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b466b747-a050-4508-a446-ee86951b4a11 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:03.300233 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b466b747-a050-4508-a446-ee86951b4a11 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:03.303692 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:03.309826 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c06e397-aeb4-491e-a243-270550305e9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:17:03.316503 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-2c06e397-aeb4-491e-a243-270550305e9e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 01:17:03.316503 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:03.316503 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:03.316503 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:03.316503 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:03.316503 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:03.316503 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:03.316503 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:03.316503 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:03.316503 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:03.316503 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:03.316503 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:03.316503 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:17:03.316503 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:17:03.316503 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:17:03.316503 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:17:03.317446 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:17:03.317446 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:17:03.317446 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:17:03.317446 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:17:03.317446 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:03.317446 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:03.317446 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:03.317446 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:03.317446 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:03.317446 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:03.317446 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:03.317446 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:03.317446 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:03.317446 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:03.317446 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:03.317446 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:03.318370 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:03.318370 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:03.318370 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:03.318370 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:03.318370 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:17:03.318370 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:17:03.318370 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:17:03.318370 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:17:03.318370 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:17:03.318370 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:17:03.318370 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 01:17:03.318370 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:17:03.318370 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 135/275] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 01:17:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 01:17:03.319040 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74898f7e-96f1-4289-8af6-91c10dcc0066 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:03.319107 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74898f7e-96f1-4289-8af6-91c10dcc0066 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:03.319340 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74898f7e-96f1-4289-8af6-91c10dcc0066 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:03.320826 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 136/276] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:17:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:17:03.325683 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74898f7e-96f1-4289-8af6-91c10dcc0066 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:03.333755 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 141/277] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Aug 12 01:17:03 2022] POST /identity/v3/users => generated 293 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 01:17:03.334874 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d2d6d-6886-4b8d-8e26-bc61e069fe06 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:03.335159 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d2d6d-6886-4b8d-8e26-bc61e069fe06 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:03.335429 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d2d6d-6886-4b8d-8e26-bc61e069fe06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:03.358801 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-718d2d6d-6886-4b8d-8e26-bc61e069fe06 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:17:03.360044 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-718d2d6d-6886-4b8d-8e26-bc61e069fe06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:17:03.462373 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 142/278] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:17:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 01:17:03.472636 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74898f7e-96f1-4289-8af6-91c10dcc0066 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:03.510733 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c24e948-5fe7-42b2-aee6-8ad343a50caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:03.511356 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c24e948-5fe7-42b2-aee6-8ad343a50caf None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:03.511634 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c24e948-5fe7-42b2-aee6-8ad343a50caf None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:03.511906 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c24e948-5fe7-42b2-aee6-8ad343a50caf None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:03.512579 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c24e948-5fe7-42b2-aee6-8ad343a50caf None admin] RBAC: Adding query filter params (name=member) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:03.512878 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c24e948-5fe7-42b2-aee6-8ad343a50caf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:03.514304 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c24e948-5fe7-42b2-aee6-8ad343a50caf None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:03.525194 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 137/279] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Aug 12 01:17:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:17:03.530896 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d2d6d-6886-4b8d-8e26-bc61e069fe06 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:03.575954 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:03.638142 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d2d6d-6886-4b8d-8e26-bc61e069fe06 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:03.676286 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532e42f5-01a7-434f-ad47-f23b9ada3aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:03.676926 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e42f5-01a7-434f-ad47-f23b9ada3aac None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:03.677202 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e42f5-01a7-434f-ad47-f23b9ada3aac None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:03.677470 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e42f5-01a7-434f-ad47-f23b9ada3aac None admin] PATH_INFO: `/v3/users/9ae38e0d0307468f8c5a1cb91a4b71bc` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:03.691512 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532e42f5-01a7-434f-ad47-f23b9ada3aac None admin] RBAC: Authorizing `identity:get_user(user_id=9ae38e0d0307468f8c5a1cb91a4b71bc)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:03.692981 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532e42f5-01a7-434f-ad47-f23b9ada3aac None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:03.695070 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 143/280] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 01:17:03 2022] GET /identity/v3/users/9ae38e0d0307468f8c5a1cb91a4b71bc => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:03.700971 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c24e948-5fe7-42b2-aee6-8ad343a50caf None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:03.745679 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532e42f5-01a7-434f-ad47-f23b9ada3aac None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:03.791228 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:03.839432 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c24e948-5fe7-42b2-aee6-8ad343a50caf None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:03.874325 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:03.877855 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9eaeb3-98a8-4d54-9488-e29a18d0065e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:03.878233 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532e42f5-01a7-434f-ad47-f23b9ada3aac None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:03.879057 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9eaeb3-98a8-4d54-9488-e29a18d0065e None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:03.879550 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9eaeb3-98a8-4d54-9488-e29a18d0065e None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:03.880032 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9eaeb3-98a8-4d54-9488-e29a18d0065e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:03.880954 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9eaeb3-98a8-4d54-9488-e29a18d0065e None admin] RBAC: Adding query filter params (role.id=13af81971c1c428eae0a571a22ea583d, user.id=9ae38e0d0307468f8c5a1cb91a4b71bc, scope.system=all) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:03.881448 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9eaeb3-98a8-4d54-9488-e29a18d0065e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:03.883273 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9eaeb3-98a8-4d54-9488-e29a18d0065e None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:03.889622 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 138/281] 10.222.0.26 () {56 vars in 1308 bytes} [Fri Aug 12 01:17:03 2022] GET /identity/v3/role_assignments?user.id=9ae38e0d0307468f8c5a1cb91a4b71bc&scope.system=all&role.id=13af81971c1c428eae0a571a22ea583d => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:17:03.922297 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8632ff0f-41ae-4a20-aa14-5e3d79f8ee06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:03.922958 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8632ff0f-41ae-4a20-aa14-5e3d79f8ee06 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:03.923237 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8632ff0f-41ae-4a20-aa14-5e3d79f8ee06 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:03.923512 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8632ff0f-41ae-4a20-aa14-5e3d79f8ee06 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:03.935909 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8632ff0f-41ae-4a20-aa14-5e3d79f8ee06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:17:03.940994 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-8632ff0f-41ae-4a20-aa14-5e3d79f8ee06 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 01:17:03.940994 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:03.940994 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:03.940994 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:03.940994 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:03.940994 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:03.940994 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:03.940994 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:03.940994 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:03.940994 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:03.940994 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:03.940994 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:03.940994 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:17:03.940994 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:17:03.940994 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:17:03.940994 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:17:03.941932 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:17:03.941932 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:17:03.941932 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:17:03.941932 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:17:03.941932 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:03.941932 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:03.941932 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:03.941932 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:03.941932 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:03.941932 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:03.941932 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:03.941932 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:03.941932 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:03.941932 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:03.941932 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:03.941932 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:03.942754 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:03.942754 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:03.942754 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:03.942754 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:03.942754 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:17:03.942754 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:17:03.942754 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:17:03.942754 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:17:03.942754 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:17:03.942754 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:17:03.942754 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 01:17:03.942754 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:17:03.942754 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 144/282] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 01:17:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:03.951584 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9eaeb3-98a8-4d54-9488-e29a18d0065e None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:03.954457 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f779b-facd-477a-bd4d-2426a75792d2 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:03.954744 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f779b-facd-477a-bd4d-2426a75792d2 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:03.955018 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f779b-facd-477a-bd4d-2426a75792d2 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:03.957798 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 145/283] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:17:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 01:17:03.962784 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee518a-a9aa-4e66-bdba-3d66d3cee019 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:03.963060 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee518a-a9aa-4e66-bdba-3d66d3cee019 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:03.963322 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee518a-a9aa-4e66-bdba-3d66d3cee019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:03.983344 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-5aee518a-a9aa-4e66-bdba-3d66d3cee019 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:17:03.984649 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-5aee518a-a9aa-4e66-bdba-3d66d3cee019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:17:04.082143 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 146/284] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:17:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 01:17:04.099365 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9eaeb3-98a8-4d54-9488-e29a18d0065e None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:04.124450 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:04.139943 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a6c160-f4ef-498f-a05e-5b441b2fed82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:04.140552 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6c160-f4ef-498f-a05e-5b441b2fed82 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:04.140824 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6c160-f4ef-498f-a05e-5b441b2fed82 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:04.141091 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a6c160-f4ef-498f-a05e-5b441b2fed82 None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:04.141753 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a6c160-f4ef-498f-a05e-5b441b2fed82 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:04.142047 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a6c160-f4ef-498f-a05e-5b441b2fed82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:04.143451 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a6c160-f4ef-498f-a05e-5b441b2fed82 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:04.156312 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 139/285] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Aug 12 01:17:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:04.158019 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee518a-a9aa-4e66-bdba-3d66d3cee019 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:04.257562 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:04.269808 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee518a-a9aa-4e66-bdba-3d66d3cee019 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:04.313005 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35039a4-daae-4bfe-8242-45941e1a80f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:04.313637 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35039a4-daae-4bfe-8242-45941e1a80f4 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:04.313911 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35039a4-daae-4bfe-8242-45941e1a80f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:04.314212 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35039a4-daae-4bfe-8242-45941e1a80f4 None admin] PATH_INFO: `/v3/users/ce2d903cb3e34957948611665afaa60f` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:04.315341 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35039a4-daae-4bfe-8242-45941e1a80f4 None admin] RBAC: Authorizing `identity:get_user(user_id=ce2d903cb3e34957948611665afaa60f)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:04.316785 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35039a4-daae-4bfe-8242-45941e1a80f4 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:04.318703 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 147/286] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 01:17:04 2022] GET /identity/v3/users/ce2d903cb3e34957948611665afaa60f => generated 297 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:04.324323 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a6c160-f4ef-498f-a05e-5b441b2fed82 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:04.430919 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35039a4-daae-4bfe-8242-45941e1a80f4 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:04.431089 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a6c160-f4ef-498f-a05e-5b441b2fed82 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:04.465365 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae90dd64-07e2-4b29-9638-16d7f5028950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:04.466379 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae90dd64-07e2-4b29-9638-16d7f5028950 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:04.466843 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae90dd64-07e2-4b29-9638-16d7f5028950 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:04.467296 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae90dd64-07e2-4b29-9638-16d7f5028950 None admin] PATH_INFO: `/v3/projects/45a8fcf9582d42ccaffc8d521078eab0` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:04.468614 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae90dd64-07e2-4b29-9638-16d7f5028950 None admin] RBAC: Authorizing `identity:get_project(project_id=45a8fcf9582d42ccaffc8d521078eab0)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:04.470276 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae90dd64-07e2-4b29-9638-16d7f5028950 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:04.472478 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 140/287] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 01:17:04 2022] GET /identity/v3/projects/45a8fcf9582d42ccaffc8d521078eab0 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:04.480828 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae90dd64-07e2-4b29-9638-16d7f5028950 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:04.578636 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:04.606284 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35039a4-daae-4bfe-8242-45941e1a80f4 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:04.649338 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfd725b-3229-456b-89f6-4cbc51cbb96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:04.649991 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd725b-3229-456b-89f6-4cbc51cbb96f None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:04.650293 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd725b-3229-456b-89f6-4cbc51cbb96f None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:04.650564 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd725b-3229-456b-89f6-4cbc51cbb96f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:04.651623 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae90dd64-07e2-4b29-9638-16d7f5028950 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:04.669207 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfd725b-3229-456b-89f6-4cbc51cbb96f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:17:04.683136 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-1dfd725b-3229-456b-89f6-4cbc51cbb96f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 01:17:04.683136 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:04.683136 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:04.683136 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:04.683136 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:04.683136 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:04.683136 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:04.683136 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:04.683136 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:04.683136 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:04.683136 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:04.683136 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:04.683136 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:17:04.683136 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:17:04.683136 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:17:04.683136 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:17:04.683997 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:17:04.683997 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:17:04.683997 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:17:04.683997 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:17:04.683997 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:04.683997 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:04.683997 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:04.683997 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:04.683997 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:04.683997 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:04.683997 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:04.683997 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:04.683997 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:04.683997 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:04.683997 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:04.683997 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:04.685187 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:04.685187 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:04.685187 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:04.685187 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:04.685187 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:17:04.685187 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:17:04.685187 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:17:04.685187 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:17:04.685187 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:17:04.685187 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:17:04.685187 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 01:17:04.685187 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:17:04.685187 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 148/288] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 01:17:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 01:17:04.690097 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfd725b-3229-456b-89f6-4cbc51cbb96f None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:04.690903 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce387313-745c-402a-9efe-e733fa7a38f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:04.691720 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce387313-745c-402a-9efe-e733fa7a38f9 None admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:04.692141 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce387313-745c-402a-9efe-e733fa7a38f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:04.692543 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce387313-745c-402a-9efe-e733fa7a38f9 None admin] PATH_INFO: `/v3/projects/45a8fcf9582d42ccaffc8d521078eab0/users/ce2d903cb3e34957948611665afaa60f/roles/d3ac26b4075941a7a84580ef43d093f6` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:04.694751 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce387313-745c-402a-9efe-e733fa7a38f9 None admin] RBAC: Authorizing `identity:create_grant(project_id=45a8fcf9582d42ccaffc8d521078eab0, user_id=ce2d903cb3e34957948611665afaa60f, role_id=d3ac26b4075941a7a84580ef43d093f6)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:04.696403 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce387313-745c-402a-9efe-e733fa7a38f9 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:04.713437 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:04.720423 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 141/289] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Aug 12 01:17:04 2022] PUT /identity/v3/projects/45a8fcf9582d42ccaffc8d521078eab0/users/ce2d903cb3e34957948611665afaa60f/roles/d3ac26b4075941a7a84580ef43d093f6 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:17:04.834719 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfd725b-3229-456b-89f6-4cbc51cbb96f None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:04.892323 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed5fca0-9b96-47b3-9c37-e4c3af1d0432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:04.892963 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed5fca0-9b96-47b3-9c37-e4c3af1d0432 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:04.893240 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed5fca0-9b96-47b3-9c37-e4c3af1d0432 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:04.893570 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed5fca0-9b96-47b3-9c37-e4c3af1d0432 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:04.894289 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed5fca0-9b96-47b3-9c37-e4c3af1d0432 None admin] RBAC: Adding query filter params (name=member) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:04.894645 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed5fca0-9b96-47b3-9c37-e4c3af1d0432 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:04.896051 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed5fca0-9b96-47b3-9c37-e4c3af1d0432 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:04.910523 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 149/290] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Aug 12 01:17:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:17:04.911855 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce387313-745c-402a-9efe-e733fa7a38f9 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:05.036836 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce387313-745c-402a-9efe-e733fa7a38f9 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:05.051591 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:05.076711 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e530945-d380-4a09-bcfc-2440b8328245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:05.077390 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e530945-d380-4a09-bcfc-2440b8328245 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:05.077666 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e530945-d380-4a09-bcfc-2440b8328245 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:05.077933 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e530945-d380-4a09-bcfc-2440b8328245 None admin] PATH_INFO: `/v3/users/1d3dbca38dba42dc90cf8983aaddd5be` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:05.079099 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e530945-d380-4a09-bcfc-2440b8328245 None admin] RBAC: Authorizing `identity:get_user(user_id=1d3dbca38dba42dc90cf8983aaddd5be)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:05.080653 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e530945-d380-4a09-bcfc-2440b8328245 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:05.082451 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 142/291] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 01:17:04 2022] GET /identity/v3/users/1d3dbca38dba42dc90cf8983aaddd5be => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:05.089071 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed5fca0-9b96-47b3-9c37-e4c3af1d0432 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:05.204095 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:05.226249 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed5fca0-9b96-47b3-9c37-e4c3af1d0432 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:05.265657 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d05df3-368b-4551-9d88-51b48dc06707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:05.266303 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d05df3-368b-4551-9d88-51b48dc06707 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:05.266576 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d05df3-368b-4551-9d88-51b48dc06707 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:05.266843 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d05df3-368b-4551-9d88-51b48dc06707 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:05.361582 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d05df3-368b-4551-9d88-51b48dc06707 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:05.363061 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d05df3-368b-4551-9d88-51b48dc06707 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:05.459611 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:05.482269 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 150/292] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 01:17:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 12 01:17:05.487796 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e530945-d380-4a09-bcfc-2440b8328245 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:05.638592 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e530945-d380-4a09-bcfc-2440b8328245 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:05.686015 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc95239-eef1-4ef0-b6c2-7e3ccaa3fb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:05.686736 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc95239-eef1-4ef0-b6c2-7e3ccaa3fb18 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:05.687019 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc95239-eef1-4ef0-b6c2-7e3ccaa3fb18 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:05.687291 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc95239-eef1-4ef0-b6c2-7e3ccaa3fb18 None admin] PATH_INFO: `/v3/projects/45a8fcf9582d42ccaffc8d521078eab0` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:05.688480 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc95239-eef1-4ef0-b6c2-7e3ccaa3fb18 None admin] RBAC: Authorizing `identity:get_project(project_id=45a8fcf9582d42ccaffc8d521078eab0)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:05.689922 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc95239-eef1-4ef0-b6c2-7e3ccaa3fb18 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:05.691882 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 143/293] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 01:17:05 2022] GET /identity/v3/projects/45a8fcf9582d42ccaffc8d521078eab0 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:05.697866 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d05df3-368b-4551-9d88-51b48dc06707 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:05.797849 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d05df3-368b-4551-9d88-51b48dc06707 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:05.832909 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e39d91-83e9-4d2a-8bba-f1feb8f36658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:05.833517 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e39d91-83e9-4d2a-8bba-f1feb8f36658 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:05.833791 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e39d91-83e9-4d2a-8bba-f1feb8f36658 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:05.834056 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e39d91-83e9-4d2a-8bba-f1feb8f36658 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:05.834811 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e39d91-83e9-4d2a-8bba-f1feb8f36658 None admin] RBAC: Adding query filter params (role.id=13af81971c1c428eae0a571a22ea583d, scope.project.id=45a8fcf9582d42ccaffc8d521078eab0, user.id=1d3dbca38dba42dc90cf8983aaddd5be) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:05.835116 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e39d91-83e9-4d2a-8bba-f1feb8f36658 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:05.836815 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e39d91-83e9-4d2a-8bba-f1feb8f36658 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:05.843269 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 151/294] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 01:17:05 2022] GET /identity/v3/role_assignments?user.id=1d3dbca38dba42dc90cf8983aaddd5be&scope.project.id=45a8fcf9582d42ccaffc8d521078eab0&role.id=13af81971c1c428eae0a571a22ea583d => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:05.939214 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a25bb-9507-462e-90f2-97e669f79796 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:05.939705 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a25bb-9507-462e-90f2-97e669f79796 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:05.939705 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a25bb-9507-462e-90f2-97e669f79796 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:05.941250 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 144/295] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:17:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:17:05.957131 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f00c3-0891-4ce7-b3aa-9133e5e3300a None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:05.957131 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f00c3-0891-4ce7-b3aa-9133e5e3300a None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:05.957131 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f00c3-0891-4ce7-b3aa-9133e5e3300a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:05.982968 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-c52f00c3-0891-4ce7-b3aa-9133e5e3300a None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:17:05.984720 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c52f00c3-0891-4ce7-b3aa-9133e5e3300a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:17:06.044858 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:06.082368 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 152/296] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:17:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 01:17:06.229995 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09177d6-b1ca-4fcf-9c7b-b4499e89039b None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:06.229995 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09177d6-b1ca-4fcf-9c7b-b4499e89039b None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:06.229995 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09177d6-b1ca-4fcf-9c7b-b4499e89039b None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:06.230724 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 145/297] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:17:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:17:06.236319 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5214b57-82e0-4b47-bec1-76d74ef71264 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:06.236843 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5214b57-82e0-4b47-bec1-76d74ef71264 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:06.237307 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5214b57-82e0-4b47-bec1-76d74ef71264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:06.258467 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-e5214b57-82e0-4b47-bec1-76d74ef71264 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:17:06.259978 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-e5214b57-82e0-4b47-bec1-76d74ef71264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:17:06.340377 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 153/298] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:17:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 01:17:06.369983 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76046930-2f97-4e51-8e20-e96f4e84ff85 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:06.369983 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76046930-2f97-4e51-8e20-e96f4e84ff85 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:06.369983 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76046930-2f97-4e51-8e20-e96f4e84ff85 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:06.370630 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 146/299] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:17:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:17:06.372539 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5214b57-82e0-4b47-bec1-76d74ef71264 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:06.375318 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe187ac-4d88-4280-b034-e3fb4b89c5f6 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:06.375834 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe187ac-4d88-4280-b034-e3fb4b89c5f6 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:06.376080 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe187ac-4d88-4280-b034-e3fb4b89c5f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:06.405400 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-7fe187ac-4d88-4280-b034-e3fb4b89c5f6 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:17:06.406963 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-7fe187ac-4d88-4280-b034-e3fb4b89c5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:17:06.470609 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:06.500517 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5214b57-82e0-4b47-bec1-76d74ef71264 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:06.502424 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:06.506676 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 147/300] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:17:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 01:17:06.541655 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d350f3-6336-46e4-961e-cd2726a814db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:06.542555 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d350f3-6336-46e4-961e-cd2726a814db None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:06.543000 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d350f3-6336-46e4-961e-cd2726a814db None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:06.543736 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d350f3-6336-46e4-961e-cd2726a814db None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:06.554308 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d350f3-6336-46e4-961e-cd2726a814db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:17:06.559359 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-77d350f3-6336-46e4-961e-cd2726a814db None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 01:17:06.559359 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:06.559359 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:06.559359 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:06.559359 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:06.559359 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:06.559359 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:06.559359 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:06.559359 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:06.559359 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:06.559359 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:06.559359 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:06.559359 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:17:06.559359 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:17:06.559359 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:17:06.559359 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:17:06.560432 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:17:06.560432 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:17:06.560432 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:17:06.560432 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:17:06.560432 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:06.560432 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:06.560432 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:06.560432 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:06.560432 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:06.560432 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:06.560432 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:06.560432 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:06.560432 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:06.560432 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:06.560432 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:06.560432 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:06.561425 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:06.561425 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:06.561425 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:06.561425 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:06.561425 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:17:06.561425 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:17:06.561425 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:17:06.561425 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:17:06.561425 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:17:06.561425 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:17:06.561425 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 01:17:06.561425 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:17:06.563583 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 154/301] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 01:17:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:06.569442 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe187ac-4d88-4280-b034-e3fb4b89c5f6 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:06.623428 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d350f3-6336-46e4-961e-cd2726a814db None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:06.674319 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe187ac-4d88-4280-b034-e3fb4b89c5f6 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:06.711821 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eb20f3-60ad-485a-b5e9-bd111325aef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:06.712433 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb20f3-60ad-485a-b5e9-bd111325aef5 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:06.712710 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb20f3-60ad-485a-b5e9-bd111325aef5 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:06.712987 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb20f3-60ad-485a-b5e9-bd111325aef5 None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:06.713652 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eb20f3-60ad-485a-b5e9-bd111325aef5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:06.713953 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eb20f3-60ad-485a-b5e9-bd111325aef5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:06.715373 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eb20f3-60ad-485a-b5e9-bd111325aef5 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:06.723847 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 148/302] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Aug 12 01:17:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:06.728967 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d350f3-6336-46e4-961e-cd2726a814db None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:06.729414 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eb20f3-60ad-485a-b5e9-bd111325aef5 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:06.765958 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b07354e-2b52-487b-b7a0-c2e005b2f57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:06.766594 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b07354e-2b52-487b-b7a0-c2e005b2f57c None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:06.766872 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b07354e-2b52-487b-b7a0-c2e005b2f57c None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:06.767140 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b07354e-2b52-487b-b7a0-c2e005b2f57c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:06.772732 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:06.780045 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b07354e-2b52-487b-b7a0-c2e005b2f57c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:17:06.785368 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-0b07354e-2b52-487b-b7a0-c2e005b2f57c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 01:17:06.785368 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:06.785368 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:06.785368 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:06.785368 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:06.785368 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:06.785368 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:06.785368 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:06.785368 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:06.785368 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:06.785368 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:06.785368 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:06.785368 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:17:06.785368 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:17:06.785368 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:17:06.785368 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:17:06.786296 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:17:06.786296 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:17:06.786296 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:17:06.786296 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:17:06.786296 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:06.786296 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:06.786296 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:06.786296 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:06.786296 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:06.786296 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:06.786296 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:06.786296 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:06.786296 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:06.786296 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:06.786296 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:06.786296 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:06.787082 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:06.787082 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:06.787082 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:06.787082 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:06.787082 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:17:06.787082 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:17:06.787082 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:17:06.787082 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:17:06.787082 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:17:06.787082 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:17:06.787082 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 01:17:06.787082 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:17:06.790273 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 155/303] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 01:17:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 01:17:06.791687 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b07354e-2b52-487b-b7a0-c2e005b2f57c None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:06.821924 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:06.833673 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eb20f3-60ad-485a-b5e9-bd111325aef5 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:06.869108 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f99a456-34a8-4e2e-a499-783dfcc562f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:06.870302 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99a456-34a8-4e2e-a499-783dfcc562f6 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:06.871579 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99a456-34a8-4e2e-a499-783dfcc562f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:06.872051 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99a456-34a8-4e2e-a499-783dfcc562f6 None admin] PATH_INFO: `/v3/users/02fa2fe54a624e3797a61d4f37bae20e` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:06.888564 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f99a456-34a8-4e2e-a499-783dfcc562f6 None admin] RBAC: Authorizing `identity:get_user(user_id=02fa2fe54a624e3797a61d4f37bae20e)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:06.890707 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f99a456-34a8-4e2e-a499-783dfcc562f6 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:06.893104 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 149/304] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 01:17:06 2022] GET /identity/v3/users/02fa2fe54a624e3797a61d4f37bae20e => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:17:06.894309 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f99a456-34a8-4e2e-a499-783dfcc562f6 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:06.901278 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b07354e-2b52-487b-b7a0-c2e005b2f57c None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:06.936488 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1963be2a-69b6-499d-8319-7da837250e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:06.937109 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1963be2a-69b6-499d-8319-7da837250e82 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:06.937377 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1963be2a-69b6-499d-8319-7da837250e82 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:06.937636 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1963be2a-69b6-499d-8319-7da837250e82 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:06.938752 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1963be2a-69b6-499d-8319-7da837250e82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:06.940313 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1963be2a-69b6-499d-8319-7da837250e82 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:06.942014 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 156/305] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:17:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:06.947111 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1963be2a-69b6-499d-8319-7da837250e82 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:06.999596 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:07.002368 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f99a456-34a8-4e2e-a499-783dfcc562f6 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:07.036938 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87acde7c-48c4-4635-8275-7a6e97ed6093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:07.037464 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87acde7c-48c4-4635-8275-7a6e97ed6093 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:07.037745 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87acde7c-48c4-4635-8275-7a6e97ed6093 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:07.038016 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87acde7c-48c4-4635-8275-7a6e97ed6093 None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:07.038759 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87acde7c-48c4-4635-8275-7a6e97ed6093 None admin] RBAC: Adding query filter params (name=member) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:07.039056 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87acde7c-48c4-4635-8275-7a6e97ed6093 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:07.040434 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87acde7c-48c4-4635-8275-7a6e97ed6093 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:07.049234 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 150/306] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Aug 12 01:17:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:07.050050 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87acde7c-48c4-4635-8275-7a6e97ed6093 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:07.054679 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:07.066162 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1963be2a-69b6-499d-8319-7da837250e82 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:07.104760 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4524cab6-c020-436c-ba43-23bdab0de5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:07.105376 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524cab6-c020-436c-ba43-23bdab0de5d9 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:07.105648 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524cab6-c020-436c-ba43-23bdab0de5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:07.105916 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524cab6-c020-436c-ba43-23bdab0de5d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:07.106687 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4524cab6-c020-436c-ba43-23bdab0de5d9 None admin] RBAC: Adding query filter params (role.id=d3ac26b4075941a7a84580ef43d093f6, user.id=02fa2fe54a624e3797a61d4f37bae20e, scope.system=all) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:07.106993 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4524cab6-c020-436c-ba43-23bdab0de5d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:07.108485 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4524cab6-c020-436c-ba43-23bdab0de5d9 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:07.113631 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 157/307] 10.222.0.26 () {56 vars in 1308 bytes} [Fri Aug 12 01:17:06 2022] GET /identity/v3/role_assignments?user.id=02fa2fe54a624e3797a61d4f37bae20e&scope.system=all&role.id=d3ac26b4075941a7a84580ef43d093f6 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:07.114447 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4524cab6-c020-436c-ba43-23bdab0de5d9 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:07.161898 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87acde7c-48c4-4635-8275-7a6e97ed6093 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:07.200282 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79a0878-5c8e-4866-a86b-ba4d4e11f2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:07.200905 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a0878-5c8e-4866-a86b-ba4d4e11f2f8 None admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:07.201182 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a0878-5c8e-4866-a86b-ba4d4e11f2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:07.201455 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a0878-5c8e-4866-a86b-ba4d4e11f2f8 None admin] PATH_INFO: `/v3/groups` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:07.202085 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79a0878-5c8e-4866-a86b-ba4d4e11f2f8 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:07.203567 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79a0878-5c8e-4866-a86b-ba4d4e11f2f8 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:07.223436 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 151/308] 10.222.0.26 () {60 vars in 1134 bytes} [Fri Aug 12 01:17:07 2022] POST /identity/v3/groups => generated 229 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:17:07.225095 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40154db6-dfbd-4d2b-9cb0-74fb8df6501e None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:07.225383 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40154db6-dfbd-4d2b-9cb0-74fb8df6501e None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:07.225710 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40154db6-dfbd-4d2b-9cb0-74fb8df6501e None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:07.228313 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 152/309] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:17:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:17:07.233755 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d580f4b-fd72-4564-8d64-7a0cc150c969 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:07.234100 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d580f4b-fd72-4564-8d64-7a0cc150c969 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:07.234400 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d580f4b-fd72-4564-8d64-7a0cc150c969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:07.242669 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4524cab6-c020-436c-ba43-23bdab0de5d9 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:07.262336 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-3d580f4b-fd72-4564-8d64-7a0cc150c969 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:17:07.262336 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-3d580f4b-fd72-4564-8d64-7a0cc150c969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:17:07.283316 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:07.304257 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f67e3-de3e-4926-8496-772da42d2ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:07.305433 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f67e3-de3e-4926-8496-772da42d2ccb None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:07.305898 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f67e3-de3e-4926-8496-772da42d2ccb None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:07.306408 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f67e3-de3e-4926-8496-772da42d2ccb None admin] PATH_INFO: `/v3/users/9ae38e0d0307468f8c5a1cb91a4b71bc` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:07.307856 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279f67e3-de3e-4926-8496-772da42d2ccb None admin] RBAC: Authorizing `identity:get_user(user_id=9ae38e0d0307468f8c5a1cb91a4b71bc)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:07.309831 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279f67e3-de3e-4926-8496-772da42d2ccb None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:07.312278 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 158/310] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 01:17:07 2022] GET /identity/v3/users/9ae38e0d0307468f8c5a1cb91a4b71bc => generated 293 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:07.317702 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f67e3-de3e-4926-8496-772da42d2ccb None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:07.346172 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 153/311] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:17:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 01:17:07.353986 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:07.439066 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f67e3-de3e-4926-8496-772da42d2ccb None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:07.473573 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ba264e-3590-4b57-b470-96ebe8481bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:07.474253 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba264e-3590-4b57-b470-96ebe8481bf3 None admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:07.474535 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba264e-3590-4b57-b470-96ebe8481bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:07.474805 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba264e-3590-4b57-b470-96ebe8481bf3 None admin] PATH_INFO: `/v3/system/users/9ae38e0d0307468f8c5a1cb91a4b71bc/roles/13af81971c1c428eae0a571a22ea583d` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:07.476664 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ba264e-3590-4b57-b470-96ebe8481bf3 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=9ae38e0d0307468f8c5a1cb91a4b71bc, role_id=13af81971c1c428eae0a571a22ea583d)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:07.478133 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ba264e-3590-4b57-b470-96ebe8481bf3 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:07.496595 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 159/312] 10.222.0.26 () {58 vars in 1334 bytes} [Fri Aug 12 01:17:07 2022] PUT /identity/v3/system/users/9ae38e0d0307468f8c5a1cb91a4b71bc/roles/13af81971c1c428eae0a571a22ea583d => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:17:07.621242 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d580f4b-fd72-4564-8d64-7a0cc150c969 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:07.733975 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d580f4b-fd72-4564-8d64-7a0cc150c969 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:07.770094 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ec0402-d6f4-4bff-ae5d-e54ae54252f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:07.770747 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec0402-d6f4-4bff-ae5d-e54ae54252f8 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:07.771017 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec0402-d6f4-4bff-ae5d-e54ae54252f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:07.771337 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec0402-d6f4-4bff-ae5d-e54ae54252f8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:07.782948 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ec0402-d6f4-4bff-ae5d-e54ae54252f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:17:07.787706 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-d1ec0402-d6f4-4bff-ae5d-e54ae54252f8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 01:17:07.787706 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:07.787706 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:07.787706 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:07.787706 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:07.787706 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:07.787706 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:07.787706 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:07.787706 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:07.787706 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:07.787706 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:07.787706 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:07.787706 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:17:07.787706 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:17:07.787706 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:17:07.787706 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:17:07.788560 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:17:07.788560 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:17:07.788560 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:17:07.788560 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:17:07.788560 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:07.788560 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:07.788560 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:07.788560 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:07.788560 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:07.788560 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:07.788560 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:07.788560 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:07.788560 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:07.788560 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:07.788560 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:07.788560 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:07.790338 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:07.790338 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:07.790338 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:07.790338 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:07.790338 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:17:07.790338 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:17:07.790338 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:17:07.790338 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:17:07.790338 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:17:07.790338 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:17:07.790338 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 01:17:07.790338 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:17:07.790338 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 154/313] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 01:17:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:07.795778 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ba264e-3590-4b57-b470-96ebe8481bf3 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:07.885386 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:07.904903 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ba264e-3590-4b57-b470-96ebe8481bf3 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:07.940954 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9c3ed2-9e0d-4353-8340-11341eff5070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:07.941873 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c3ed2-9e0d-4353-8340-11341eff5070 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:07.942374 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c3ed2-9e0d-4353-8340-11341eff5070 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:07.942881 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c3ed2-9e0d-4353-8340-11341eff5070 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:07.943734 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9c3ed2-9e0d-4353-8340-11341eff5070 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:07.944238 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9c3ed2-9e0d-4353-8340-11341eff5070 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:07.946611 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9c3ed2-9e0d-4353-8340-11341eff5070 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:07.956076 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 160/314] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Aug 12 01:17:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:07.966146 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ec0402-d6f4-4bff-ae5d-e54ae54252f8 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:07.978795 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:08.075568 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ec0402-d6f4-4bff-ae5d-e54ae54252f8 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:08.112213 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165c8abc-26ce-45a1-a4bc-492a8ebeb8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:08.112864 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c8abc-26ce-45a1-a4bc-492a8ebeb8f3 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:08.113140 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c8abc-26ce-45a1-a4bc-492a8ebeb8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:08.113419 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c8abc-26ce-45a1-a4bc-492a8ebeb8f3 None admin] PATH_INFO: `/v3/users/ce2d903cb3e34957948611665afaa60f` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:08.114589 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165c8abc-26ce-45a1-a4bc-492a8ebeb8f3 None admin] RBAC: Authorizing `identity:get_user(user_id=ce2d903cb3e34957948611665afaa60f)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:08.116044 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165c8abc-26ce-45a1-a4bc-492a8ebeb8f3 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:08.118685 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 155/315] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 01:17:07 2022] GET /identity/v3/users/ce2d903cb3e34957948611665afaa60f => generated 297 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:08.124210 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9c3ed2-9e0d-4353-8340-11341eff5070 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:08.238053 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9c3ed2-9e0d-4353-8340-11341eff5070 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:08.271843 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f5f20e-3556-4c3f-bbc7-e110b686412b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:08.272764 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f5f20e-3556-4c3f-bbc7-e110b686412b None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:08.273296 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f5f20e-3556-4c3f-bbc7-e110b686412b None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:08.273893 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f5f20e-3556-4c3f-bbc7-e110b686412b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:08.292176 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:08.346632 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f5f20e-3556-4c3f-bbc7-e110b686412b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:08.348107 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f5f20e-3556-4c3f-bbc7-e110b686412b None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:08.455932 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 161/316] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 01:17:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 01:17:08.462295 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165c8abc-26ce-45a1-a4bc-492a8ebeb8f3 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:08.548327 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:08.567602 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165c8abc-26ce-45a1-a4bc-492a8ebeb8f3 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:08.606337 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c285d9-edfb-4418-b3e0-00702c1e74be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:08.607004 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c285d9-edfb-4418-b3e0-00702c1e74be None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:08.607283 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c285d9-edfb-4418-b3e0-00702c1e74be None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:08.607552 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c285d9-edfb-4418-b3e0-00702c1e74be None admin] PATH_INFO: `/v3/projects/45a8fcf9582d42ccaffc8d521078eab0` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:08.608702 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c285d9-edfb-4418-b3e0-00702c1e74be None admin] RBAC: Authorizing `identity:get_project(project_id=45a8fcf9582d42ccaffc8d521078eab0)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:08.610162 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c285d9-edfb-4418-b3e0-00702c1e74be None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:08.612292 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 156/317] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 01:17:08 2022] GET /identity/v3/projects/45a8fcf9582d42ccaffc8d521078eab0 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:17:08.618543 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f5f20e-3556-4c3f-bbc7-e110b686412b None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:08.669477 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:08.724619 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f5f20e-3556-4c3f-bbc7-e110b686412b None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:08.763223 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fe5c73-b139-4acd-97f4-ce670c07475f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:08.764155 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe5c73-b139-4acd-97f4-ce670c07475f None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:08.764618 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe5c73-b139-4acd-97f4-ce670c07475f None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:08.765093 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe5c73-b139-4acd-97f4-ce670c07475f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:08.766010 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fe5c73-b139-4acd-97f4-ce670c07475f None admin] RBAC: Adding query filter params (role.id=d3ac26b4075941a7a84580ef43d093f6, scope.project.id=45a8fcf9582d42ccaffc8d521078eab0, user.id=ce2d903cb3e34957948611665afaa60f) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:08.766526 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fe5c73-b139-4acd-97f4-ce670c07475f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:08.768281 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fe5c73-b139-4acd-97f4-ce670c07475f None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:08.775059 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 162/318] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 01:17:08 2022] GET /identity/v3/role_assignments?user.id=ce2d903cb3e34957948611665afaa60f&scope.project.id=45a8fcf9582d42ccaffc8d521078eab0&role.id=d3ac26b4075941a7a84580ef43d093f6 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:09.081640 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87828c9-8b81-46b5-b8f3-c9682e04850a None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:09.082176 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87828c9-8b81-46b5-b8f3-c9682e04850a None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:09.082176 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87828c9-8b81-46b5-b8f3-c9682e04850a None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:09.083631 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 157/319] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:17:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:17:09.089032 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c831ae1-068b-4f06-aca8-fca375921c77 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:09.089550 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c831ae1-068b-4f06-aca8-fca375921c77 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:09.089550 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c831ae1-068b-4f06-aca8-fca375921c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:09.107816 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-3c831ae1-068b-4f06-aca8-fca375921c77 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:17:09.109002 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-3c831ae1-068b-4f06-aca8-fca375921c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:17:09.180556 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 163/320] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:17:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 01:17:09.328094 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396fd72e-7f56-42f2-886f-a96b039822a5 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:09.328467 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396fd72e-7f56-42f2-886f-a96b039822a5 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:09.328635 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396fd72e-7f56-42f2-886f-a96b039822a5 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:09.330108 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 158/321] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:17:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:17:09.335270 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5016936a-5e53-4275-936b-4bec62319b11 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:09.335718 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5016936a-5e53-4275-936b-4bec62319b11 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:09.335838 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5016936a-5e53-4275-936b-4bec62319b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:09.353966 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-5016936a-5e53-4275-936b-4bec62319b11 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:17:09.355157 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-5016936a-5e53-4275-936b-4bec62319b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:17:09.390732 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:09.424631 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 164/322] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:17:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 01:17:09.447752 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396fd72e-7f56-42f2-886f-a96b039822a5 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:09.531031 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee7932-bdcb-4577-a6ef-5b76211f5b43 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:09.531365 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee7932-bdcb-4577-a6ef-5b76211f5b43 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:09.531556 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee7932-bdcb-4577-a6ef-5b76211f5b43 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:09.533067 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 165/323] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:17:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 01:17:09.537730 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430ed1fa-f4e8-48c8-97f1-a6b334b6be69 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:09.538014 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430ed1fa-f4e8-48c8-97f1-a6b334b6be69 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:09.538332 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430ed1fa-f4e8-48c8-97f1-a6b334b6be69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:09.552039 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396fd72e-7f56-42f2-886f-a96b039822a5 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:09.558546 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-430ed1fa-f4e8-48c8-97f1-a6b334b6be69 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:17:09.559735 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-430ed1fa-f4e8-48c8-97f1-a6b334b6be69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:17:09.588529 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b6c3e5-3ad1-4d13-8a57-e9bab702955b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:09.589082 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6c3e5-3ad1-4d13-8a57-e9bab702955b None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:09.589358 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6c3e5-3ad1-4d13-8a57-e9bab702955b None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:09.589627 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b6c3e5-3ad1-4d13-8a57-e9bab702955b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:09.600102 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b6c3e5-3ad1-4d13-8a57-e9bab702955b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:17:09.604841 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-63b6c3e5-3ad1-4d13-8a57-e9bab702955b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 01:17:09.604841 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:09.604841 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:09.604841 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:09.604841 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:09.604841 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:09.604841 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:09.604841 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:09.604841 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:09.604841 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:09.604841 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:09.604841 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:09.604841 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:17:09.604841 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:17:09.604841 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:17:09.604841 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:17:09.605729 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:17:09.605729 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:17:09.605729 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:17:09.605729 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:17:09.605729 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:09.605729 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:09.605729 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:09.605729 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:09.605729 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:09.605729 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:09.605729 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:09.605729 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:09.605729 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:09.605729 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:09.605729 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:09.605729 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:09.606556 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:09.606556 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:09.606556 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:09.606556 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:09.606556 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:17:09.606556 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:17:09.606556 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:17:09.606556 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:17:09.606556 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:17:09.606556 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:17:09.606556 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 01:17:09.606556 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:17:09.606556 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 159/324] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 01:17:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:09.611583 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b6c3e5-3ad1-4d13-8a57-e9bab702955b None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:09.622971 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:09.638164 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 166/325] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:17:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 01:17:09.688020 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430ed1fa-f4e8-48c8-97f1-a6b334b6be69 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:09.723694 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b6c3e5-3ad1-4d13-8a57-e9bab702955b None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:09.762431 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7af78a1-b064-47ad-8e1c-7e589beed54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:09.763040 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af78a1-b064-47ad-8e1c-7e589beed54c None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:09.763323 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af78a1-b064-47ad-8e1c-7e589beed54c None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:09.763593 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af78a1-b064-47ad-8e1c-7e589beed54c None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:09.764257 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7af78a1-b064-47ad-8e1c-7e589beed54c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:09.764559 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7af78a1-b064-47ad-8e1c-7e589beed54c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:09.765918 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7af78a1-b064-47ad-8e1c-7e589beed54c None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:09.774205 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 160/326] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Aug 12 01:17:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:17:09.779946 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7af78a1-b064-47ad-8e1c-7e589beed54c None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:09.791028 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430ed1fa-f4e8-48c8-97f1-a6b334b6be69 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:09.792954 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:09.830954 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebae34b-cb55-421a-8c71-c374f7046bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:09.831997 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebae34b-cb55-421a-8c71-c374f7046bb0 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:09.832468 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebae34b-cb55-421a-8c71-c374f7046bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:09.832927 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebae34b-cb55-421a-8c71-c374f7046bb0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:09.834268 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebae34b-cb55-421a-8c71-c374f7046bb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:09.835951 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebae34b-cb55-421a-8c71-c374f7046bb0 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:09.837917 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 167/327] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:17:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:17:09.843247 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebae34b-cb55-421a-8c71-c374f7046bb0 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:09.852898 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:09.885724 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7af78a1-b064-47ad-8e1c-7e589beed54c None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:09.921067 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3914283f-17a8-412d-8594-c988eddbe614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:09.921694 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3914283f-17a8-412d-8594-c988eddbe614 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:09.921971 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3914283f-17a8-412d-8594-c988eddbe614 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:09.922272 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3914283f-17a8-412d-8594-c988eddbe614 None admin] PATH_INFO: `/v3/users/02fa2fe54a624e3797a61d4f37bae20e` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:09.923398 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3914283f-17a8-412d-8594-c988eddbe614 None admin] RBAC: Authorizing `identity:get_user(user_id=02fa2fe54a624e3797a61d4f37bae20e)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:09.924837 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3914283f-17a8-412d-8594-c988eddbe614 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:09.926444 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 161/328] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 01:17:09 2022] GET /identity/v3/users/02fa2fe54a624e3797a61d4f37bae20e => generated 293 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:17:09.929967 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3914283f-17a8-412d-8594-c988eddbe614 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:09.948882 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebae34b-cb55-421a-8c71-c374f7046bb0 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:09.981250 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c85b67-4886-41bc-827d-43368c025252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:09.981855 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c85b67-4886-41bc-827d-43368c025252 None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:09.982159 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c85b67-4886-41bc-827d-43368c025252 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:09.982435 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c85b67-4886-41bc-827d-43368c025252 None admin] PATH_INFO: `/v3/groups` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:09.983442 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c85b67-4886-41bc-827d-43368c025252 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:09.984890 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c85b67-4886-41bc-827d-43368c025252 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:10.000976 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 168/329] 10.222.0.26 () {60 vars in 1134 bytes} [Fri Aug 12 01:17:09 2022] POST /identity/v3/groups => generated 226 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 01:17:10.001770 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c85b67-4886-41bc-827d-43368c025252 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:10.028155 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3914283f-17a8-412d-8594-c988eddbe614 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:10.036347 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:10.069465 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22548efd-1643-4914-b0b4-aaba0816188c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:10.070261 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22548efd-1643-4914-b0b4-aaba0816188c None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:10.070538 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22548efd-1643-4914-b0b4-aaba0816188c None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:10.070808 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22548efd-1643-4914-b0b4-aaba0816188c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:10.078948 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:10.083843 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22548efd-1643-4914-b0b4-aaba0816188c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:17:10.091172 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-22548efd-1643-4914-b0b4-aaba0816188c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 01:17:10.091172 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:10.091172 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:10.091172 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:10.091172 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:10.091172 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:10.091172 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:10.091172 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:10.091172 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:10.091172 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:10.091172 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:10.091172 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:10.091172 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:17:10.091172 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:17:10.091172 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:17:10.091172 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:17:10.092346 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:17:10.092346 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:17:10.092346 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:17:10.092346 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:17:10.092346 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:10.092346 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:10.092346 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:10.092346 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:10.092346 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:10.092346 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:10.092346 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:10.092346 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:10.092346 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:10.092346 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:10.092346 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:10.092346 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:10.093171 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:10.093171 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:10.093171 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:10.093171 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:10.093171 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:17:10.093171 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:17:10.093171 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:17:10.093171 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:17:10.093171 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:17:10.093171 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:17:10.093171 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 01:17:10.093171 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:17:10.093171 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 162/330] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 01:17:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:10.099477 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22548efd-1643-4914-b0b4-aaba0816188c None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:10.123370 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c85b67-4886-41bc-827d-43368c025252 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:10.161594 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a757ac4b-0458-40ea-99e4-e643ab2058c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:10.162980 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a757ac4b-0458-40ea-99e4-e643ab2058c6 None admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:10.162980 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a757ac4b-0458-40ea-99e4-e643ab2058c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:10.162980 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a757ac4b-0458-40ea-99e4-e643ab2058c6 None admin] PATH_INFO: `/v3/system/users/02fa2fe54a624e3797a61d4f37bae20e/roles/d3ac26b4075941a7a84580ef43d093f6` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:10.164268 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a757ac4b-0458-40ea-99e4-e643ab2058c6 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=02fa2fe54a624e3797a61d4f37bae20e, role_id=d3ac26b4075941a7a84580ef43d093f6)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:10.165795 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a757ac4b-0458-40ea-99e4-e643ab2058c6 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:10.175950 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 169/331] 10.222.0.26 () {58 vars in 1334 bytes} [Fri Aug 12 01:17:10 2022] PUT /identity/v3/system/users/02fa2fe54a624e3797a61d4f37bae20e/roles/d3ac26b4075941a7a84580ef43d093f6 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:17:10.228716 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22548efd-1643-4914-b0b4-aaba0816188c None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:10.267055 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b647be21-eb7f-4ba8-b3b1-f9236e213c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:10.267692 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b647be21-eb7f-4ba8-b3b1-f9236e213c24 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:10.268000 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b647be21-eb7f-4ba8-b3b1-f9236e213c24 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:10.268240 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b647be21-eb7f-4ba8-b3b1-f9236e213c24 None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:10.268927 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b647be21-eb7f-4ba8-b3b1-f9236e213c24 None admin] RBAC: Adding query filter params (name=member) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:10.269254 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b647be21-eb7f-4ba8-b3b1-f9236e213c24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:10.270667 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b647be21-eb7f-4ba8-b3b1-f9236e213c24 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:10.280635 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 163/332] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Aug 12 01:17:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:17:10.286797 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a757ac4b-0458-40ea-99e4-e643ab2058c6 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:10.392813 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:10.402414 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a757ac4b-0458-40ea-99e4-e643ab2058c6 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:10.440795 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e38b6d0-976c-45cd-b08f-359ddfdcceae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:10.441436 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38b6d0-976c-45cd-b08f-359ddfdcceae None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:10.441711 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38b6d0-976c-45cd-b08f-359ddfdcceae None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:10.441980 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38b6d0-976c-45cd-b08f-359ddfdcceae None admin] PATH_INFO: `/v3/users/9ae38e0d0307468f8c5a1cb91a4b71bc` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:10.443143 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e38b6d0-976c-45cd-b08f-359ddfdcceae None admin] RBAC: Authorizing `identity:get_user(user_id=9ae38e0d0307468f8c5a1cb91a4b71bc)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:10.444590 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e38b6d0-976c-45cd-b08f-359ddfdcceae None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:10.447305 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 170/333] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 01:17:10 2022] GET /identity/v3/users/9ae38e0d0307468f8c5a1cb91a4b71bc => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:10.452797 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b647be21-eb7f-4ba8-b3b1-f9236e213c24 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:10.526472 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:10.574972 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b647be21-eb7f-4ba8-b3b1-f9236e213c24 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:10.611459 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f50ed2e-34c3-4144-ae74-e7ea252e7a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:10.612082 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f50ed2e-34c3-4144-ae74-e7ea252e7a71 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:10.612350 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f50ed2e-34c3-4144-ae74-e7ea252e7a71 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:10.612627 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f50ed2e-34c3-4144-ae74-e7ea252e7a71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:10.613361 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f50ed2e-34c3-4144-ae74-e7ea252e7a71 None admin] RBAC: Adding query filter params (role.id=13af81971c1c428eae0a571a22ea583d, user.id=9ae38e0d0307468f8c5a1cb91a4b71bc, scope.system=all) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:10.613666 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f50ed2e-34c3-4144-ae74-e7ea252e7a71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:10.615254 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f50ed2e-34c3-4144-ae74-e7ea252e7a71 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:10.629373 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 164/334] 10.222.0.26 () {56 vars in 1308 bytes} [Fri Aug 12 01:17:10 2022] GET /identity/v3/role_assignments?user.id=9ae38e0d0307468f8c5a1cb91a4b71bc&scope.system=all&role.id=13af81971c1c428eae0a571a22ea583d => generated 510 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:17:12.423215 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a0d34-e46a-4825-b46b-f560980d40e0 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:12.424227 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a0d34-e46a-4825-b46b-f560980d40e0 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:12.424718 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a0d34-e46a-4825-b46b-f560980d40e0 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:12.426306 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 171/335] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:17:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:17:12.440184 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac1710-b3a6-4213-9525-57a310867950 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:12.441113 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac1710-b3a6-4213-9525-57a310867950 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:12.441574 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac1710-b3a6-4213-9525-57a310867950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:12.461610 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50bcee-d301-4ed7-a33a-a4cb0fc7a793 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:12.461610 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50bcee-d301-4ed7-a33a-a4cb0fc7a793 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:12.461610 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50bcee-d301-4ed7-a33a-a4cb0fc7a793 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:12.461610 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 172/336] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:17:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:17:12.466893 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf02d61-4beb-4dfb-aaaa-8863d5336493 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:12.467170 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf02d61-4beb-4dfb-aaaa-8863d5336493 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:12.467436 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf02d61-4beb-4dfb-aaaa-8863d5336493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:12.467712 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-d1ac1710-b3a6-4213-9525-57a310867950 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:17:12.469103 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-d1ac1710-b3a6-4213-9525-57a310867950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:17:12.505291 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-cdf02d61-4beb-4dfb-aaaa-8863d5336493 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:17:12.510688 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-cdf02d61-4beb-4dfb-aaaa-8863d5336493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:17:12.579141 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 165/337] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:17:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 01:17:12.580229 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d876eb86-a9bb-4df8-81ff-85d68b9f633f None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:12.580505 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d876eb86-a9bb-4df8-81ff-85d68b9f633f None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:12.580769 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d876eb86-a9bb-4df8-81ff-85d68b9f633f None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:12.583130 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 166/338] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:17:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:17:12.589645 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ae0fe-2da7-4c39-8fa9-6a66df957838 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:12.589915 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ae0fe-2da7-4c39-8fa9-6a66df957838 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:12.590201 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ae0fe-2da7-4c39-8fa9-6a66df957838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:12.636748 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-945ae0fe-2da7-4c39-8fa9-6a66df957838 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:17:12.637960 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-945ae0fe-2da7-4c39-8fa9-6a66df957838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:17:12.677741 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 173/339] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:17:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 01:17:12.723552 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:12.743644 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 167/340] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:17:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 01:17:13.011934 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf02d61-4beb-4dfb-aaaa-8863d5336493 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:13.053369 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ae0fe-2da7-4c39-8fa9-6a66df957838 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:13.172384 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:13.183671 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf02d61-4beb-4dfb-aaaa-8863d5336493 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:13.219308 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ae0fe-2da7-4c39-8fa9-6a66df957838 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:13.240170 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cd945e-45a1-40a2-908c-fa60a6ed1461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:13.240806 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cd945e-45a1-40a2-908c-fa60a6ed1461 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:13.241077 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cd945e-45a1-40a2-908c-fa60a6ed1461 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:13.241343 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cd945e-45a1-40a2-908c-fa60a6ed1461 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:13.258617 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cd945e-45a1-40a2-908c-fa60a6ed1461 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:17:13.261181 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27b6c1c-047f-4e0f-a7ab-5863ac204646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:13.262100 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b6c1c-047f-4e0f-a7ab-5863ac204646 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:13.262578 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b6c1c-047f-4e0f-a7ab-5863ac204646 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:13.263055 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b6c1c-047f-4e0f-a7ab-5863ac204646 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:13.263369 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-c9cd945e-45a1-40a2-908c-fa60a6ed1461 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 01:17:13.263369 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:13.263369 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:13.263369 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:13.263369 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:13.263369 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:13.263369 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:13.263369 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:13.263369 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:13.263369 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:13.263369 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:13.263369 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:13.263369 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:17:13.263369 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:17:13.263369 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:17:13.263369 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:17:13.264204 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:17:13.264204 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:17:13.264204 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:17:13.264204 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:17:13.264204 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:13.264204 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:13.264204 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:13.264204 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:13.264204 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:13.264204 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:13.264204 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:13.264204 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:13.264204 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:13.264204 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:13.264204 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:13.264204 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:13.264989 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:13.264989 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:13.264989 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:13.264989 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:13.264989 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:17:13.264989 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:17:13.264989 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:17:13.264989 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:17:13.264989 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:17:13.264989 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:17:13.264989 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 01:17:13.264989 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:17:13.264989 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 174/341] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Aug 12 01:17:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:13.265625 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cd945e-45a1-40a2-908c-fa60a6ed1461 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:13.279252 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27b6c1c-047f-4e0f-a7ab-5863ac204646 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:17:13.285435 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-e27b6c1c-047f-4e0f-a7ab-5863ac204646 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 01:17:13.285435 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:13.285435 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:13.285435 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:13.285435 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:13.285435 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:13.285435 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:13.285435 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:13.285435 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:13.285435 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:13.285435 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:13.285435 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:13.285435 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:17:13.285435 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:17:13.285435 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:17:13.285435 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:17:13.286392 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:17:13.286392 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:17:13.286392 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:17:13.286392 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:17:13.286392 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:13.286392 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:13.286392 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:13.286392 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:13.286392 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:13.286392 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:13.286392 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:13.286392 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:13.286392 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:13.286392 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:13.286392 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:13.286392 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:13.287167 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:13.287167 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:13.287167 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:13.287167 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:13.287167 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:17:13.287167 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:17:13.287167 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:17:13.287167 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:17:13.287167 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:17:13.287167 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:17:13.287167 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 01:17:13.287167 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:17:13.289466 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 168/342] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 01:17:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 01:17:13.290922 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf571883-41f4-4be6-9a97-4149c99971be None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:13.291371 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf571883-41f4-4be6-9a97-4149c99971be None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:13.291834 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf571883-41f4-4be6-9a97-4149c99971be None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:13.293082 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 169/343] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:17:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:17:13.294096 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf571883-41f4-4be6-9a97-4149c99971be None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:13.336433 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:13.396575 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cd945e-45a1-40a2-908c-fa60a6ed1461 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:13.403186 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf571883-41f4-4be6-9a97-4149c99971be None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:13.444495 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d0211d-a751-414e-9e07-a158cd67b9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:13.445639 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f80e11-27df-4b3d-9ac3-43370d9771b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:13.445639 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f80e11-27df-4b3d-9ac3-43370d9771b9 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:13.446098 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f80e11-27df-4b3d-9ac3-43370d9771b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:13.446197 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f80e11-27df-4b3d-9ac3-43370d9771b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:13.447066 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0211d-a751-414e-9e07-a158cd67b9b6 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:13.447174 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f80e11-27df-4b3d-9ac3-43370d9771b9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:13.447528 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f80e11-27df-4b3d-9ac3-43370d9771b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:13.447693 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0211d-a751-414e-9e07-a158cd67b9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:13.448101 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0211d-a751-414e-9e07-a158cd67b9b6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:13.449308 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f80e11-27df-4b3d-9ac3-43370d9771b9 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:13.459664 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 170/344] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 01:17:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:13.460573 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f80e11-27df-4b3d-9ac3-43370d9771b9 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:13.463762 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d0211d-a751-414e-9e07-a158cd67b9b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:17:13.470430 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-89d0211d-a751-414e-9e07-a158cd67b9b6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 01:17:13.470430 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:13.470430 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:13.470430 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:13.470430 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:13.470430 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:13.470430 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:13.470430 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:13.470430 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:13.470430 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:13.470430 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:13.470430 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:13.470430 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:17:13.470430 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:17:13.470430 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:17:13.470430 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:17:13.471341 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:17:13.471341 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:17:13.471341 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:17:13.471341 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:17:13.471341 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:13.471341 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:13.471341 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:13.471341 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:13.471341 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:13.471341 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:13.471341 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:13.471341 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:13.471341 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:13.471341 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:13.471341 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:13.471341 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:13.472144 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:13.472144 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:13.472144 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:13.472144 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:13.472144 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:17:13.472144 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:17:13.472144 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:17:13.472144 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:17:13.472144 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:17:13.472144 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:17:13.472144 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 12 01:17:13.472144 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:17:13.475641 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 175/345] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 01:17:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:13.478507 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea051c53-c7cf-4610-b91e-db2edf785296 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:13.478948 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea051c53-c7cf-4610-b91e-db2edf785296 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:13.479394 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea051c53-c7cf-4610-b91e-db2edf785296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:13.507236 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-ea051c53-c7cf-4610-b91e-db2edf785296 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:17:13.510283 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-ea051c53-c7cf-4610-b91e-db2edf785296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:17:13.520417 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:13.598564 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:13.601896 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 176/346] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:17:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 01:17:13.602025 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f80e11-27df-4b3d-9ac3-43370d9771b9 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:13.602471 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea051c53-c7cf-4610-b91e-db2edf785296 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:13.654355 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad46f8-c721-49b0-a08f-17f8f34c5d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:13.655001 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad46f8-c721-49b0-a08f-17f8f34c5d01 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:13.655276 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad46f8-c721-49b0-a08f-17f8f34c5d01 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:13.655545 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad46f8-c721-49b0-a08f-17f8f34c5d01 None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:13.656225 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ad46f8-c721-49b0-a08f-17f8f34c5d01 None admin] RBAC: Adding query filter params (name=member) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:13.656526 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ad46f8-c721-49b0-a08f-17f8f34c5d01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:13.657938 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ad46f8-c721-49b0-a08f-17f8f34c5d01 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:13.667258 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 171/347] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Aug 12 01:17:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:13.668754 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad46f8-c721-49b0-a08f-17f8f34c5d01 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:13.741235 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea051c53-c7cf-4610-b91e-db2edf785296 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:13.781065 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1db275b-11ba-41e4-b189-83a962c4b976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:13.781709 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db275b-11ba-41e4-b189-83a962c4b976 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:13.781991 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db275b-11ba-41e4-b189-83a962c4b976 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:13.782285 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db275b-11ba-41e4-b189-83a962c4b976 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:13.795479 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:13.800614 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad46f8-c721-49b0-a08f-17f8f34c5d01 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:13.851856 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84962de4-b8c9-40c9-b74a-8445cedd477e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:13.853304 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84962de4-b8c9-40c9-b74a-8445cedd477e None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:13.854290 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84962de4-b8c9-40c9-b74a-8445cedd477e None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:13.854572 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84962de4-b8c9-40c9-b74a-8445cedd477e None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:13.855253 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84962de4-b8c9-40c9-b74a-8445cedd477e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:13.855561 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84962de4-b8c9-40c9-b74a-8445cedd477e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:13.856946 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84962de4-b8c9-40c9-b74a-8445cedd477e None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:13.869531 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 172/348] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Aug 12 01:17:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:13.870377 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84962de4-b8c9-40c9-b74a-8445cedd477e None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:13.881917 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1db275b-11ba-41e4-b189-83a962c4b976 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:13.883585 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1db275b-11ba-41e4-b189-83a962c4b976 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:13.902171 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:13.988129 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84962de4-b8c9-40c9-b74a-8445cedd477e None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:14.034976 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e047fa85-e614-4fd0-9d88-89e7d18b90be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:14.035516 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e047fa85-e614-4fd0-9d88-89e7d18b90be None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:14.035824 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e047fa85-e614-4fd0-9d88-89e7d18b90be None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:14.036067 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e047fa85-e614-4fd0-9d88-89e7d18b90be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:14.078327 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 177/349] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 01:17:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 01:17:14.079216 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1db275b-11ba-41e4-b189-83a962c4b976 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:14.126360 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:14.151772 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e047fa85-e614-4fd0-9d88-89e7d18b90be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:14.153238 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e047fa85-e614-4fd0-9d88-89e7d18b90be None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:14.182724 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:14.196741 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1db275b-11ba-41e4-b189-83a962c4b976 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:14.241760 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c34bf7-2979-4b09-b4e3-cbf92856249f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:14.242426 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c34bf7-2979-4b09-b4e3-cbf92856249f None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:14.242704 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c34bf7-2979-4b09-b4e3-cbf92856249f None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:14.242973 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c34bf7-2979-4b09-b4e3-cbf92856249f None admin] PATH_INFO: `/v3/users/02fa2fe54a624e3797a61d4f37bae20e` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:14.244177 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c34bf7-2979-4b09-b4e3-cbf92856249f None admin] RBAC: Authorizing `identity:get_user(user_id=02fa2fe54a624e3797a61d4f37bae20e)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:14.245996 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c34bf7-2979-4b09-b4e3-cbf92856249f None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:14.248447 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 178/350] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 01:17:14 2022] GET /identity/v3/users/02fa2fe54a624e3797a61d4f37bae20e => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:14.254506 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c34bf7-2979-4b09-b4e3-cbf92856249f None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:14.285924 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 173/351] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 01:17:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 01:17:14.286760 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e047fa85-e614-4fd0-9d88-89e7d18b90be None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:14.386840 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c34bf7-2979-4b09-b4e3-cbf92856249f None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:14.400081 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:14.420358 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e047fa85-e614-4fd0-9d88-89e7d18b90be None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:14.437878 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f664b6-6b0c-4d0e-9fb2-f0819449970f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:14.438560 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f664b6-6b0c-4d0e-9fb2-f0819449970f None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:14.439220 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f664b6-6b0c-4d0e-9fb2-f0819449970f None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:14.439220 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f664b6-6b0c-4d0e-9fb2-f0819449970f None admin] PATH_INFO: `/v3/projects/d979106c8a164d55aa33fdb5ea995c7a` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:14.440233 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f664b6-6b0c-4d0e-9fb2-f0819449970f None admin] RBAC: Authorizing `identity:get_project(project_id=d979106c8a164d55aa33fdb5ea995c7a)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:14.443061 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f664b6-6b0c-4d0e-9fb2-f0819449970f None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:14.450064 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 179/352] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 01:17:14 2022] GET /identity/v3/projects/d979106c8a164d55aa33fdb5ea995c7a => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:14.451394 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148a169-809b-41a1-9db7-b8f1d1a2346f None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:14.451679 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148a169-809b-41a1-9db7-b8f1d1a2346f None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:14.451949 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148a169-809b-41a1-9db7-b8f1d1a2346f None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:14.453247 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 180/353] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:17:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:17:14.453701 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:14.454071 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148a169-809b-41a1-9db7-b8f1d1a2346f None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:14.472489 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef859dd-0771-4c07-9f69-eabe3f3cac1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:14.473126 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef859dd-0771-4c07-9f69-eabe3f3cac1c None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:14.473396 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef859dd-0771-4c07-9f69-eabe3f3cac1c None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:14.473662 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef859dd-0771-4c07-9f69-eabe3f3cac1c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:14.486156 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef859dd-0771-4c07-9f69-eabe3f3cac1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:17:14.490253 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-cef859dd-0771-4c07-9f69-eabe3f3cac1c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 01:17:14.490253 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:14.490253 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:14.490253 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:14.490253 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:14.490253 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:14.490253 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:14.490253 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:14.490253 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:14.490253 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:14.490253 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:14.490253 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:14.490253 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:17:14.490253 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:17:14.490253 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:17:14.490253 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:17:14.491149 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:17:14.491149 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:17:14.491149 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:17:14.491149 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:17:14.491149 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:14.491149 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:14.491149 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:14.491149 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:14.491149 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:14.491149 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:14.491149 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:14.491149 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:14.491149 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:14.491149 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:14.491149 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:14.491149 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:14.493109 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:14.493109 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:14.493109 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:14.493109 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:14.493109 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:17:14.493109 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:17:14.493109 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:17:14.493109 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:17:14.493109 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:17:14.493109 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:17:14.493109 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 01:17:14.493109 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:17:14.493109 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 174/354] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 01:17:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:14.493109 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef859dd-0771-4c07-9f69-eabe3f3cac1c None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:14.617278 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef859dd-0771-4c07-9f69-eabe3f3cac1c None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:14.624753 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148a169-809b-41a1-9db7-b8f1d1a2346f None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:14.662345 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c7b2b-dcb9-420f-b8ad-0ec96b4d7c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:14.662996 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c7b2b-dcb9-420f-b8ad-0ec96b4d7c9f None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:14.663315 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c7b2b-dcb9-420f-b8ad-0ec96b4d7c9f None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:14.663769 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c7b2b-dcb9-420f-b8ad-0ec96b4d7c9f None admin] PATH_INFO: `/v3/projects/d979106c8a164d55aa33fdb5ea995c7a` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:14.666262 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477c7b2b-dcb9-420f-b8ad-0ec96b4d7c9f None admin] RBAC: Authorizing `identity:get_project(project_id=d979106c8a164d55aa33fdb5ea995c7a)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:14.666388 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0920957-77e7-4c89-9ec5-cf9689b6acd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:14.666813 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0920957-77e7-4c89-9ec5-cf9689b6acd6 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:14.667003 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477c7b2b-dcb9-420f-b8ad-0ec96b4d7c9f None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:14.667108 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0920957-77e7-4c89-9ec5-cf9689b6acd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:14.667337 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0920957-77e7-4c89-9ec5-cf9689b6acd6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:14.668058 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0920957-77e7-4c89-9ec5-cf9689b6acd6 None admin] RBAC: Adding query filter params (role.id=d3ac26b4075941a7a84580ef43d093f6, user.id=02fa2fe54a624e3797a61d4f37bae20e, scope.system=all) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:14.668688 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0920957-77e7-4c89-9ec5-cf9689b6acd6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:14.668944 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 175/355] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 01:17:14 2022] GET /identity/v3/projects/d979106c8a164d55aa33fdb5ea995c7a => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:14.669724 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c7b2b-dcb9-420f-b8ad-0ec96b4d7c9f None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:14.670090 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0920957-77e7-4c89-9ec5-cf9689b6acd6 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:14.685569 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 181/356] 10.222.0.26 () {56 vars in 1308 bytes} [Fri Aug 12 01:17:14 2022] GET /identity/v3/role_assignments?user.id=02fa2fe54a624e3797a61d4f37bae20e&scope.system=all&role.id=d3ac26b4075941a7a84580ef43d093f6 => generated 510 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:14.686887 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f65ce3-4b49-42e8-a328-c894d5c1b6b0 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:14.687179 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f65ce3-4b49-42e8-a328-c894d5c1b6b0 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:14.687452 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f65ce3-4b49-42e8-a328-c894d5c1b6b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:14.709856 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-b9f65ce3-4b49-42e8-a328-c894d5c1b6b0 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:17:14.711248 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-b9f65ce3-4b49-42e8-a328-c894d5c1b6b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:17:14.752964 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:14.758597 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:14.808397 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 182/357] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:17:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 01:17:14.814401 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f65ce3-4b49-42e8-a328-c894d5c1b6b0 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:14.821116 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c7b2b-dcb9-420f-b8ad-0ec96b4d7c9f None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:14.872144 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287c6e92-9e60-4f44-b321-de8276046584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:14.872724 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c6e92-9e60-4f44-b321-de8276046584 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:14.873019 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c6e92-9e60-4f44-b321-de8276046584 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:14.873285 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c6e92-9e60-4f44-b321-de8276046584 None admin] PATH_INFO: `/v3/groups/a9f36e31aa934f7bb325c0014e30e9be` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:14.880980 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287c6e92-9e60-4f44-b321-de8276046584 None admin] RBAC: Authorizing `identity:get_group(group_id=a9f36e31aa934f7bb325c0014e30e9be)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:14.882608 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287c6e92-9e60-4f44-b321-de8276046584 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:14.884405 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 176/358] 10.222.0.26 () {56 vars in 1180 bytes} [Fri Aug 12 01:17:14 2022] GET /identity/v3/groups/a9f36e31aa934f7bb325c0014e30e9be => generated 226 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:14.885410 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a009fe9-d0a9-4bae-86d2-69e43797b2d0 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:14.885657 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a009fe9-d0a9-4bae-86d2-69e43797b2d0 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:14.885920 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a009fe9-d0a9-4bae-86d2-69e43797b2d0 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:14.887273 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 177/359] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:17:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:17:14.890151 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a009fe9-d0a9-4bae-86d2-69e43797b2d0 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:14.949059 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f65ce3-4b49-42e8-a328-c894d5c1b6b0 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:14.993179 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefe6d5f-faa8-4a31-b57f-ebfa1bb0aa29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:14.994255 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe6d5f-faa8-4a31-b57f-ebfa1bb0aa29 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:14.994802 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe6d5f-faa8-4a31-b57f-ebfa1bb0aa29 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:14.995554 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe6d5f-faa8-4a31-b57f-ebfa1bb0aa29 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:14.996387 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefe6d5f-faa8-4a31-b57f-ebfa1bb0aa29 None admin] RBAC: Adding query filter params (name=member) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:14.997135 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefe6d5f-faa8-4a31-b57f-ebfa1bb0aa29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:14.999227 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefe6d5f-faa8-4a31-b57f-ebfa1bb0aa29 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:15.010454 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 183/360] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Aug 12 01:17:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:15.011493 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefe6d5f-faa8-4a31-b57f-ebfa1bb0aa29 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:15.029626 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a009fe9-d0a9-4bae-86d2-69e43797b2d0 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:15.046395 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:15.050705 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:15.082304 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7540e0d9-57f2-4db7-b80f-d51018565f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:15.083324 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540e0d9-57f2-4db7-b80f-d51018565f91 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:15.083819 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540e0d9-57f2-4db7-b80f-d51018565f91 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:15.084292 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540e0d9-57f2-4db7-b80f-d51018565f91 None admin] PATH_INFO: `/v3/groups/a9f36e31aa934f7bb325c0014e30e9be` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:15.085824 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7540e0d9-57f2-4db7-b80f-d51018565f91 None admin] RBAC: Authorizing `identity:get_group(group_id=a9f36e31aa934f7bb325c0014e30e9be)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:15.087516 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7540e0d9-57f2-4db7-b80f-d51018565f91 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:15.089361 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 178/361] 10.222.0.26 () {56 vars in 1180 bytes} [Fri Aug 12 01:17:14 2022] GET /identity/v3/groups/a9f36e31aa934f7bb325c0014e30e9be => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:15.090767 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d0183f-fc02-4ef6-ad7f-43906ad21864 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:15.091263 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d0183f-fc02-4ef6-ad7f-43906ad21864 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:15.091726 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d0183f-fc02-4ef6-ad7f-43906ad21864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:15.110838 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-30d0183f-fc02-4ef6-ad7f-43906ad21864 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:17:15.112338 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-30d0183f-fc02-4ef6-ad7f-43906ad21864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:17:15.142807 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefe6d5f-faa8-4a31-b57f-ebfa1bb0aa29 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:15.182654 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8ff843-c082-4f8d-ac66-712bdd4213a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:15.183488 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ff843-c082-4f8d-ac66-712bdd4213a0 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:15.183617 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ff843-c082-4f8d-ac66-712bdd4213a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:15.183790 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ff843-c082-4f8d-ac66-712bdd4213a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:15.184493 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8ff843-c082-4f8d-ac66-712bdd4213a0 None admin] RBAC: Adding query filter params (group.id=a9f36e31aa934f7bb325c0014e30e9be, role.id=bab2af60c26640acbd0c4db2f9796cfb, scope.project.id=d979106c8a164d55aa33fdb5ea995c7a) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:15.184791 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8ff843-c082-4f8d-ac66-712bdd4213a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:15.186242 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8ff843-c082-4f8d-ac66-712bdd4213a0 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:15.190233 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 179/362] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:17:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 01:17:15.191083 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d0183f-fc02-4ef6-ad7f-43906ad21864 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:15.192514 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 184/363] 10.222.0.26 () {56 vars in 1376 bytes} [Fri Aug 12 01:17:15 2022] GET /identity/v3/role_assignments?group.id=a9f36e31aa934f7bb325c0014e30e9be&scope.project.id=d979106c8a164d55aa33fdb5ea995c7a&role.id=bab2af60c26640acbd0c4db2f9796cfb => generated 260 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:15.193498 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8ff843-c082-4f8d-ac66-712bdd4213a0 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:15.340646 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d0183f-fc02-4ef6-ad7f-43906ad21864 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:15.341755 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:15.352720 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8ff843-c082-4f8d-ac66-712bdd4213a0 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:15.366106 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:15.403184 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e4b3b-d5c0-4a70-a317-1719c3bbe509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:15.404731 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e4b3b-d5c0-4a70-a317-1719c3bbe509 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:15.405297 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e4b3b-d5c0-4a70-a317-1719c3bbe509 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:15.405829 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e4b3b-d5c0-4a70-a317-1719c3bbe509 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:15.408518 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe92e3a-653f-4ec2-b064-053a1ff042f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:15.409208 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe92e3a-653f-4ec2-b064-053a1ff042f9 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:15.409543 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe92e3a-653f-4ec2-b064-053a1ff042f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:15.409905 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe92e3a-653f-4ec2-b064-053a1ff042f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:15.410698 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe92e3a-653f-4ec2-b064-053a1ff042f9 None admin] RBAC: Adding query filter params (group.id=a9f36e31aa934f7bb325c0014e30e9be, role.id=13af81971c1c428eae0a571a22ea583d, scope.project.id=d979106c8a164d55aa33fdb5ea995c7a) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:15.411064 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe92e3a-653f-4ec2-b064-053a1ff042f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:15.412579 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe92e3a-653f-4ec2-b064-053a1ff042f9 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:15.422669 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 185/364] 10.222.0.26 () {56 vars in 1376 bytes} [Fri Aug 12 01:17:15 2022] GET /identity/v3/role_assignments?group.id=a9f36e31aa934f7bb325c0014e30e9be&scope.project.id=d979106c8a164d55aa33fdb5ea995c7a&role.id=13af81971c1c428eae0a571a22ea583d => generated 260 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:15.423654 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe92e3a-653f-4ec2-b064-053a1ff042f9 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:15.491858 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0e4b3b-d5c0-4a70-a317-1719c3bbe509 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:15.494069 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0e4b3b-d5c0-4a70-a317-1719c3bbe509 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:15.548682 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe92e3a-653f-4ec2-b064-053a1ff042f9 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:15.589597 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0d84dc-e4cd-411d-8bb4-e258a1666fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:15.590287 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d84dc-e4cd-411d-8bb4-e258a1666fbb None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:15.590561 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d84dc-e4cd-411d-8bb4-e258a1666fbb None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:15.590830 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d84dc-e4cd-411d-8bb4-e258a1666fbb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:15.604774 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0d84dc-e4cd-411d-8bb4-e258a1666fbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:17:15.610093 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-eb0d84dc-e4cd-411d-8bb4-e258a1666fbb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 01:17:15.610093 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:15.610093 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:15.610093 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:15.610093 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:15.610093 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:15.610093 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:15.610093 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:15.610093 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:15.610093 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:15.610093 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:15.610093 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:15.610093 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:17:15.610093 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:17:15.610093 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:17:15.610093 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:17:15.611037 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:17:15.611037 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:17:15.611037 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:17:15.611037 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:17:15.611037 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:15.611037 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:15.611037 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:15.611037 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:15.611037 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:15.611037 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:15.611037 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:15.611037 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:15.611037 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:15.611037 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:15.611037 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:15.611037 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:15.611823 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:15.611823 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:15.611823 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:15.611823 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:15.611823 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:17:15.611823 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:17:15.611823 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:17:15.611823 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:17:15.611823 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:17:15.611823 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:17:15.611823 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 01:17:15.611823 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:17:15.616350 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 186/365] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Aug 12 01:17:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:15.617693 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0d84dc-e4cd-411d-8bb4-e258a1666fbb None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:15.623801 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 180/366] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 01:17:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 01:17:15.625077 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e4b3b-d5c0-4a70-a317-1719c3bbe509 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:15.639009 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:15.643030 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:15.734538 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0d84dc-e4cd-411d-8bb4-e258a1666fbb None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:15.740835 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e4b3b-d5c0-4a70-a317-1719c3bbe509 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:15.771396 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb9bebc-90ff-4a2c-a9e1-054cbb1435c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:15.772269 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb9bebc-90ff-4a2c-a9e1-054cbb1435c4 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:15.772760 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb9bebc-90ff-4a2c-a9e1-054cbb1435c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:15.773176 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb9bebc-90ff-4a2c-a9e1-054cbb1435c4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:15.781364 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e4dbbd-73d4-4880-b2db-266a2b6926f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:15.782081 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e4dbbd-73d4-4880-b2db-266a2b6926f0 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:15.782383 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e4dbbd-73d4-4880-b2db-266a2b6926f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:15.782659 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e4dbbd-73d4-4880-b2db-266a2b6926f0 None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:15.783340 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e4dbbd-73d4-4880-b2db-266a2b6926f0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:15.783646 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e4dbbd-73d4-4880-b2db-266a2b6926f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:15.785076 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e4dbbd-73d4-4880-b2db-266a2b6926f0 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:15.785720 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb9bebc-90ff-4a2c-a9e1-054cbb1435c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:17:15.791393 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-bbb9bebc-90ff-4a2c-a9e1-054cbb1435c4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 01:17:15.791393 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:15.791393 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:15.791393 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:15.791393 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:15.791393 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:15.791393 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:15.791393 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:15.791393 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:15.791393 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:15.791393 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:15.791393 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:15.791393 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:17:15.791393 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:17:15.791393 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:17:15.791393 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:17:15.792322 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:17:15.792322 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:17:15.792322 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:17:15.792322 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:17:15.792322 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:15.792322 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:15.792322 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:15.792322 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:15.792322 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:15.792322 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:15.792322 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:15.792322 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:15.792322 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:15.792322 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:15.792322 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:15.792322 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:15.793414 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:15.793414 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:15.793414 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:15.793414 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:15.793414 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:17:15.793414 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:17:15.793414 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:17:15.793414 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:17:15.793414 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:17:15.793414 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:17:15.793414 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 01:17:15.793414 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:17:15.795596 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 181/367] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 01:17:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:15.796366 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 187/368] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Aug 12 01:17:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:15.801092 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb9bebc-90ff-4a2c-a9e1-054cbb1435c4 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:15.802356 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e4dbbd-73d4-4880-b2db-266a2b6926f0 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:15.882030 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:15.901351 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:15.906046 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb9bebc-90ff-4a2c-a9e1-054cbb1435c4 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:15.931608 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e4dbbd-73d4-4880-b2db-266a2b6926f0 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:15.942002 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1125975c-ab2d-433f-880e-cc5aa4536179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:15.942837 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1125975c-ab2d-433f-880e-cc5aa4536179 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:15.943277 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1125975c-ab2d-433f-880e-cc5aa4536179 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:15.943685 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1125975c-ab2d-433f-880e-cc5aa4536179 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:15.968535 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1d7f7b-d245-4fbe-b00b-1e7def7b47f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:15.969314 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d7f7b-d245-4fbe-b00b-1e7def7b47f6 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:15.969780 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d7f7b-d245-4fbe-b00b-1e7def7b47f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:15.970196 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d7f7b-d245-4fbe-b00b-1e7def7b47f6 None admin] PATH_INFO: `/v3/projects/45a8fcf9582d42ccaffc8d521078eab0` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:15.971769 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1d7f7b-d245-4fbe-b00b-1e7def7b47f6 None admin] RBAC: Authorizing `identity:get_project(project_id=45a8fcf9582d42ccaffc8d521078eab0)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:15.973475 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1d7f7b-d245-4fbe-b00b-1e7def7b47f6 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:15.976025 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 182/369] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 01:17:15 2022] GET /identity/v3/projects/45a8fcf9582d42ccaffc8d521078eab0 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:15.977075 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1d7f7b-d245-4fbe-b00b-1e7def7b47f6 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:16.016842 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1125975c-ab2d-433f-880e-cc5aa4536179 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:16.018364 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1125975c-ab2d-433f-880e-cc5aa4536179 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:16.097820 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:16.106988 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1d7f7b-d245-4fbe-b00b-1e7def7b47f6 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:16.124123 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 188/370] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 01:17:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 12 01:17:16.124990 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1125975c-ab2d-433f-880e-cc5aa4536179 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:16.153008 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b5b02-ed4c-4736-b6be-5adf25d99d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:16.153871 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b5b02-ed4c-4736-b6be-5adf25d99d3a None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:16.154199 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b5b02-ed4c-4736-b6be-5adf25d99d3a None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:16.154915 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b5b02-ed4c-4736-b6be-5adf25d99d3a None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:16.155852 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386b5b02-ed4c-4736-b6be-5adf25d99d3a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:16.156166 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386b5b02-ed4c-4736-b6be-5adf25d99d3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:16.157555 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386b5b02-ed4c-4736-b6be-5adf25d99d3a None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:16.169746 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 183/371] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 01:17:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:16.174734 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b5b02-ed4c-4736-b6be-5adf25d99d3a None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:16.187392 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:16.246023 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1125975c-ab2d-433f-880e-cc5aa4536179 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:16.293466 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c46ee1-8b60-45f9-a439-4e48855603a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:16.294032 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c46ee1-8b60-45f9-a439-4e48855603a0 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:16.294591 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c46ee1-8b60-45f9-a439-4e48855603a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:16.294867 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c46ee1-8b60-45f9-a439-4e48855603a0 None admin] PATH_INFO: `/v3/groups/a9f36e31aa934f7bb325c0014e30e9be` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:16.296671 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c46ee1-8b60-45f9-a439-4e48855603a0 None admin] RBAC: Authorizing `identity:get_group(group_id=a9f36e31aa934f7bb325c0014e30e9be)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:16.298784 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c46ee1-8b60-45f9-a439-4e48855603a0 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:16.301536 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 189/372] 10.222.0.26 () {56 vars in 1180 bytes} [Fri Aug 12 01:17:16 2022] GET /identity/v3/groups/a9f36e31aa934f7bb325c0014e30e9be => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:16.302681 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c46ee1-8b60-45f9-a439-4e48855603a0 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:16.304859 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b5b02-ed4c-4736-b6be-5adf25d99d3a None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:16.343903 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef08ed8-7524-40ab-9268-5087aec64ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:16.344559 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef08ed8-7524-40ab-9268-5087aec64ddf None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:16.344835 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef08ed8-7524-40ab-9268-5087aec64ddf None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:16.345103 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef08ed8-7524-40ab-9268-5087aec64ddf None admin] PATH_INFO: `/v3/projects/45a8fcf9582d42ccaffc8d521078eab0` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:16.346484 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef08ed8-7524-40ab-9268-5087aec64ddf None admin] RBAC: Authorizing `identity:get_project(project_id=45a8fcf9582d42ccaffc8d521078eab0)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:16.347982 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef08ed8-7524-40ab-9268-5087aec64ddf None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:16.349840 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 184/373] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 01:17:16 2022] GET /identity/v3/projects/45a8fcf9582d42ccaffc8d521078eab0 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:16.350550 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef08ed8-7524-40ab-9268-5087aec64ddf None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:16.361139 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:16.446599 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:16.448007 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c46ee1-8b60-45f9-a439-4e48855603a0 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:16.483801 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef08ed8-7524-40ab-9268-5087aec64ddf None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:16.502805 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164815ed-0bac-41f9-8268-0c09c297d437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:16.503688 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164815ed-0bac-41f9-8268-0c09c297d437 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:16.504108 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164815ed-0bac-41f9-8268-0c09c297d437 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:16.504537 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164815ed-0bac-41f9-8268-0c09c297d437 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:16.534455 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad5175c-ebde-4e47-9755-48640f1f4893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:16.535084 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad5175c-ebde-4e47-9755-48640f1f4893 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:16.535347 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad5175c-ebde-4e47-9755-48640f1f4893 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:16.535614 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad5175c-ebde-4e47-9755-48640f1f4893 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:16.536343 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad5175c-ebde-4e47-9755-48640f1f4893 None admin] RBAC: Adding query filter params (group.id=a9f36e31aa934f7bb325c0014e30e9be, role.id=13af81971c1c428eae0a571a22ea583d, scope.project.id=45a8fcf9582d42ccaffc8d521078eab0) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:16.536643 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad5175c-ebde-4e47-9755-48640f1f4893 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:16.538159 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad5175c-ebde-4e47-9755-48640f1f4893 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:16.546186 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 185/374] 10.222.0.26 () {56 vars in 1376 bytes} [Fri Aug 12 01:17:16 2022] GET /identity/v3/role_assignments?group.id=a9f36e31aa934f7bb325c0014e30e9be&scope.project.id=45a8fcf9582d42ccaffc8d521078eab0&role.id=13af81971c1c428eae0a571a22ea583d => generated 260 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:16.551122 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad5175c-ebde-4e47-9755-48640f1f4893 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:16.609191 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164815ed-0bac-41f9-8268-0c09c297d437 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:16.611486 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164815ed-0bac-41f9-8268-0c09c297d437 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:16.692431 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:16.753593 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad5175c-ebde-4e47-9755-48640f1f4893 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:16.804707 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 190/375] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 01:17:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 01:17:16.808722 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b05f55f-6eb5-49a9-ac43-412e7bd8e5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:16.809554 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b05f55f-6eb5-49a9-ac43-412e7bd8e5a0 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:16.810605 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164815ed-0bac-41f9-8268-0c09c297d437 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:16.813109 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b05f55f-6eb5-49a9-ac43-412e7bd8e5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:16.813542 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b05f55f-6eb5-49a9-ac43-412e7bd8e5a0 None admin] PATH_INFO: `/v3/groups/a9f36e31aa934f7bb325c0014e30e9be` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:16.814936 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b05f55f-6eb5-49a9-ac43-412e7bd8e5a0 None admin] RBAC: Authorizing `identity:get_group(group_id=a9f36e31aa934f7bb325c0014e30e9be)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:16.818262 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b05f55f-6eb5-49a9-ac43-412e7bd8e5a0 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:16.825495 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 186/376] 10.222.0.26 () {56 vars in 1180 bytes} [Fri Aug 12 01:17:16 2022] GET /identity/v3/groups/a9f36e31aa934f7bb325c0014e30e9be => generated 226 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:16.831063 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b05f55f-6eb5-49a9-ac43-412e7bd8e5a0 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:16.844333 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:17.009503 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b05f55f-6eb5-49a9-ac43-412e7bd8e5a0 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:17.016075 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164815ed-0bac-41f9-8268-0c09c297d437 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:17.061238 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227cac3c-2544-4059-9298-fe806cd29a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:17.062081 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227cac3c-2544-4059-9298-fe806cd29a08 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:17.062514 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227cac3c-2544-4059-9298-fe806cd29a08 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:17.064055 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227cac3c-2544-4059-9298-fe806cd29a08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:17.064935 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227cac3c-2544-4059-9298-fe806cd29a08 None admin] RBAC: Adding query filter params (group.id=a9f36e31aa934f7bb325c0014e30e9be, role.id=bab2af60c26640acbd0c4db2f9796cfb, scope.project.id=45a8fcf9582d42ccaffc8d521078eab0) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:17.065639 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227cac3c-2544-4059-9298-fe806cd29a08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:17.068581 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227cac3c-2544-4059-9298-fe806cd29a08 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:17.081082 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 187/377] 10.222.0.26 () {56 vars in 1376 bytes} [Fri Aug 12 01:17:16 2022] GET /identity/v3/role_assignments?group.id=a9f36e31aa934f7bb325c0014e30e9be&scope.project.id=45a8fcf9582d42ccaffc8d521078eab0&role.id=bab2af60c26640acbd0c4db2f9796cfb => generated 260 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:17:17.087161 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7068d1-60f2-4c36-a1a2-0f8ab38d9fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:17.088100 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7068d1-60f2-4c36-a1a2-0f8ab38d9fbf None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:17.088521 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7068d1-60f2-4c36-a1a2-0f8ab38d9fbf None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:17.088945 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7068d1-60f2-4c36-a1a2-0f8ab38d9fbf None admin] PATH_INFO: `/v3/projects/9f7a63ab9a434ddfb7cb138101d2e804` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:17.090368 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7068d1-60f2-4c36-a1a2-0f8ab38d9fbf None admin] RBAC: Authorizing `identity:get_project(project_id=9f7a63ab9a434ddfb7cb138101d2e804)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:17.092073 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7068d1-60f2-4c36-a1a2-0f8ab38d9fbf None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:17.094326 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 191/378] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 01:17:16 2022] GET /identity/v3/projects/9f7a63ab9a434ddfb7cb138101d2e804 => generated 344 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:17.100333 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227cac3c-2544-4059-9298-fe806cd29a08 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:17.183318 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:17.225891 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227cac3c-2544-4059-9298-fe806cd29a08 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:17.263609 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0609a7-26f1-485a-b4b2-689f7a0b22fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:17.264533 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0609a7-26f1-485a-b4b2-689f7a0b22fb None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:17.264969 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0609a7-26f1-485a-b4b2-689f7a0b22fb None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:17.265378 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0609a7-26f1-485a-b4b2-689f7a0b22fb None admin] PATH_INFO: `/v3/groups/62238f8dd2854ccca2a9c289420cec89` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:17.271329 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0609a7-26f1-485a-b4b2-689f7a0b22fb None admin] RBAC: Authorizing `identity:get_group(group_id=62238f8dd2854ccca2a9c289420cec89)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:17.273345 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0609a7-26f1-485a-b4b2-689f7a0b22fb None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:17.278511 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 188/379] 10.222.0.26 () {56 vars in 1180 bytes} [Fri Aug 12 01:17:17 2022] GET /identity/v3/groups/62238f8dd2854ccca2a9c289420cec89 => generated 229 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:17.282252 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7068d1-60f2-4c36-a1a2-0f8ab38d9fbf None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:17.302525 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:17.409989 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7068d1-60f2-4c36-a1a2-0f8ab38d9fbf None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:17.449609 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d2585e-45db-4634-9d4e-6b7b5a79b728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:17.450255 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2585e-45db-4634-9d4e-6b7b5a79b728 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:17.450535 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2585e-45db-4634-9d4e-6b7b5a79b728 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:17.450825 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2585e-45db-4634-9d4e-6b7b5a79b728 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:17.451544 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d2585e-45db-4634-9d4e-6b7b5a79b728 None admin] RBAC: Adding query filter params (group.id=62238f8dd2854ccca2a9c289420cec89, role.id=fb48693810be495fb4b1893a79429b78, scope.project.id=9f7a63ab9a434ddfb7cb138101d2e804) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:17.451779 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87089540-c4a5-4ca3-96ae-b70f2d9f891d None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:17.451881 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d2585e-45db-4634-9d4e-6b7b5a79b728 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:17.452350 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87089540-c4a5-4ca3-96ae-b70f2d9f891d None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:17.452807 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87089540-c4a5-4ca3-96ae-b70f2d9f891d None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:17.453300 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d2585e-45db-4634-9d4e-6b7b5a79b728 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:17.454806 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 189/380] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:17:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:17:17.460349 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b4cc98-b2d5-4e5a-97d4-5c8c9f675b80 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:17.460902 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b4cc98-b2d5-4e5a-97d4-5c8c9f675b80 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:17.461025 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 192/381] 10.222.0.26 () {56 vars in 1376 bytes} [Fri Aug 12 01:17:17 2022] GET /identity/v3/role_assignments?group.id=62238f8dd2854ccca2a9c289420cec89&scope.project.id=9f7a63ab9a434ddfb7cb138101d2e804&role.id=fb48693810be495fb4b1893a79429b78 => generated 260 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:17.461486 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b4cc98-b2d5-4e5a-97d4-5c8c9f675b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:17.493102 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-c7b4cc98-b2d5-4e5a-97d4-5c8c9f675b80 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:17:17.494619 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-c7b4cc98-b2d5-4e5a-97d4-5c8c9f675b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:17:17.579148 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 190/382] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:17:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 01:17:17.859033 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d2585e-45db-4634-9d4e-6b7b5a79b728 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:17.945917 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:17.974275 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d2585e-45db-4634-9d4e-6b7b5a79b728 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:17.993527 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99b074-414b-4ad1-8c54-9bc8b5036fed None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:17.993860 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99b074-414b-4ad1-8c54-9bc8b5036fed None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:17.994063 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99b074-414b-4ad1-8c54-9bc8b5036fed None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:17.995473 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 191/383] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:17:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 01:17:18.002169 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b3b4fa-381f-406b-87d2-a46af66a7b57 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:18.002742 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b3b4fa-381f-406b-87d2-a46af66a7b57 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:18.003224 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b3b4fa-381f-406b-87d2-a46af66a7b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:18.015441 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f980efd6-6a05-4579-8844-39d3cf111828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:18.016023 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f980efd6-6a05-4579-8844-39d3cf111828 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:18.016299 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f980efd6-6a05-4579-8844-39d3cf111828 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:18.016575 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f980efd6-6a05-4579-8844-39d3cf111828 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:18.031308 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-e6b3b4fa-381f-406b-87d2-a46af66a7b57 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:17:18.032822 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-e6b3b4fa-381f-406b-87d2-a46af66a7b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:17:18.035094 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f980efd6-6a05-4579-8844-39d3cf111828 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:17:18.040781 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-f980efd6-6a05-4579-8844-39d3cf111828 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 01:17:18.040781 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:18.040781 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:18.040781 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:18.040781 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:18.040781 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:18.040781 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:18.040781 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:18.040781 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:18.040781 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:18.040781 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:18.040781 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:18.040781 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:17:18.040781 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:17:18.040781 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:17:18.040781 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:17:18.041686 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:17:18.041686 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:17:18.041686 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:17:18.041686 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:17:18.041686 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:18.041686 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:18.041686 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:18.041686 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:18.041686 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:18.041686 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:18.041686 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:18.041686 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:18.041686 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:18.041686 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:18.041686 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:18.041686 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:18.042547 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:18.042547 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:18.042547 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:18.042547 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:18.042547 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:17:18.042547 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:17:18.042547 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:17:18.042547 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:17:18.042547 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:17:18.042547 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:17:18.042547 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 01:17:18.042547 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:17:18.044303 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 193/384] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Aug 12 01:17:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:18.048902 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f980efd6-6a05-4579-8844-39d3cf111828 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:18.158633 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:18.170597 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 192/385] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:17:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 01:17:18.200676 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f980efd6-6a05-4579-8844-39d3cf111828 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:18.245829 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5fef83-b745-4ca7-8e21-896c8e8d992d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:18.246854 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5fef83-b745-4ca7-8e21-896c8e8d992d None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:18.247349 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5fef83-b745-4ca7-8e21-896c8e8d992d None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:18.247803 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5fef83-b745-4ca7-8e21-896c8e8d992d None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:18.248694 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5fef83-b745-4ca7-8e21-896c8e8d992d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:18.249177 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5fef83-b745-4ca7-8e21-896c8e8d992d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:18.250781 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5fef83-b745-4ca7-8e21-896c8e8d992d None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:18.253412 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:18.262096 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 194/386] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 01:17:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:17:18.267283 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b3b4fa-381f-406b-87d2-a46af66a7b57 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:18.383477 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b3b4fa-381f-406b-87d2-a46af66a7b57 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:18.435766 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fe75ee-5ca5-4da2-8d5a-a3008b5ed7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:18.436322 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe75ee-5ca5-4da2-8d5a-a3008b5ed7a6 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:18.436593 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe75ee-5ca5-4da2-8d5a-a3008b5ed7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:18.436856 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe75ee-5ca5-4da2-8d5a-a3008b5ed7a6 None admin] PATH_INFO: `/v3/groups/a9f36e31aa934f7bb325c0014e30e9be` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:18.437950 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fe75ee-5ca5-4da2-8d5a-a3008b5ed7a6 None admin] RBAC: Authorizing `identity:get_group(group_id=a9f36e31aa934f7bb325c0014e30e9be)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:18.439390 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fe75ee-5ca5-4da2-8d5a-a3008b5ed7a6 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:18.440944 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 193/387] 10.222.0.26 () {56 vars in 1180 bytes} [Fri Aug 12 01:17:18 2022] GET /identity/v3/groups/a9f36e31aa934f7bb325c0014e30e9be => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:18.447688 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5fef83-b745-4ca7-8e21-896c8e8d992d None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:18.503368 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fe75ee-5ca5-4da2-8d5a-a3008b5ed7a6 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:18.628347 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:18.646934 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5fef83-b745-4ca7-8e21-896c8e8d992d None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:18.707736 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fe75ee-5ca5-4da2-8d5a-a3008b5ed7a6 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:18.722344 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e29eaef-b820-4fef-8dfa-06557f531c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:18.722983 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29eaef-b820-4fef-8dfa-06557f531c90 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:18.723255 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29eaef-b820-4fef-8dfa-06557f531c90 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:18.723523 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29eaef-b820-4fef-8dfa-06557f531c90 None admin] PATH_INFO: `/v3/projects/d979106c8a164d55aa33fdb5ea995c7a` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:18.726742 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e29eaef-b820-4fef-8dfa-06557f531c90 None admin] RBAC: Authorizing `identity:get_project(project_id=d979106c8a164d55aa33fdb5ea995c7a)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:18.728176 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e29eaef-b820-4fef-8dfa-06557f531c90 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:18.731146 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 195/388] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 01:17:18 2022] GET /identity/v3/projects/d979106c8a164d55aa33fdb5ea995c7a => generated 298 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:18.737674 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e29eaef-b820-4fef-8dfa-06557f531c90 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:18.778431 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7150a8-2e6c-49e5-a086-a0a1fc8f8cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:18.779510 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7150a8-2e6c-49e5-a086-a0a1fc8f8cfa None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:18.780029 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7150a8-2e6c-49e5-a086-a0a1fc8f8cfa None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:18.780492 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7150a8-2e6c-49e5-a086-a0a1fc8f8cfa None admin] PATH_INFO: `/v3/roles/member` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:18.800590 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7150a8-2e6c-49e5-a086-a0a1fc8f8cfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:17:18.806159 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-3a7150a8-2e6c-49e5-a086-a0a1fc8f8cfa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 01:17:18.806159 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:18.806159 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:18.806159 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:18.806159 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:18.806159 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:18.806159 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:18.806159 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:18.806159 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:18.806159 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:18.806159 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:18.806159 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:18.806159 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:17:18.806159 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:17:18.806159 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:17:18.806159 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:17:18.807031 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:17:18.807031 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:17:18.807031 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:17:18.807031 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:17:18.807031 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:18.807031 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:18.807031 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:18.807031 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:18.807031 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:18.807031 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:18.807031 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:18.807031 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:18.807031 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:18.807031 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:18.807031 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:18.807031 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:18.807818 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:18.807818 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:18.807818 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:18.807818 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:18.807818 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:17:18.807818 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:17:18.807818 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:17:18.807818 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:17:18.807818 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:17:18.807818 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:17:18.807818 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 01:17:18.807818 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:17:18.814030 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 194/389] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 01:17:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 01:17:18.815750 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7150a8-2e6c-49e5-a086-a0a1fc8f8cfa None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:18.877560 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:18.930883 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7150a8-2e6c-49e5-a086-a0a1fc8f8cfa None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:18.958656 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:18.962910 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e29eaef-b820-4fef-8dfa-06557f531c90 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:18.970238 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d9f980-8ccf-4a87-8cc6-8a188b1ac98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:18.971227 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9f980-8ccf-4a87-8cc6-8a188b1ac98b None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:18.971765 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9f980-8ccf-4a87-8cc6-8a188b1ac98b None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:18.972211 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9f980-8ccf-4a87-8cc6-8a188b1ac98b None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:18.973225 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d9f980-8ccf-4a87-8cc6-8a188b1ac98b None admin] RBAC: Adding query filter params (name=member) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:18.973698 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d9f980-8ccf-4a87-8cc6-8a188b1ac98b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:18.975300 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d9f980-8ccf-4a87-8cc6-8a188b1ac98b None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:18.984912 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 195/390] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Aug 12 01:17:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:18.990646 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d9f980-8ccf-4a87-8cc6-8a188b1ac98b None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:19.027755 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e24d7c-6139-475c-9d4c-c05bb7337181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:19.028432 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e24d7c-6139-475c-9d4c-c05bb7337181 None admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:19.028859 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e24d7c-6139-475c-9d4c-c05bb7337181 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:19.029286 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e24d7c-6139-475c-9d4c-c05bb7337181 None admin] PATH_INFO: `/v3/projects/d979106c8a164d55aa33fdb5ea995c7a/groups/a9f36e31aa934f7bb325c0014e30e9be/roles/bab2af60c26640acbd0c4db2f9796cfb` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:19.038895 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e24d7c-6139-475c-9d4c-c05bb7337181 None admin] RBAC: Authorizing `identity:create_grant(project_id=d979106c8a164d55aa33fdb5ea995c7a, group_id=a9f36e31aa934f7bb325c0014e30e9be, role_id=bab2af60c26640acbd0c4db2f9796cfb)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:19.040627 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e24d7c-6139-475c-9d4c-c05bb7337181 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:19.085290 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 196/391] 10.222.0.26 () {58 vars in 1442 bytes} [Fri Aug 12 01:17:18 2022] PUT /identity/v3/projects/d979106c8a164d55aa33fdb5ea995c7a/groups/a9f36e31aa934f7bb325c0014e30e9be/roles/bab2af60c26640acbd0c4db2f9796cfb => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 01:17:19.086842 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ce790-eb0d-4d99-889d-60a00f18f412 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:19.087325 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ce790-eb0d-4d99-889d-60a00f18f412 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:19.087768 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ce790-eb0d-4d99-889d-60a00f18f412 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:19.089226 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 197/392] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:17:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:17:19.096072 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bed0f2-266c-4779-b89c-32851faf8002 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:19.096700 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bed0f2-266c-4779-b89c-32851faf8002 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:19.097194 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bed0f2-266c-4779-b89c-32851faf8002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:19.106161 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d9f980-8ccf-4a87-8cc6-8a188b1ac98b None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:19.139253 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-97bed0f2-266c-4779-b89c-32851faf8002 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:17:19.140630 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc32a864-59c7-48a1-8e78-1c0aa4771a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:19.140979 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-97bed0f2-266c-4779-b89c-32851faf8002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:17:19.141663 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32a864-59c7-48a1-8e78-1c0aa4771a34 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:19.142085 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32a864-59c7-48a1-8e78-1c0aa4771a34 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:19.142522 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32a864-59c7-48a1-8e78-1c0aa4771a34 None admin] PATH_INFO: `/v3/groups/a9f36e31aa934f7bb325c0014e30e9be` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:19.143983 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc32a864-59c7-48a1-8e78-1c0aa4771a34 None admin] RBAC: Authorizing `identity:get_group(group_id=a9f36e31aa934f7bb325c0014e30e9be)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:19.145750 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc32a864-59c7-48a1-8e78-1c0aa4771a34 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:19.148166 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 196/393] 10.222.0.26 () {56 vars in 1180 bytes} [Fri Aug 12 01:17:18 2022] GET /identity/v3/groups/a9f36e31aa934f7bb325c0014e30e9be => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:17:19.154060 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc32a864-59c7-48a1-8e78-1c0aa4771a34 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:19.271024 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 198/394] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:17:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 01:17:19.272861 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:19.304491 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc32a864-59c7-48a1-8e78-1c0aa4771a34 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:19.338948 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907ad659-2272-4449-b84a-547fb94402e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:19.339932 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ad659-2272-4449-b84a-547fb94402e0 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:19.340426 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ad659-2272-4449-b84a-547fb94402e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:19.340883 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ad659-2272-4449-b84a-547fb94402e0 None admin] PATH_INFO: `/v3/projects/d979106c8a164d55aa33fdb5ea995c7a` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:19.342216 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907ad659-2272-4449-b84a-547fb94402e0 None admin] RBAC: Authorizing `identity:get_project(project_id=d979106c8a164d55aa33fdb5ea995c7a)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:19.343840 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907ad659-2272-4449-b84a-547fb94402e0 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:19.345945 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 197/395] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 01:17:19 2022] GET /identity/v3/projects/d979106c8a164d55aa33fdb5ea995c7a => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:17:19.352077 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bed0f2-266c-4779-b89c-32851faf8002 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:19.425551 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:19.494844 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bed0f2-266c-4779-b89c-32851faf8002 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:19.549194 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0491fd3-8ca1-4c95-8f46-34861dc7c235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:19.550237 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0491fd3-8ca1-4c95-8f46-34861dc7c235 None admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:19.550756 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0491fd3-8ca1-4c95-8f46-34861dc7c235 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:19.551210 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0491fd3-8ca1-4c95-8f46-34861dc7c235 None admin] PATH_INFO: `/v3/projects/d979106c8a164d55aa33fdb5ea995c7a/groups/a9f36e31aa934f7bb325c0014e30e9be/roles/13af81971c1c428eae0a571a22ea583d` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:19.559502 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0491fd3-8ca1-4c95-8f46-34861dc7c235 None admin] RBAC: Authorizing `identity:create_grant(project_id=d979106c8a164d55aa33fdb5ea995c7a, group_id=a9f36e31aa934f7bb325c0014e30e9be, role_id=13af81971c1c428eae0a571a22ea583d)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:19.561358 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0491fd3-8ca1-4c95-8f46-34861dc7c235 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:19.580827 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 199/396] 10.222.0.26 () {58 vars in 1442 bytes} [Fri Aug 12 01:17:19 2022] PUT /identity/v3/projects/d979106c8a164d55aa33fdb5ea995c7a/groups/a9f36e31aa934f7bb325c0014e30e9be/roles/13af81971c1c428eae0a571a22ea583d => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:17:19.646754 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b05ecf-f5f0-4094-8f50-ed103f292a92 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:19.647365 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b05ecf-f5f0-4094-8f50-ed103f292a92 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:19.647365 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b05ecf-f5f0-4094-8f50-ed103f292a92 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:19.649067 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 198/397] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:17:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:17:19.655172 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c2235f-c76f-4257-abc6-90277c00ccb3 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:19.655497 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c2235f-c76f-4257-abc6-90277c00ccb3 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:19.655719 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c2235f-c76f-4257-abc6-90277c00ccb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:19.676625 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-a1c2235f-c76f-4257-abc6-90277c00ccb3 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:17:19.677905 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-a1c2235f-c76f-4257-abc6-90277c00ccb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:17:19.699701 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b05ecf-f5f0-4094-8f50-ed103f292a92 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:19.801169 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 200/398] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:17:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 01:17:19.851084 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b05ecf-f5f0-4094-8f50-ed103f292a92 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:19.873183 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:19.888283 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7fc4e8-2421-4a99-b69a-e7f428c5d943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:19.889272 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7fc4e8-2421-4a99-b69a-e7f428c5d943 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:19.889771 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7fc4e8-2421-4a99-b69a-e7f428c5d943 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:19.890268 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7fc4e8-2421-4a99-b69a-e7f428c5d943 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:19.903002 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7fc4e8-2421-4a99-b69a-e7f428c5d943 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:17:19.908180 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-9d7fc4e8-2421-4a99-b69a-e7f428c5d943 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 01:17:19.908180 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:19.908180 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:19.908180 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:19.908180 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:19.908180 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:19.908180 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:19.908180 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:19.908180 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:19.908180 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:19.908180 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:19.908180 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:19.908180 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:17:19.908180 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:17:19.908180 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:17:19.908180 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:17:19.909061 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:17:19.909061 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:17:19.909061 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:17:19.909061 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:17:19.909061 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:19.909061 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:19.909061 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:19.909061 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:19.909061 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:19.909061 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:19.909061 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:19.909061 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:19.909061 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:19.909061 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:19.909061 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:19.909061 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:19.909953 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:19.909953 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:19.909953 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:19.909953 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:19.909953 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:17:19.909953 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:17:19.909953 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:17:19.909953 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:17:19.909953 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:17:19.909953 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:17:19.909953 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 01:17:19.909953 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:17:19.912747 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 199/399] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 01:17:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:19.919412 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c2235f-c76f-4257-abc6-90277c00ccb3 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:19.972634 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:19.974729 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6bfec7-500c-4d1f-b0a2-6e96369e3a10 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:19.975291 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6bfec7-500c-4d1f-b0a2-6e96369e3a10 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:19.975897 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6bfec7-500c-4d1f-b0a2-6e96369e3a10 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:19.977468 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 200/400] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:17:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:17:19.982663 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b8ad5-8a9e-4e68-8898-9c2e1154b97e None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:19.983222 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b8ad5-8a9e-4e68-8898-9c2e1154b97e None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:19.983676 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b8ad5-8a9e-4e68-8898-9c2e1154b97e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:20.004964 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-c93b8ad5-8a9e-4e68-8898-9c2e1154b97e None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:17:20.006574 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-c93b8ad5-8a9e-4e68-8898-9c2e1154b97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:17:20.087045 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 201/401] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:17:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 01:17:20.109582 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c2235f-c76f-4257-abc6-90277c00ccb3 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:20.162693 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81394030-c2c6-4c25-a58e-a46b214bb8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:20.163361 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81394030-c2c6-4c25-a58e-a46b214bb8a8 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:20.163630 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81394030-c2c6-4c25-a58e-a46b214bb8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:20.163894 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81394030-c2c6-4c25-a58e-a46b214bb8a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:20.164565 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81394030-c2c6-4c25-a58e-a46b214bb8a8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:20.164861 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81394030-c2c6-4c25-a58e-a46b214bb8a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:20.166256 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81394030-c2c6-4c25-a58e-a46b214bb8a8 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:20.175004 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b8ad5-8a9e-4e68-8898-9c2e1154b97e None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:20.181965 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 201/402] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Aug 12 01:17:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:20.190390 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81394030-c2c6-4c25-a58e-a46b214bb8a8 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:20.291532 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b8ad5-8a9e-4e68-8898-9c2e1154b97e None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:20.330501 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:20.342497 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95330b2-bd05-4fa4-81ba-98f1fb3114de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:20.343074 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95330b2-bd05-4fa4-81ba-98f1fb3114de None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:20.343344 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95330b2-bd05-4fa4-81ba-98f1fb3114de None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:20.343610 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95330b2-bd05-4fa4-81ba-98f1fb3114de None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:20.365018 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95330b2-bd05-4fa4-81ba-98f1fb3114de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:17:20.372999 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-b95330b2-bd05-4fa4-81ba-98f1fb3114de None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 01:17:20.372999 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:20.372999 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:20.372999 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:20.372999 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:20.372999 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:20.372999 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:20.372999 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:20.372999 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:20.372999 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:20.372999 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:20.372999 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:20.372999 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:17:20.372999 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:17:20.372999 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:17:20.372999 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:17:20.373937 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:17:20.373937 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:17:20.373937 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:17:20.373937 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:17:20.373937 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:20.373937 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:20.373937 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:20.373937 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:20.373937 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:20.373937 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:20.373937 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:20.373937 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:20.373937 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:20.373937 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:20.373937 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:20.373937 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:20.374772 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:20.374772 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:20.374772 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:20.374772 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:20.374772 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:17:20.374772 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:17:20.374772 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:17:20.374772 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:17:20.374772 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:17:20.374772 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:17:20.374772 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 01:17:20.374772 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:17:20.379782 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81394030-c2c6-4c25-a58e-a46b214bb8a8 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:20.379929 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 202/403] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Aug 12 01:17:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:20.387146 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95330b2-bd05-4fa4-81ba-98f1fb3114de None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:20.387793 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:20.439549 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7965109f-8194-4719-a81d-e09c50c82d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:20.440240 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965109f-8194-4719-a81d-e09c50c82d15 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:20.441419 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965109f-8194-4719-a81d-e09c50c82d15 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:20.441419 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965109f-8194-4719-a81d-e09c50c82d15 None admin] PATH_INFO: `/v3/groups/a9f36e31aa934f7bb325c0014e30e9be` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:20.443453 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7965109f-8194-4719-a81d-e09c50c82d15 None admin] RBAC: Authorizing `identity:get_group(group_id=a9f36e31aa934f7bb325c0014e30e9be)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:20.444339 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7965109f-8194-4719-a81d-e09c50c82d15 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:20.449621 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 202/404] 10.222.0.26 () {56 vars in 1180 bytes} [Fri Aug 12 01:17:20 2022] GET /identity/v3/groups/a9f36e31aa934f7bb325c0014e30e9be => generated 226 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:20.458853 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7965109f-8194-4719-a81d-e09c50c82d15 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:20.546151 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95330b2-bd05-4fa4-81ba-98f1fb3114de None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:20.587812 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7965109f-8194-4719-a81d-e09c50c82d15 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:20.594618 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b8e8a1-5596-46b0-9e19-f99a96f85bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:20.595492 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8e8a1-5596-46b0-9e19-f99a96f85bc8 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:20.595947 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8e8a1-5596-46b0-9e19-f99a96f85bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:20.596642 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8e8a1-5596-46b0-9e19-f99a96f85bc8 None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:20.597947 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b8e8a1-5596-46b0-9e19-f99a96f85bc8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:20.598466 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b8e8a1-5596-46b0-9e19-f99a96f85bc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:20.600782 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b8e8a1-5596-46b0-9e19-f99a96f85bc8 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:20.619998 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 203/405] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 01:17:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:20.622126 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b8e8a1-5596-46b0-9e19-f99a96f85bc8 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:20.627428 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc5b056-6545-4bdc-9f57-03db38f21ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:20.628073 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5b056-6545-4bdc-9f57-03db38f21ac5 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:20.628349 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5b056-6545-4bdc-9f57-03db38f21ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:20.628607 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5b056-6545-4bdc-9f57-03db38f21ac5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:20.640839 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc5b056-6545-4bdc-9f57-03db38f21ac5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:17:20.646287 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-2cc5b056-6545-4bdc-9f57-03db38f21ac5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 01:17:20.646287 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:20.646287 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:20.646287 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:20.646287 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:20.646287 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:20.646287 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:20.646287 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:20.646287 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:20.646287 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:20.646287 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:20.646287 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:20.646287 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:17:20.646287 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:17:20.646287 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:17:20.646287 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:17:20.647248 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:17:20.647248 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:17:20.647248 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:17:20.647248 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:17:20.647248 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:20.647248 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:20.647248 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:20.647248 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:20.647248 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:20.647248 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:20.647248 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:20.647248 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:20.647248 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:20.647248 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:20.647248 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:20.647248 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:20.648090 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:20.648090 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:20.648090 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:20.648090 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:20.648090 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:17:20.648090 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:17:20.648090 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:17:20.648090 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:17:20.648090 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:17:20.648090 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:17:20.648090 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 01:17:20.648090 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:17:20.652917 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 203/406] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Aug 12 01:17:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 01:17:20.653808 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc5b056-6545-4bdc-9f57-03db38f21ac5 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:20.660592 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:20.689855 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:20.738056 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b8e8a1-5596-46b0-9e19-f99a96f85bc8 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:20.757370 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc5b056-6545-4bdc-9f57-03db38f21ac5 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:20.774732 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95834cbd-9d35-4104-b7f0-2df7bb3113cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:20.775644 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95834cbd-9d35-4104-b7f0-2df7bb3113cd None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:20.776095 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95834cbd-9d35-4104-b7f0-2df7bb3113cd None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:20.776582 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95834cbd-9d35-4104-b7f0-2df7bb3113cd None admin] PATH_INFO: `/v3/projects/45a8fcf9582d42ccaffc8d521078eab0` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:20.778057 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95834cbd-9d35-4104-b7f0-2df7bb3113cd None admin] RBAC: Authorizing `identity:get_project(project_id=45a8fcf9582d42ccaffc8d521078eab0)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:20.779680 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95834cbd-9d35-4104-b7f0-2df7bb3113cd None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:20.782073 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 204/407] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 01:17:20 2022] GET /identity/v3/projects/45a8fcf9582d42ccaffc8d521078eab0 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:20.783240 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95834cbd-9d35-4104-b7f0-2df7bb3113cd None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:20.795558 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6967f8b-ef9f-42f3-b0dd-38d4673f2cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:20.796092 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6967f8b-ef9f-42f3-b0dd-38d4673f2cea None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:20.796368 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6967f8b-ef9f-42f3-b0dd-38d4673f2cea None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:20.796636 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6967f8b-ef9f-42f3-b0dd-38d4673f2cea None admin] PATH_INFO: `/v3/groups/a9f36e31aa934f7bb325c0014e30e9be` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:20.797922 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6967f8b-ef9f-42f3-b0dd-38d4673f2cea None admin] RBAC: Authorizing `identity:get_group(group_id=a9f36e31aa934f7bb325c0014e30e9be)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:20.799334 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6967f8b-ef9f-42f3-b0dd-38d4673f2cea None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:20.805648 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 204/408] 10.222.0.26 () {56 vars in 1180 bytes} [Fri Aug 12 01:17:20 2022] GET /identity/v3/groups/a9f36e31aa934f7bb325c0014e30e9be => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:20.805648 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6967f8b-ef9f-42f3-b0dd-38d4673f2cea None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:20.894690 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:20.898534 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95834cbd-9d35-4104-b7f0-2df7bb3113cd None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:20.909800 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6967f8b-ef9f-42f3-b0dd-38d4673f2cea None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:20.912397 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:20.937466 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98da6f7-4aea-4b11-84eb-0837f686196d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:20.938543 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98da6f7-4aea-4b11-84eb-0837f686196d None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:20.939019 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98da6f7-4aea-4b11-84eb-0837f686196d None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:20.939543 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98da6f7-4aea-4b11-84eb-0837f686196d None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:20.940431 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98da6f7-4aea-4b11-84eb-0837f686196d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:20.940929 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98da6f7-4aea-4b11-84eb-0837f686196d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:20.942658 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98da6f7-4aea-4b11-84eb-0837f686196d None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:20.948845 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c3316-d007-4044-b611-98d36ab39263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:20.949454 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c3316-d007-4044-b611-98d36ab39263 None admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:20.949679 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c3316-d007-4044-b611-98d36ab39263 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:20.949954 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c3316-d007-4044-b611-98d36ab39263 None admin] PATH_INFO: `/v3/projects/45a8fcf9582d42ccaffc8d521078eab0/groups/a9f36e31aa934f7bb325c0014e30e9be/roles/13af81971c1c428eae0a571a22ea583d` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:20.951888 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6c3316-d007-4044-b611-98d36ab39263 None admin] RBAC: Authorizing `identity:create_grant(project_id=45a8fcf9582d42ccaffc8d521078eab0, group_id=a9f36e31aa934f7bb325c0014e30e9be, role_id=13af81971c1c428eae0a571a22ea583d)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:20.953395 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6c3316-d007-4044-b611-98d36ab39263 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:20.953874 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 205/409] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 01:17:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:20.954928 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98da6f7-4aea-4b11-84eb-0837f686196d None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:20.976709 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 205/410] 10.222.0.26 () {58 vars in 1442 bytes} [Fri Aug 12 01:17:20 2022] PUT /identity/v3/projects/45a8fcf9582d42ccaffc8d521078eab0/groups/a9f36e31aa934f7bb325c0014e30e9be/roles/13af81971c1c428eae0a571a22ea583d => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:17:20.978595 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c3316-d007-4044-b611-98d36ab39263 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:21.118248 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c3316-d007-4044-b611-98d36ab39263 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:21.159838 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa7aa7-9448-4f57-87ae-3ef1ed48a31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:21.160819 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa7aa7-9448-4f57-87ae-3ef1ed48a31a None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:21.161295 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa7aa7-9448-4f57-87ae-3ef1ed48a31a None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:21.161758 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa7aa7-9448-4f57-87ae-3ef1ed48a31a None admin] PATH_INFO: `/v3/groups/62238f8dd2854ccca2a9c289420cec89` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:21.163635 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfa7aa7-9448-4f57-87ae-3ef1ed48a31a None admin] RBAC: Authorizing `identity:get_group(group_id=62238f8dd2854ccca2a9c289420cec89)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:21.165437 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfa7aa7-9448-4f57-87ae-3ef1ed48a31a None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:21.167684 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 206/411] 10.222.0.26 () {56 vars in 1180 bytes} [Fri Aug 12 01:17:20 2022] GET /identity/v3/groups/62238f8dd2854ccca2a9c289420cec89 => generated 229 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:21.169845 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98da6f7-4aea-4b11-84eb-0837f686196d None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:21.184453 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa7aa7-9448-4f57-87ae-3ef1ed48a31a None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:21.211948 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228dda6b-062b-49f0-bb22-fcb56ba653b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:21.212885 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228dda6b-062b-49f0-bb22-fcb56ba653b3 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:21.213019 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228dda6b-062b-49f0-bb22-fcb56ba653b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:21.213224 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228dda6b-062b-49f0-bb22-fcb56ba653b3 None admin] PATH_INFO: `/v3/projects/45a8fcf9582d42ccaffc8d521078eab0` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:21.214465 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228dda6b-062b-49f0-bb22-fcb56ba653b3 None admin] RBAC: Authorizing `identity:get_project(project_id=45a8fcf9582d42ccaffc8d521078eab0)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:21.215826 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228dda6b-062b-49f0-bb22-fcb56ba653b3 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:21.217970 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 206/412] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 01:17:20 2022] GET /identity/v3/projects/45a8fcf9582d42ccaffc8d521078eab0 => generated 302 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:21.223944 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228dda6b-062b-49f0-bb22-fcb56ba653b3 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:21.224949 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:21.260197 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:21.326732 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa7aa7-9448-4f57-87ae-3ef1ed48a31a None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:21.360597 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e269ae0-038d-43e7-8118-dc978fb54d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:21.361230 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e269ae0-038d-43e7-8118-dc978fb54d3e None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:21.361507 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e269ae0-038d-43e7-8118-dc978fb54d3e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:21.361766 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e269ae0-038d-43e7-8118-dc978fb54d3e None admin] PATH_INFO: `/v3/projects/9f7a63ab9a434ddfb7cb138101d2e804` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:21.363017 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e269ae0-038d-43e7-8118-dc978fb54d3e None admin] RBAC: Authorizing `identity:get_project(project_id=9f7a63ab9a434ddfb7cb138101d2e804)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:21.364456 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e269ae0-038d-43e7-8118-dc978fb54d3e None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:21.366664 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 207/413] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 01:17:21 2022] GET /identity/v3/projects/9f7a63ab9a434ddfb7cb138101d2e804 => generated 344 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:21.369035 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228dda6b-062b-49f0-bb22-fcb56ba653b3 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:21.372486 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e269ae0-038d-43e7-8118-dc978fb54d3e None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:21.463536 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff97877-06b1-4adf-ba96-a46f9e75c1b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:21.464139 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff97877-06b1-4adf-ba96-a46f9e75c1b6 None admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:21.464413 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff97877-06b1-4adf-ba96-a46f9e75c1b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:21.464680 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff97877-06b1-4adf-ba96-a46f9e75c1b6 None admin] PATH_INFO: `/v3/projects/45a8fcf9582d42ccaffc8d521078eab0/groups/a9f36e31aa934f7bb325c0014e30e9be/roles/bab2af60c26640acbd0c4db2f9796cfb` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:21.481360 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff97877-06b1-4adf-ba96-a46f9e75c1b6 None admin] RBAC: Authorizing `identity:create_grant(project_id=45a8fcf9582d42ccaffc8d521078eab0, group_id=a9f36e31aa934f7bb325c0014e30e9be, role_id=bab2af60c26640acbd0c4db2f9796cfb)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:21.481360 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff97877-06b1-4adf-ba96-a46f9e75c1b6 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:21.486150 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e269ae0-038d-43e7-8118-dc978fb54d3e None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:21.493969 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:21.514158 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 207/414] 10.222.0.26 () {58 vars in 1442 bytes} [Fri Aug 12 01:17:21 2022] PUT /identity/v3/projects/45a8fcf9582d42ccaffc8d521078eab0/groups/a9f36e31aa934f7bb325c0014e30e9be/roles/bab2af60c26640acbd0c4db2f9796cfb => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:17:21.514158 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c77f1-d520-4404-9350-526ead41aa10 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:21.514158 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c77f1-d520-4404-9350-526ead41aa10 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:21.514158 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c77f1-d520-4404-9350-526ead41aa10 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:21.514158 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 208/415] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:17:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:17:21.522533 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33920137-252e-47e0-94c2-8cedd78e7b29 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:21.523127 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33920137-252e-47e0-94c2-8cedd78e7b29 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:21.523534 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33920137-252e-47e0-94c2-8cedd78e7b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:21.550525 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c643c9-55dc-466a-b30e-f87855527916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:21.551487 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c643c9-55dc-466a-b30e-f87855527916 None admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:21.551898 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c643c9-55dc-466a-b30e-f87855527916 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:21.552318 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c643c9-55dc-466a-b30e-f87855527916 None admin] PATH_INFO: `/v3/projects/9f7a63ab9a434ddfb7cb138101d2e804/groups/62238f8dd2854ccca2a9c289420cec89/roles/fb48693810be495fb4b1893a79429b78` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:21.554900 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c643c9-55dc-466a-b30e-f87855527916 None admin] RBAC: Authorizing `identity:create_grant(project_id=9f7a63ab9a434ddfb7cb138101d2e804, group_id=62238f8dd2854ccca2a9c289420cec89, role_id=fb48693810be495fb4b1893a79429b78)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:21.556537 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c643c9-55dc-466a-b30e-f87855527916 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:21.563198 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-33920137-252e-47e0-94c2-8cedd78e7b29 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:17:21.565537 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-33920137-252e-47e0-94c2-8cedd78e7b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:17:21.585136 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 208/416] 10.222.0.26 () {58 vars in 1442 bytes} [Fri Aug 12 01:17:21 2022] PUT /identity/v3/projects/9f7a63ab9a434ddfb7cb138101d2e804/groups/62238f8dd2854ccca2a9c289420cec89/roles/fb48693810be495fb4b1893a79429b78 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 01:17:21.660434 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 209/417] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:17:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 01:17:21.925097 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f4383-afad-490a-8734-279330d3e772 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:21.925587 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f4383-afad-490a-8734-279330d3e772 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:21.925966 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f4383-afad-490a-8734-279330d3e772 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:21.927735 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 209/418] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:17:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:17:21.932745 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d2a6d7-5501-4478-9bd6-87875cb78b60 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:21.933194 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d2a6d7-5501-4478-9bd6-87875cb78b60 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:21.933286 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d2a6d7-5501-4478-9bd6-87875cb78b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:21.959130 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-86d2a6d7-5501-4478-9bd6-87875cb78b60 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:17:21.960455 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-86d2a6d7-5501-4478-9bd6-87875cb78b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:17:21.968410 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622f4383-afad-490a-8734-279330d3e772 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:21.977300 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:22.041156 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 210/419] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:17:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 01:17:22.123778 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622f4383-afad-490a-8734-279330d3e772 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:22.171760 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ff6bd2-b1e0-4480-a8f9-5221bdf93668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:22.172462 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff6bd2-b1e0-4480-a8f9-5221bdf93668 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:22.172749 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff6bd2-b1e0-4480-a8f9-5221bdf93668 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:22.173073 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff6bd2-b1e0-4480-a8f9-5221bdf93668 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:22.184727 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ff6bd2-b1e0-4480-a8f9-5221bdf93668 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:17:22.189430 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-74ff6bd2-b1e0-4480-a8f9-5221bdf93668 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 01:17:22.189430 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:22.189430 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:22.189430 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:22.189430 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:22.189430 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:22.189430 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:22.189430 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:22.189430 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:22.189430 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:22.189430 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:22.189430 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:22.189430 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:17:22.189430 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:17:22.189430 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:17:22.189430 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:17:22.190430 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:17:22.190430 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:17:22.190430 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:17:22.190430 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:17:22.190430 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:22.190430 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:22.190430 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:22.190430 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:22.190430 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:22.190430 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:22.190430 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:22.190430 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:22.190430 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:22.190430 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:22.190430 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:22.190430 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:22.191203 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:22.191203 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:22.191203 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:22.191203 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:22.191203 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:17:22.191203 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:17:22.191203 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:17:22.191203 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:17:22.191203 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:17:22.191203 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:17:22.191203 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 01:17:22.191203 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:17:22.191203 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 210/420] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Aug 12 01:17:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:22.198199 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d2a6d7-5501-4478-9bd6-87875cb78b60 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:22.306172 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d2a6d7-5501-4478-9bd6-87875cb78b60 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:22.345176 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ff6bd2-b1e0-4480-a8f9-5221bdf93668 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:22.348863 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f409964e-8932-426d-9d7c-de43e54987cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:22.353879 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409964e-8932-426d-9d7c-de43e54987cc None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:22.353879 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409964e-8932-426d-9d7c-de43e54987cc None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:22.353879 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409964e-8932-426d-9d7c-de43e54987cc None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:22.353879 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f409964e-8932-426d-9d7c-de43e54987cc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:22.353879 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f409964e-8932-426d-9d7c-de43e54987cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:22.353879 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f409964e-8932-426d-9d7c-de43e54987cc None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:22.363060 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 211/421] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 01:17:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:22.369531 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f409964e-8932-426d-9d7c-de43e54987cc None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:22.386175 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:22.396861 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:22.527719 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f409964e-8932-426d-9d7c-de43e54987cc None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:22.555762 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ff6bd2-b1e0-4480-a8f9-5221bdf93668 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:22.595070 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d171cb83-313f-4ca2-a89d-1fac2f24834b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:22.595918 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171cb83-313f-4ca2-a89d-1fac2f24834b None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:22.597348 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171cb83-313f-4ca2-a89d-1fac2f24834b None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:22.597757 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171cb83-313f-4ca2-a89d-1fac2f24834b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:22.623689 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7fac0f-9208-4dc7-a117-6858c81c9556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:22.624640 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7fac0f-9208-4dc7-a117-6858c81c9556 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:22.625066 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7fac0f-9208-4dc7-a117-6858c81c9556 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:22.625472 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7fac0f-9208-4dc7-a117-6858c81c9556 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:22.645350 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7fac0f-9208-4dc7-a117-6858c81c9556 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:17:22.651974 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-4b7fac0f-9208-4dc7-a117-6858c81c9556 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 01:17:22.651974 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:22.651974 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:22.651974 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:22.651974 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:22.651974 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:22.651974 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:22.651974 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:22.651974 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:22.651974 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:22.651974 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:22.651974 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:22.651974 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:17:22.651974 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:17:22.651974 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:17:22.651974 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:17:22.653040 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:17:22.653040 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:17:22.653040 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:17:22.653040 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:17:22.653040 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:22.653040 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:22.653040 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:22.653040 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:22.653040 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:22.653040 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:22.653040 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:22.653040 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:22.653040 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:22.653040 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:22.653040 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:22.653040 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:22.654021 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:22.654021 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:22.654021 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:22.654021 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:22.654021 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:17:22.654021 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:17:22.654021 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:17:22.654021 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:17:22.654021 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:17:22.654021 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:17:22.654021 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 01:17:22.654021 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:17:22.658073 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 211/422] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 01:17:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:22.662662 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7fac0f-9208-4dc7-a117-6858c81c9556 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:22.751295 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d171cb83-313f-4ca2-a89d-1fac2f24834b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:22.752847 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d171cb83-313f-4ca2-a89d-1fac2f24834b None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:22.761941 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:22.774067 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:22.784355 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7fac0f-9208-4dc7-a117-6858c81c9556 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:22.831386 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70075600-4bbf-49cc-9475-d20ce13e634e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:22.832389 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70075600-4bbf-49cc-9475-d20ce13e634e None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:22.834443 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70075600-4bbf-49cc-9475-d20ce13e634e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:22.834936 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70075600-4bbf-49cc-9475-d20ce13e634e None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:22.835802 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70075600-4bbf-49cc-9475-d20ce13e634e None admin] RBAC: Adding query filter params (name=member) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:22.836542 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70075600-4bbf-49cc-9475-d20ce13e634e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:22.839832 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70075600-4bbf-49cc-9475-d20ce13e634e None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:22.858625 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 212/423] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Aug 12 01:17:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:22.864615 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70075600-4bbf-49cc-9475-d20ce13e634e None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:22.972521 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 212/424] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 01:17:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 603 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 01:17:22.992379 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d171cb83-313f-4ca2-a89d-1fac2f24834b None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:22.994045 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70075600-4bbf-49cc-9475-d20ce13e634e None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:23.032616 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f210c066-8dd5-46eb-a80d-9ce8b4210530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:23.037010 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f210c066-8dd5-46eb-a80d-9ce8b4210530 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:23.037495 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f210c066-8dd5-46eb-a80d-9ce8b4210530 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:23.038171 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f210c066-8dd5-46eb-a80d-9ce8b4210530 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:23.061335 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:23.170411 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d171cb83-313f-4ca2-a89d-1fac2f24834b None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:23.185449 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:23.191163 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f210c066-8dd5-46eb-a80d-9ce8b4210530 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:23.192659 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f210c066-8dd5-46eb-a80d-9ce8b4210530 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:23.216867 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f2282-8160-4a19-a242-c494385f9c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:23.217851 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f2282-8160-4a19-a242-c494385f9c62 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:23.218359 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f2282-8160-4a19-a242-c494385f9c62 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:23.218829 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f2282-8160-4a19-a242-c494385f9c62 None admin] PATH_INFO: `/v3/projects/d979106c8a164d55aa33fdb5ea995c7a` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:23.220147 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4f2282-8160-4a19-a242-c494385f9c62 None admin] RBAC: Authorizing `identity:get_project(project_id=d979106c8a164d55aa33fdb5ea995c7a)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:23.222596 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4f2282-8160-4a19-a242-c494385f9c62 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:23.227895 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 213/425] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 01:17:22 2022] GET /identity/v3/projects/d979106c8a164d55aa33fdb5ea995c7a => generated 298 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:17:23.233404 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f2282-8160-4a19-a242-c494385f9c62 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:23.333666 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 213/426] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 01:17:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 01:17:23.336233 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a4ee0-f19c-4c1d-b9cc-cef974942e94 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:23.336538 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a4ee0-f19c-4c1d-b9cc-cef974942e94 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:23.337105 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a4ee0-f19c-4c1d-b9cc-cef974942e94 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:23.338077 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 214/427] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:17:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:17:23.342982 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10a4ee0-f19c-4c1d-b9cc-cef974942e94 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:23.364639 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f2282-8160-4a19-a242-c494385f9c62 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:23.390258 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:23.409408 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d9b42f-73f9-401d-be17-a9cb2642de35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:23.410719 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d9b42f-73f9-401d-be17-a9cb2642de35 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:23.411064 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d9b42f-73f9-401d-be17-a9cb2642de35 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:23.411436 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d9b42f-73f9-401d-be17-a9cb2642de35 None admin] PATH_INFO: `/v3/groups/a9f36e31aa934f7bb325c0014e30e9be` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:23.412846 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d9b42f-73f9-401d-be17-a9cb2642de35 None admin] RBAC: Authorizing `identity:get_group(group_id=a9f36e31aa934f7bb325c0014e30e9be)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:23.414886 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d9b42f-73f9-401d-be17-a9cb2642de35 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:23.417236 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 214/428] 10.222.0.26 () {56 vars in 1180 bytes} [Fri Aug 12 01:17:23 2022] GET /identity/v3/groups/a9f36e31aa934f7bb325c0014e30e9be => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:17:23.419080 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed1ce34-ba95-4cec-955d-8d212c30638b None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:23.419517 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed1ce34-ba95-4cec-955d-8d212c30638b None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:23.419940 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed1ce34-ba95-4cec-955d-8d212c30638b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:23.448080 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-8ed1ce34-ba95-4cec-955d-8d212c30638b None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:17:23.449378 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-8ed1ce34-ba95-4cec-955d-8d212c30638b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:17:23.465086 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10a4ee0-f19c-4c1d-b9cc-cef974942e94 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:23.508831 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:23.511415 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6cfd11-950f-4c14-8f2b-b03cbf21b07e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:23.512287 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6cfd11-950f-4c14-8f2b-b03cbf21b07e None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:23.513708 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6cfd11-950f-4c14-8f2b-b03cbf21b07e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:23.513708 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6cfd11-950f-4c14-8f2b-b03cbf21b07e None admin] PATH_INFO: `/v3/projects/d979106c8a164d55aa33fdb5ea995c7a` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:23.514533 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6cfd11-950f-4c14-8f2b-b03cbf21b07e None admin] RBAC: Authorizing `identity:get_project(project_id=d979106c8a164d55aa33fdb5ea995c7a)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:23.516150 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6cfd11-950f-4c14-8f2b-b03cbf21b07e None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:23.518452 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 215/429] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 01:17:23 2022] GET /identity/v3/projects/d979106c8a164d55aa33fdb5ea995c7a => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:23.519457 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6cfd11-950f-4c14-8f2b-b03cbf21b07e None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:23.536844 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 215/430] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:17:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 01:17:23.543677 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed1ce34-ba95-4cec-955d-8d212c30638b None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:23.651005 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed1ce34-ba95-4cec-955d-8d212c30638b None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:23.689312 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fab6c1d-1dec-45c8-90f2-16c37989cc76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:23.690034 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab6c1d-1dec-45c8-90f2-16c37989cc76 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:23.690398 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab6c1d-1dec-45c8-90f2-16c37989cc76 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:23.690856 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab6c1d-1dec-45c8-90f2-16c37989cc76 None admin] PATH_INFO: `/v3/groups/a9f36e31aa934f7bb325c0014e30e9be` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:23.692155 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fab6c1d-1dec-45c8-90f2-16c37989cc76 None admin] RBAC: Authorizing `identity:get_group(group_id=a9f36e31aa934f7bb325c0014e30e9be)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:23.693793 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fab6c1d-1dec-45c8-90f2-16c37989cc76 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:23.696267 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 216/431] 10.222.0.26 () {56 vars in 1180 bytes} [Fri Aug 12 01:17:23 2022] GET /identity/v3/groups/a9f36e31aa934f7bb325c0014e30e9be => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:23.701907 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fab6c1d-1dec-45c8-90f2-16c37989cc76 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:23.706285 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6cfd11-950f-4c14-8f2b-b03cbf21b07e None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:23.726392 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:23.762006 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:23.775463 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff136db6-8b62-4cd1-97b1-d958ce5a2e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:23.776133 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff136db6-8b62-4cd1-97b1-d958ce5a2e19 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:23.776427 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff136db6-8b62-4cd1-97b1-d958ce5a2e19 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:23.776678 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff136db6-8b62-4cd1-97b1-d958ce5a2e19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:23.777417 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff136db6-8b62-4cd1-97b1-d958ce5a2e19 None admin] RBAC: Adding query filter params (group.id=a9f36e31aa934f7bb325c0014e30e9be, role.id=bab2af60c26640acbd0c4db2f9796cfb, scope.project.id=d979106c8a164d55aa33fdb5ea995c7a) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:23.777722 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff136db6-8b62-4cd1-97b1-d958ce5a2e19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:23.779371 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff136db6-8b62-4cd1-97b1-d958ce5a2e19 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:23.786218 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 216/432] 10.222.0.26 () {56 vars in 1376 bytes} [Fri Aug 12 01:17:23 2022] GET /identity/v3/role_assignments?group.id=a9f36e31aa934f7bb325c0014e30e9be&scope.project.id=d979106c8a164d55aa33fdb5ea995c7a&role.id=bab2af60c26640acbd0c4db2f9796cfb => generated 611 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:23.861069 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fab6c1d-1dec-45c8-90f2-16c37989cc76 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:23.884289 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002f54e-d943-4829-b687-a18633b20498 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:23.884604 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002f54e-d943-4829-b687-a18633b20498 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:23.884829 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002f54e-d943-4829-b687-a18633b20498 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:23.887015 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 217/433] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:17:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:17:23.894859 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc6397-42c2-4a27-98ad-1866a0f9b061 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:23.895279 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc6397-42c2-4a27-98ad-1866a0f9b061 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:23.895563 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc6397-42c2-4a27-98ad-1866a0f9b061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:23.924606 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1ffe7c-0fc9-4ebf-8fc2-8c5eb260cd6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:23.925150 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ffe7c-0fc9-4ebf-8fc2-8c5eb260cd6f None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:23.925419 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ffe7c-0fc9-4ebf-8fc2-8c5eb260cd6f None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:23.925828 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ffe7c-0fc9-4ebf-8fc2-8c5eb260cd6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:23.926603 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1ffe7c-0fc9-4ebf-8fc2-8c5eb260cd6f None admin] RBAC: Adding query filter params (group.id=a9f36e31aa934f7bb325c0014e30e9be, role.id=13af81971c1c428eae0a571a22ea583d, scope.project.id=d979106c8a164d55aa33fdb5ea995c7a) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:23.926906 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1ffe7c-0fc9-4ebf-8fc2-8c5eb260cd6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:23.928882 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1ffe7c-0fc9-4ebf-8fc2-8c5eb260cd6f None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:23.929790 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-8edc6397-42c2-4a27-98ad-1866a0f9b061 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:17:23.931048 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-8edc6397-42c2-4a27-98ad-1866a0f9b061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:17:23.937166 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 217/434] 10.222.0.26 () {56 vars in 1376 bytes} [Fri Aug 12 01:17:23 2022] GET /identity/v3/role_assignments?group.id=a9f36e31aa934f7bb325c0014e30e9be&scope.project.id=d979106c8a164d55aa33fdb5ea995c7a&role.id=13af81971c1c428eae0a571a22ea583d => generated 611 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:23.938059 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1ffe7c-0fc9-4ebf-8fc2-8c5eb260cd6f None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:24.034415 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 218/435] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:17:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 01:17:24.039835 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c53cd2-926a-417a-92ca-36be68d3befa None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:24.039835 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c53cd2-926a-417a-92ca-36be68d3befa None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:24.039835 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c53cd2-926a-417a-92ca-36be68d3befa None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:24.042345 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 219/436] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:17:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:17:24.044060 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed7c789-2ada-473e-8543-a400315f9440 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:24.044342 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed7c789-2ada-473e-8543-a400315f9440 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:24.044616 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed7c789-2ada-473e-8543-a400315f9440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:24.066681 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-5ed7c789-2ada-473e-8543-a400315f9440 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:17:24.068504 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-5ed7c789-2ada-473e-8543-a400315f9440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:17:24.085067 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1ffe7c-0fc9-4ebf-8fc2-8c5eb260cd6f None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:24.103700 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:24.136273 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6974e3-414b-407e-b7b6-d7614d98901c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:24.137023 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6974e3-414b-407e-b7b6-d7614d98901c None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:24.137300 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6974e3-414b-407e-b7b6-d7614d98901c None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:24.137574 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6974e3-414b-407e-b7b6-d7614d98901c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:24.149981 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6974e3-414b-407e-b7b6-d7614d98901c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:17:24.157061 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-0f6974e3-414b-407e-b7b6-d7614d98901c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 12 01:17:24.157061 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:24.157061 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:24.157061 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:24.157061 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:24.157061 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:24.157061 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:24.157061 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:24.157061 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:24.157061 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:24.157061 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:24.157061 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:24.157061 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:17:24.157061 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:17:24.157061 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:17:24.157061 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:17:24.158259 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:17:24.158259 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:17:24.158259 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:17:24.158259 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:17:24.158259 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:24.158259 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:24.158259 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:24.158259 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:24.158259 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:24.158259 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:24.158259 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:24.158259 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:24.158259 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:24.158259 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:24.158259 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:24.158259 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:24.159035 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:24.159035 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:24.159035 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:24.159035 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:24.159035 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:17:24.159035 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:17:24.159035 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:17:24.159035 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:17:24.159035 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:17:24.159035 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:17:24.159035 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 12 01:17:24.159035 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:17:24.160024 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 218/437] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 01:17:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:24.166334 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6974e3-414b-407e-b7b6-d7614d98901c None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:24.173874 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 220/438] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:17:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 01:17:24.271673 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6974e3-414b-407e-b7b6-d7614d98901c None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:24.308156 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcfa83b-bbc0-44d1-9f64-9f0a61f43e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:24.308813 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcfa83b-bbc0-44d1-9f64-9f0a61f43e00 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:24.309095 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcfa83b-bbc0-44d1-9f64-9f0a61f43e00 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:24.309368 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcfa83b-bbc0-44d1-9f64-9f0a61f43e00 None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:24.310048 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcfa83b-bbc0-44d1-9f64-9f0a61f43e00 None admin] RBAC: Adding query filter params (name=member) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:24.310380 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcfa83b-bbc0-44d1-9f64-9f0a61f43e00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:24.311748 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcfa83b-bbc0-44d1-9f64-9f0a61f43e00 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:24.320129 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed7c789-2ada-473e-8543-a400315f9440 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:24.322909 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 219/439] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Aug 12 01:17:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:24.333040 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcfa83b-bbc0-44d1-9f64-9f0a61f43e00 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:24.364774 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:24.383189 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:24.459003 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed7c789-2ada-473e-8543-a400315f9440 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:24.475098 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcfa83b-bbc0-44d1-9f64-9f0a61f43e00 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:24.512212 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dea675-eeb7-4036-b878-de3f0ffcd74b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:24.512872 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dea675-eeb7-4036-b878-de3f0ffcd74b None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:24.513148 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dea675-eeb7-4036-b878-de3f0ffcd74b None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:24.513419 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dea675-eeb7-4036-b878-de3f0ffcd74b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:24.514069 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900f13d3-4a60-4736-bbae-b0def85b2ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:24.514709 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f13d3-4a60-4736-bbae-b0def85b2ee3 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:24.514991 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f13d3-4a60-4736-bbae-b0def85b2ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:24.515264 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f13d3-4a60-4736-bbae-b0def85b2ee3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:24.526394 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dea675-eeb7-4036-b878-de3f0ffcd74b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:17:24.533127 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-03dea675-eeb7-4036-b878-de3f0ffcd74b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 01:17:24.533127 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:24.533127 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:24.533127 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:24.533127 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:24.533127 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:24.533127 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:24.533127 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:24.533127 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:24.533127 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:24.533127 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:24.533127 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:24.533127 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:17:24.533127 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:17:24.533127 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:17:24.533127 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:17:24.534384 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:17:24.534384 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:17:24.534384 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:17:24.534384 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:17:24.534384 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:24.534384 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:24.534384 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:24.534384 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:24.534384 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:24.534384 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:24.534384 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:24.534384 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:24.534384 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:24.534384 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:24.534384 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:24.534384 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:24.535476 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:24.535476 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:24.535476 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:24.535476 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:24.535476 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:17:24.535476 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:17:24.535476 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:17:24.535476 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:17:24.535476 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:17:24.535476 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:17:24.535476 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 01:17:24.535476 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:17:24.535476 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 221/440] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Aug 12 01:17:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 01:17:24.535476 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dea675-eeb7-4036-b878-de3f0ffcd74b None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:24.602640 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900f13d3-4a60-4736-bbae-b0def85b2ee3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:24.604188 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900f13d3-4a60-4736-bbae-b0def85b2ee3 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:24.640569 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:24.649548 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:24.656622 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dea675-eeb7-4036-b878-de3f0ffcd74b None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:24.693057 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf8d079-cf93-4fa4-af13-06f2b6f2f43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:24.693685 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8d079-cf93-4fa4-af13-06f2b6f2f43a None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:24.694037 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8d079-cf93-4fa4-af13-06f2b6f2f43a None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:24.694511 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8d079-cf93-4fa4-af13-06f2b6f2f43a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:24.704563 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf8d079-cf93-4fa4-af13-06f2b6f2f43a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:17:24.709175 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-4cf8d079-cf93-4fa4-af13-06f2b6f2f43a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 01:17:24.709175 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:24.709175 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:24.709175 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:24.709175 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:24.709175 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:24.709175 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:24.709175 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:24.709175 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:24.709175 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:24.709175 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:24.709175 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:24.709175 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:17:24.709175 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:17:24.709175 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:17:24.709175 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:17:24.714961 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:17:24.714961 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:17:24.714961 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:17:24.714961 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:17:24.714961 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:24.714961 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:24.714961 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:24.714961 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:24.714961 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:24.714961 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:24.714961 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:24.714961 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:24.714961 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:24.714961 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:24.714961 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:24.714961 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:24.715766 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:24.715766 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:24.715766 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:24.715766 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:24.715766 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:17:24.715766 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:17:24.715766 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:17:24.715766 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:17:24.715766 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:17:24.715766 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:17:24.715766 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 01:17:24.715766 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:17:24.716356 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 220/441] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 01:17:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 01:17:24.716356 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900f13d3-4a60-4736-bbae-b0def85b2ee3 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:24.716475 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 222/442] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Aug 12 01:17:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:24.716475 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf8d079-cf93-4fa4-af13-06f2b6f2f43a None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:24.812617 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900f13d3-4a60-4736-bbae-b0def85b2ee3 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:24.813840 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf8d079-cf93-4fa4-af13-06f2b6f2f43a None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:24.840625 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:24.845751 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be390e0-6cbf-4bab-8dad-cb7d0f4addb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:24.846376 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be390e0-6cbf-4bab-8dad-cb7d0f4addb7 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:24.846594 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0bc1d2-242c-46cc-9975-2035966ef7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:24.846701 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be390e0-6cbf-4bab-8dad-cb7d0f4addb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:24.846901 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be390e0-6cbf-4bab-8dad-cb7d0f4addb7 None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:24.847217 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0bc1d2-242c-46cc-9975-2035966ef7df None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:24.847492 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0bc1d2-242c-46cc-9975-2035966ef7df None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:24.847599 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be390e0-6cbf-4bab-8dad-cb7d0f4addb7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:24.847760 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0bc1d2-242c-46cc-9975-2035966ef7df None admin] PATH_INFO: `/v3/projects/45a8fcf9582d42ccaffc8d521078eab0` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:24.847847 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be390e0-6cbf-4bab-8dad-cb7d0f4addb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:24.848940 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0bc1d2-242c-46cc-9975-2035966ef7df None admin] RBAC: Authorizing `identity:get_project(project_id=45a8fcf9582d42ccaffc8d521078eab0)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:24.849173 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be390e0-6cbf-4bab-8dad-cb7d0f4addb7 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:24.850962 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0bc1d2-242c-46cc-9975-2035966ef7df None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:24.852596 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 223/443] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 01:17:24 2022] GET /identity/v3/projects/45a8fcf9582d42ccaffc8d521078eab0 => generated 302 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:24.853341 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0bc1d2-242c-46cc-9975-2035966ef7df None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:24.864741 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 221/444] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 01:17:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:24.864741 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be390e0-6cbf-4bab-8dad-cb7d0f4addb7 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:24.881313 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:24.958440 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0bc1d2-242c-46cc-9975-2035966ef7df None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:24.959304 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be390e0-6cbf-4bab-8dad-cb7d0f4addb7 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:24.993420 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc296169-c730-4802-971d-78330e5cec8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:24.994028 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc296169-c730-4802-971d-78330e5cec8f None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:24.994265 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe0b8c3-433a-4155-9900-97801ac56bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:24.994366 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc296169-c730-4802-971d-78330e5cec8f None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:24.994584 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc296169-c730-4802-971d-78330e5cec8f None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:24.994854 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe0b8c3-433a-4155-9900-97801ac56bf8 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:24.995130 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe0b8c3-433a-4155-9900-97801ac56bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:24.995227 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc296169-c730-4802-971d-78330e5cec8f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:24.995402 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe0b8c3-433a-4155-9900-97801ac56bf8 None admin] PATH_INFO: `/v3/groups/a9f36e31aa934f7bb325c0014e30e9be` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:24.995539 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc296169-c730-4802-971d-78330e5cec8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:24.996506 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe0b8c3-433a-4155-9900-97801ac56bf8 None admin] RBAC: Authorizing `identity:get_group(group_id=a9f36e31aa934f7bb325c0014e30e9be)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:24.996915 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc296169-c730-4802-971d-78330e5cec8f None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:24.997933 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe0b8c3-433a-4155-9900-97801ac56bf8 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:24.999734 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 222/445] 10.222.0.26 () {56 vars in 1180 bytes} [Fri Aug 12 01:17:24 2022] GET /identity/v3/groups/a9f36e31aa934f7bb325c0014e30e9be => generated 226 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:25.000490 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe0b8c3-433a-4155-9900-97801ac56bf8 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:25.008235 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 224/446] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 01:17:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:25.009010 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc296169-c730-4802-971d-78330e5cec8f None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:25.067413 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:25.098489 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:25.106746 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe0b8c3-433a-4155-9900-97801ac56bf8 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:25.113810 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc296169-c730-4802-971d-78330e5cec8f None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:25.140644 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb504c8-5c0e-4fcd-b765-16c32cb7d8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:25.141247 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb504c8-5c0e-4fcd-b765-16c32cb7d8c4 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:25.141524 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb504c8-5c0e-4fcd-b765-16c32cb7d8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:25.141792 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb504c8-5c0e-4fcd-b765-16c32cb7d8c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:25.149511 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4214dfa9-e20c-45ed-8f19-4a833d388c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:25.150132 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4214dfa9-e20c-45ed-8f19-4a833d388c08 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:25.150404 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4214dfa9-e20c-45ed-8f19-4a833d388c08 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:25.150667 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4214dfa9-e20c-45ed-8f19-4a833d388c08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:25.151391 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4214dfa9-e20c-45ed-8f19-4a833d388c08 None admin] RBAC: Adding query filter params (group.id=a9f36e31aa934f7bb325c0014e30e9be, role.id=13af81971c1c428eae0a571a22ea583d, scope.project.id=45a8fcf9582d42ccaffc8d521078eab0) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:25.151694 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4214dfa9-e20c-45ed-8f19-4a833d388c08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:25.153121 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4214dfa9-e20c-45ed-8f19-4a833d388c08 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:25.159844 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 225/447] 10.222.0.26 () {56 vars in 1376 bytes} [Fri Aug 12 01:17:25 2022] GET /identity/v3/role_assignments?group.id=a9f36e31aa934f7bb325c0014e30e9be&scope.project.id=45a8fcf9582d42ccaffc8d521078eab0&role.id=13af81971c1c428eae0a571a22ea583d => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:25.160628 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4214dfa9-e20c-45ed-8f19-4a833d388c08 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:25.217147 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb504c8-5c0e-4fcd-b765-16c32cb7d8c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:25.218670 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb504c8-5c0e-4fcd-b765-16c32cb7d8c4 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:25.276262 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4214dfa9-e20c-45ed-8f19-4a833d388c08 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:25.286455 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:25.323364 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755e213a-da39-40f7-a829-ee8f97ad5c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:25.323900 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e213a-da39-40f7-a829-ee8f97ad5c82 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:25.324171 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e213a-da39-40f7-a829-ee8f97ad5c82 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:25.324427 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e213a-da39-40f7-a829-ee8f97ad5c82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:25.337041 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 223/448] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 01:17:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 01:17:25.342925 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb504c8-5c0e-4fcd-b765-16c32cb7d8c4 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:25.348925 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:25.409515 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755e213a-da39-40f7-a829-ee8f97ad5c82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:25.411030 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755e213a-da39-40f7-a829-ee8f97ad5c82 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:25.457789 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb504c8-5c0e-4fcd-b765-16c32cb7d8c4 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:25.500234 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b1ff1-ec37-4809-9cee-142f22fba89b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:25.500234 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b1ff1-ec37-4809-9cee-142f22fba89b None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:25.500470 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b1ff1-ec37-4809-9cee-142f22fba89b None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:25.500695 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b1ff1-ec37-4809-9cee-142f22fba89b None admin] PATH_INFO: `/v3/projects/45a8fcf9582d42ccaffc8d521078eab0` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:25.502530 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9b1ff1-ec37-4809-9cee-142f22fba89b None admin] RBAC: Authorizing `identity:get_project(project_id=45a8fcf9582d42ccaffc8d521078eab0)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:25.503259 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9b1ff1-ec37-4809-9cee-142f22fba89b None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:25.505115 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 224/449] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 01:17:25 2022] GET /identity/v3/projects/45a8fcf9582d42ccaffc8d521078eab0 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:17:25.511646 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b1ff1-ec37-4809-9cee-142f22fba89b None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:25.528735 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 226/450] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 01:17:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 01:17:25.534793 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755e213a-da39-40f7-a829-ee8f97ad5c82 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:25.540429 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:25.582338 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:25.609802 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b1ff1-ec37-4809-9cee-142f22fba89b None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:25.632061 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755e213a-da39-40f7-a829-ee8f97ad5c82 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:25.645549 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91558fec-1b0e-478d-a6f6-d02492be3e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:25.646252 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91558fec-1b0e-478d-a6f6-d02492be3e88 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:25.646527 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91558fec-1b0e-478d-a6f6-d02492be3e88 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:25.646785 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91558fec-1b0e-478d-a6f6-d02492be3e88 None admin] PATH_INFO: `/v3/groups/a9f36e31aa934f7bb325c0014e30e9be` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:25.647944 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91558fec-1b0e-478d-a6f6-d02492be3e88 None admin] RBAC: Authorizing `identity:get_group(group_id=a9f36e31aa934f7bb325c0014e30e9be)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:25.649385 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91558fec-1b0e-478d-a6f6-d02492be3e88 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:25.650995 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 225/451] 10.222.0.26 () {56 vars in 1180 bytes} [Fri Aug 12 01:17:25 2022] GET /identity/v3/groups/a9f36e31aa934f7bb325c0014e30e9be => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:17:25.656716 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91558fec-1b0e-478d-a6f6-d02492be3e88 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:25.669108 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e8855a-1317-40ab-b2d4-b977da4ade97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:25.669743 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e8855a-1317-40ab-b2d4-b977da4ade97 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:25.670013 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e8855a-1317-40ab-b2d4-b977da4ade97 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:25.670309 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e8855a-1317-40ab-b2d4-b977da4ade97 None admin] PATH_INFO: `/v3/projects/9f7a63ab9a434ddfb7cb138101d2e804` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:25.671517 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e8855a-1317-40ab-b2d4-b977da4ade97 None admin] RBAC: Authorizing `identity:get_project(project_id=9f7a63ab9a434ddfb7cb138101d2e804)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:25.672966 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e8855a-1317-40ab-b2d4-b977da4ade97 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:25.674620 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 227/452] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 01:17:25 2022] GET /identity/v3/projects/9f7a63ab9a434ddfb7cb138101d2e804 => generated 344 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:17:25.680076 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e8855a-1317-40ab-b2d4-b977da4ade97 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:25.754194 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:25.758277 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91558fec-1b0e-478d-a6f6-d02492be3e88 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:25.778802 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e8855a-1317-40ab-b2d4-b977da4ade97 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:25.792016 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8820bdb-e879-4391-8074-868ed06a7554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:25.793053 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8820bdb-e879-4391-8074-868ed06a7554 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:25.793332 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8820bdb-e879-4391-8074-868ed06a7554 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:25.793604 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8820bdb-e879-4391-8074-868ed06a7554 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:25.794363 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8820bdb-e879-4391-8074-868ed06a7554 None admin] RBAC: Adding query filter params (group.id=a9f36e31aa934f7bb325c0014e30e9be, role.id=bab2af60c26640acbd0c4db2f9796cfb, scope.project.id=45a8fcf9582d42ccaffc8d521078eab0) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:25.794678 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8820bdb-e879-4391-8074-868ed06a7554 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:25.794801 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:25.796200 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8820bdb-e879-4391-8074-868ed06a7554 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:25.802374 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 226/453] 10.222.0.26 () {56 vars in 1376 bytes} [Fri Aug 12 01:17:25 2022] GET /identity/v3/role_assignments?group.id=a9f36e31aa934f7bb325c0014e30e9be&scope.project.id=45a8fcf9582d42ccaffc8d521078eab0&role.id=bab2af60c26640acbd0c4db2f9796cfb => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:25.814353 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ad90c5-77d8-4bab-bb18-748c35a5d9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:25.815038 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad90c5-77d8-4bab-bb18-748c35a5d9cc None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:25.815317 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad90c5-77d8-4bab-bb18-748c35a5d9cc None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:25.815591 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad90c5-77d8-4bab-bb18-748c35a5d9cc None admin] PATH_INFO: `/v3/groups/62238f8dd2854ccca2a9c289420cec89` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:25.816866 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ad90c5-77d8-4bab-bb18-748c35a5d9cc None admin] RBAC: Authorizing `identity:get_group(group_id=62238f8dd2854ccca2a9c289420cec89)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:25.818377 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ad90c5-77d8-4bab-bb18-748c35a5d9cc None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:25.824993 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 228/454] 10.222.0.26 () {56 vars in 1180 bytes} [Fri Aug 12 01:17:25 2022] GET /identity/v3/groups/62238f8dd2854ccca2a9c289420cec89 => generated 229 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:25.826360 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8820bdb-e879-4391-8074-868ed06a7554 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:25.934284 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8820bdb-e879-4391-8074-868ed06a7554 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:25.969640 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c68d603-aecc-4e46-9c2d-df2c95edd9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:25.970275 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68d603-aecc-4e46-9c2d-df2c95edd9cd None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:25.970546 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68d603-aecc-4e46-9c2d-df2c95edd9cd None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:25.970814 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68d603-aecc-4e46-9c2d-df2c95edd9cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:25.971555 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c68d603-aecc-4e46-9c2d-df2c95edd9cd None admin] RBAC: Adding query filter params (group.id=62238f8dd2854ccca2a9c289420cec89, role.id=fb48693810be495fb4b1893a79429b78, scope.project.id=9f7a63ab9a434ddfb7cb138101d2e804) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:25.971860 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c68d603-aecc-4e46-9c2d-df2c95edd9cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:25.973274 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c68d603-aecc-4e46-9c2d-df2c95edd9cd None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:25.979311 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 227/455] 10.222.0.26 () {56 vars in 1376 bytes} [Fri Aug 12 01:17:25 2022] GET /identity/v3/role_assignments?group.id=62238f8dd2854ccca2a9c289420cec89&scope.project.id=9f7a63ab9a434ddfb7cb138101d2e804&role.id=fb48693810be495fb4b1893a79429b78 => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:28.320677 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e4385-a52d-4aec-b6cb-a5895e4399e0 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:28.321206 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e4385-a52d-4aec-b6cb-a5895e4399e0 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:28.321206 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9e4385-a52d-4aec-b6cb-a5895e4399e0 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:28.322740 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 229/456] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:17:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:17:28.340188 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531a0a9-f60b-4ba7-b104-0e308e84175b None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:28.340674 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531a0a9-f60b-4ba7-b104-0e308e84175b None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:28.340748 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531a0a9-f60b-4ba7-b104-0e308e84175b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:28.367475 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-d531a0a9-f60b-4ba7-b104-0e308e84175b None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:17:28.368686 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-d531a0a9-f60b-4ba7-b104-0e308e84175b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:17:28.393287 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:28.464641 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 228/457] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:17:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 01:17:28.579103 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11d40d-6f85-4772-bc27-27cdb6b605b3 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:28.579652 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11d40d-6f85-4772-bc27-27cdb6b605b3 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:28.580095 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11d40d-6f85-4772-bc27-27cdb6b605b3 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:28.581588 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 230/458] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:17:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:17:28.587010 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b713e1-8a9f-4f53-bcf8-a37ed07008f8 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:28.587554 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b713e1-8a9f-4f53-bcf8-a37ed07008f8 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:28.588018 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b713e1-8a9f-4f53-bcf8-a37ed07008f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:28.614242 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-d7b713e1-8a9f-4f53-bcf8-a37ed07008f8 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:17:28.616438 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-d7b713e1-8a9f-4f53-bcf8-a37ed07008f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:17:28.676724 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4840b0-bf03-4409-b2a2-ed8d99131e39 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:28.677355 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4840b0-bf03-4409-b2a2-ed8d99131e39 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:28.677874 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4840b0-bf03-4409-b2a2-ed8d99131e39 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:28.679551 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 231/459] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:17:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:17:28.684935 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2675e02c-f866-4d4a-8cfb-85c598efdda1 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:28.685521 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2675e02c-f866-4d4a-8cfb-85c598efdda1 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:28.685937 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2675e02c-f866-4d4a-8cfb-85c598efdda1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:28.699369 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 229/460] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:17:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 01:17:28.723054 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-2675e02c-f866-4d4a-8cfb-85c598efdda1 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:17:28.724488 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2675e02c-f866-4d4a-8cfb-85c598efdda1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:17:28.806975 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b713e1-8a9f-4f53-bcf8-a37ed07008f8 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:28.822145 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 232/461] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:17:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 01:17:28.938561 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:28.956892 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b713e1-8a9f-4f53-bcf8-a37ed07008f8 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:28.979928 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d077d-c6a6-476e-a020-29dc3be331d8 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:28.980207 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d077d-c6a6-476e-a020-29dc3be331d8 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:28.980690 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d077d-c6a6-476e-a020-29dc3be331d8 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:28.982581 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 233/462] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:17:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 01:17:28.989147 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd75c0-9be6-4fc9-90d6-169dc67d907b None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:28.989680 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd75c0-9be6-4fc9-90d6-169dc67d907b None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:28.990166 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd75c0-9be6-4fc9-90d6-169dc67d907b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:28.991055 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cda77b6-bf89-4739-a8b4-b8650eee8673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:28.991713 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda77b6-bf89-4739-a8b4-b8650eee8673 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:28.992049 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda77b6-bf89-4739-a8b4-b8650eee8673 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:28.992320 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda77b6-bf89-4739-a8b4-b8650eee8673 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:29.002884 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cda77b6-bf89-4739-a8b4-b8650eee8673 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:29.004590 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cda77b6-bf89-4739-a8b4-b8650eee8673 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:29.025578 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-0cda77b6-bf89-4739-a8b4-b8650eee8673 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:29.025578 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:29.025578 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:29.025578 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:29.025578 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:29.025578 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:29.025578 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:29.025578 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:29.025578 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:29.025578 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:29.025578 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:29.025578 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:29.025578 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 01:17:29.025578 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 01:17:29.025578 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 01:17:29.025578 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 01:17:29.026639 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:29.026639 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:29.026639 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:29.026639 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:29.026639 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:29.026639 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:29.026639 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:29.026639 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:29.026639 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:29.026639 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:29.026639 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:29.026639 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:29.026639 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:29.026639 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:29.026639 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:29.026639 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:29.026639 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 01:17:29.027460 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 01:17:29.027460 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:29.027460 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:17:29.027460 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 230/463] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:17:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 01:17:29.028109 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cda77b6-bf89-4739-a8b4-b8650eee8673 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:29.030582 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-96bd75c0-9be6-4fc9-90d6-169dc67d907b None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:17:29.032035 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-96bd75c0-9be6-4fc9-90d6-169dc67d907b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:17:29.111292 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 234/464] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:17:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 01:17:29.112455 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bd75c0-9be6-4fc9-90d6-169dc67d907b None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:29.139603 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cda77b6-bf89-4739-a8b4-b8650eee8673 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:29.173062 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:29.184740 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78dab64-c627-44ce-8fb3-69f0fc7d7b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:29.185389 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78dab64-c627-44ce-8fb3-69f0fc7d7b44 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:29.185665 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78dab64-c627-44ce-8fb3-69f0fc7d7b44 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:29.185936 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78dab64-c627-44ce-8fb3-69f0fc7d7b44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:29.193686 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:29.197628 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78dab64-c627-44ce-8fb3-69f0fc7d7b44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:29.199435 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78dab64-c627-44ce-8fb3-69f0fc7d7b44 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:29.215023 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-e78dab64-c627-44ce-8fb3-69f0fc7d7b44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:29.215023 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:29.215023 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:29.215023 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:29.215023 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:29.215023 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:29.215023 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:29.215023 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:29.215023 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:29.215023 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:29.215023 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:29.215023 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:29.215023 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 01:17:29.215023 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 01:17:29.215023 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 01:17:29.215023 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 01:17:29.215934 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:29.215934 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:29.215934 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:29.215934 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:29.215934 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:29.215934 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:29.215934 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:29.215934 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:29.215934 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:29.215934 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:29.215934 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:29.215934 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:29.215934 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:29.215934 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:29.215934 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:29.215934 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:29.215934 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 01:17:29.216762 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 01:17:29.216762 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:29.216762 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:17:29.218614 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 231/465] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:17:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:29.224125 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78dab64-c627-44ce-8fb3-69f0fc7d7b44 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:29.230830 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bd75c0-9be6-4fc9-90d6-169dc67d907b None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:29.265802 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a19f814-8f65-4434-9f8d-4da81e45d1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:29.266454 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a19f814-8f65-4434-9f8d-4da81e45d1d8 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:29.266724 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a19f814-8f65-4434-9f8d-4da81e45d1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:29.266987 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a19f814-8f65-4434-9f8d-4da81e45d1d8 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:29.267985 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a19f814-8f65-4434-9f8d-4da81e45d1d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:29.268091 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a19f814-8f65-4434-9f8d-4da81e45d1d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:29.269519 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a19f814-8f65-4434-9f8d-4da81e45d1d8 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:29.288291 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 235/466] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 01:17:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:29.289243 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a19f814-8f65-4434-9f8d-4da81e45d1d8 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:29.334180 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78dab64-c627-44ce-8fb3-69f0fc7d7b44 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:29.370257 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2beb8e9-c10b-4536-bfd4-c7eeedaae57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:29.371709 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2beb8e9-c10b-4536-bfd4-c7eeedaae57e None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:29.372156 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2beb8e9-c10b-4536-bfd4-c7eeedaae57e None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:29.372593 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2beb8e9-c10b-4536-bfd4-c7eeedaae57e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:29.384299 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2beb8e9-c10b-4536-bfd4-c7eeedaae57e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:29.386064 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2beb8e9-c10b-4536-bfd4-c7eeedaae57e None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:29.392495 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a19f814-8f65-4434-9f8d-4da81e45d1d8 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:29.395668 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:29.401556 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-b2beb8e9-c10b-4536-bfd4-c7eeedaae57e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:29.401556 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:29.401556 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:29.401556 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:29.401556 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:29.401556 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:29.401556 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:29.401556 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:29.401556 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:29.401556 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:29.401556 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:29.401556 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:29.401556 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 01:17:29.401556 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 01:17:29.401556 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 01:17:29.401556 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 01:17:29.402586 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:29.402586 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:29.402586 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:29.402586 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:29.402586 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:29.402586 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:29.402586 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:29.402586 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:29.402586 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:29.402586 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:29.402586 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:29.402586 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:29.402586 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:29.402586 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:29.402586 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:29.402586 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:29.402586 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 01:17:29.403426 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 01:17:29.403426 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:29.403426 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:17:29.403426 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 232/467] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:17:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:29.403982 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2beb8e9-c10b-4536-bfd4-c7eeedaae57e None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:29.436947 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede9776f-665f-4230-bef5-57509a48ec98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:29.437657 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9776f-665f-4230-bef5-57509a48ec98 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:29.437927 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9776f-665f-4230-bef5-57509a48ec98 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:29.438213 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9776f-665f-4230-bef5-57509a48ec98 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:29.438847 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede9776f-665f-4230-bef5-57509a48ec98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:29.439196 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede9776f-665f-4230-bef5-57509a48ec98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:29.440660 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede9776f-665f-4230-bef5-57509a48ec98 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:29.449290 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:29.454681 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 236/468] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 01:17:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:29.455371 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede9776f-665f-4230-bef5-57509a48ec98 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:29.517615 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2beb8e9-c10b-4536-bfd4-c7eeedaae57e None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:29.553313 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1815cbf-2ed0-49b6-adea-674f2856fdf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:29.553916 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1815cbf-2ed0-49b6-adea-674f2856fdf3 None admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:29.554230 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1815cbf-2ed0-49b6-adea-674f2856fdf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:29.554502 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1815cbf-2ed0-49b6-adea-674f2856fdf3 None admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:29.555143 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1815cbf-2ed0-49b6-adea-674f2856fdf3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:29.556588 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1815cbf-2ed0-49b6-adea-674f2856fdf3 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:29.565991 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede9776f-665f-4230-bef5-57509a48ec98 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:29.578310 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 233/469] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Aug 12 01:17:29 2022] POST /identity/v3/users => generated 246 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:17:29.578310 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1815cbf-2ed0-49b6-adea-674f2856fdf3 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:29.612859 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db96a2a7-a0dd-4533-9c8b-4aa7283180ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:29.613609 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db96a2a7-a0dd-4533-9c8b-4aa7283180ea None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:29.613955 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db96a2a7-a0dd-4533-9c8b-4aa7283180ea None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:29.614408 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db96a2a7-a0dd-4533-9c8b-4aa7283180ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:29.627403 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db96a2a7-a0dd-4533-9c8b-4aa7283180ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:29.629063 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db96a2a7-a0dd-4533-9c8b-4aa7283180ea None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:29.647458 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-db96a2a7-a0dd-4533-9c8b-4aa7283180ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:29.647458 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:29.647458 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:29.647458 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:29.647458 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:29.647458 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:29.647458 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:29.647458 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:29.647458 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:29.647458 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:29.647458 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:29.647458 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:29.647458 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 01:17:29.647458 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 01:17:29.647458 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 01:17:29.647458 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 01:17:29.648408 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:29.648408 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:29.648408 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:29.648408 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:29.648408 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:29.648408 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:29.648408 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:29.648408 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:29.648408 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:29.648408 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:29.648408 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:29.648408 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:29.648408 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:29.648408 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:29.648408 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:29.648408 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:29.648408 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 01:17:29.649233 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 01:17:29.649233 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:29.649233 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:17:29.654620 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 237/470] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:17:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:29.655902 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db96a2a7-a0dd-4533-9c8b-4aa7283180ea None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:29.681778 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:29.712173 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:29.719327 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1815cbf-2ed0-49b6-adea-674f2856fdf3 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:29.761528 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f35f2-7630-42de-b3b0-d4f5182e91b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:29.762526 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f35f2-7630-42de-b3b0-d4f5182e91b0 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:29.763023 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f35f2-7630-42de-b3b0-d4f5182e91b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:29.763487 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f35f2-7630-42de-b3b0-d4f5182e91b0 None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:29.764207 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543f35f2-7630-42de-b3b0-d4f5182e91b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:29.764568 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543f35f2-7630-42de-b3b0-d4f5182e91b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:29.766909 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543f35f2-7630-42de-b3b0-d4f5182e91b0 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:29.786555 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 234/471] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 01:17:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:29.791101 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f35f2-7630-42de-b3b0-d4f5182e91b0 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:29.801024 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db96a2a7-a0dd-4533-9c8b-4aa7283180ea None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:29.839897 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f38b3f-55f1-41fd-9317-b1b0bfb5c4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:29.840512 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f38b3f-55f1-41fd-9317-b1b0bfb5c4e9 None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:29.841055 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f38b3f-55f1-41fd-9317-b1b0bfb5c4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:29.841055 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f38b3f-55f1-41fd-9317-b1b0bfb5c4e9 None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:29.841682 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f38b3f-55f1-41fd-9317-b1b0bfb5c4e9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:29.843144 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f38b3f-55f1-41fd-9317-b1b0bfb5c4e9 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:29.867940 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 238/472] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Aug 12 01:17:29 2022] POST /identity/v3/users => generated 248 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:17:29.874471 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f38b3f-55f1-41fd-9317-b1b0bfb5c4e9 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:29.913090 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f35f2-7630-42de-b3b0-d4f5182e91b0 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:29.953723 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52735f7-e596-49a5-a8ae-1f44f6bd1be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:29.954396 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52735f7-e596-49a5-a8ae-1f44f6bd1be1 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:29.955122 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52735f7-e596-49a5-a8ae-1f44f6bd1be1 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:29.955122 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52735f7-e596-49a5-a8ae-1f44f6bd1be1 None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:29.955613 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52735f7-e596-49a5-a8ae-1f44f6bd1be1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:29.955917 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52735f7-e596-49a5-a8ae-1f44f6bd1be1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:29.957317 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52735f7-e596-49a5-a8ae-1f44f6bd1be1 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:29.970211 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 235/473] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 01:17:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:29.975343 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52735f7-e596-49a5-a8ae-1f44f6bd1be1 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:29.978523 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:29.998287 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:30.030778 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f38b3f-55f1-41fd-9317-b1b0bfb5c4e9 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:30.088067 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6097bbc3-de4f-43db-aba3-1f5b29892af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:30.088991 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097bbc3-de4f-43db-aba3-1f5b29892af1 None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:30.088991 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097bbc3-de4f-43db-aba3-1f5b29892af1 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:30.089252 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097bbc3-de4f-43db-aba3-1f5b29892af1 None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:30.089899 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6097bbc3-de4f-43db-aba3-1f5b29892af1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:30.091441 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6097bbc3-de4f-43db-aba3-1f5b29892af1 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:30.131595 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 239/474] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Aug 12 01:17:29 2022] POST /identity/v3/users => generated 248 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:17:30.133497 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f45d4-8aa1-4d67-8557-a21cbe7a6d84 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:30.133910 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f45d4-8aa1-4d67-8557-a21cbe7a6d84 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:30.135271 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f45d4-8aa1-4d67-8557-a21cbe7a6d84 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:30.138838 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 240/475] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:17:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:17:30.144193 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe7452-4987-41c0-84eb-f983befa447b None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:30.144613 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe7452-4987-41c0-84eb-f983befa447b None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:30.145007 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe7452-4987-41c0-84eb-f983befa447b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:30.147115 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52735f7-e596-49a5-a8ae-1f44f6bd1be1 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:30.169920 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-acfe7452-4987-41c0-84eb-f983befa447b None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:17:30.171336 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-acfe7452-4987-41c0-84eb-f983befa447b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:17:30.192040 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9ba428-75ad-45e5-b74e-e372d591509b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:30.193075 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ba428-75ad-45e5-b74e-e372d591509b None admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:30.193588 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ba428-75ad-45e5-b74e-e372d591509b None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:30.194192 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ba428-75ad-45e5-b74e-e372d591509b None admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:30.195278 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9ba428-75ad-45e5-b74e-e372d591509b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:30.197104 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9ba428-75ad-45e5-b74e-e372d591509b None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:30.229783 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 236/476] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Aug 12 01:17:29 2022] POST /identity/v3/users => generated 249 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:17:30.263980 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 241/477] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:17:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 01:17:30.536768 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9ba428-75ad-45e5-b74e-e372d591509b None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:30.617534 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:30.651914 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9ba428-75ad-45e5-b74e-e372d591509b None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:30.692778 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78122dcb-4845-456b-9776-e9519a800f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:30.693416 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78122dcb-4845-456b-9776-e9519a800f46 None admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:30.693695 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78122dcb-4845-456b-9776-e9519a800f46 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:30.693969 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78122dcb-4845-456b-9776-e9519a800f46 None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:30.694712 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78122dcb-4845-456b-9776-e9519a800f46 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:30.696076 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78122dcb-4845-456b-9776-e9519a800f46 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:30.708194 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.sql.core [None req-78122dcb-4845-456b-9776-e9519a800f46 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 12 01:17:30.708194 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 12 01:17:30.708194 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [parameters: {'id': '4d495bfc5c734b939be29d290108bc9f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 12 01:17:30.708194 dv-cinder-784815-15-smb devstack@keystone.service[81555]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81555) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 12 01:17:30.729151 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-78122dcb-4845-456b-9776-e9519a800f46 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 12 01:17:30.729151 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:30.729151 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 12 01:17:30.729151 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 12 01:17:30.729151 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 12 01:17:30.729151 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 12 01:17:30.729151 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 12 01:17:30.729151 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application result = self._query(query) Aug 12 01:17:30.729151 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 12 01:17:30.729151 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application conn.query(q) Aug 12 01:17:30.729151 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 12 01:17:30.729151 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 12 01:17:30.729151 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 12 01:17:30.729151 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application result.read() Aug 12 01:17:30.729151 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 12 01:17:30.730083 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 12 01:17:30.730083 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 12 01:17:30.730083 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 12 01:17:30.730083 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 12 01:17:30.730083 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 12 01:17:30.730083 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 12 01:17:30.730083 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 12 01:17:30.730083 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 12 01:17:30.730083 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:17:30.730083 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 12 01:17:30.730083 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:17:30.730083 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:30.730083 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 12 01:17:30.730083 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 12 01:17:30.730083 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 12 01:17:30.730083 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return ref.to_dict() Aug 12 01:17:30.730083 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 12 01:17:30.730083 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application next(self.gen) Aug 12 01:17:30.731063 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 12 01:17:30.731063 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application yield resource Aug 12 01:17:30.731063 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 12 01:17:30.731063 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application next(self.gen) Aug 12 01:17:30.731063 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 12 01:17:30.731063 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self.session.rollback() Aug 12 01:17:30.731063 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 12 01:17:30.731063 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self.force_reraise() Aug 12 01:17:30.731063 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 12 01:17:30.731063 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise self.value Aug 12 01:17:30.731063 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 12 01:17:30.731063 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 12 01:17:30.731063 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 12 01:17:30.731063 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application session.commit() Aug 12 01:17:30.731063 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 12 01:17:30.731063 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 12 01:17:30.731063 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 12 01:17:30.731925 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self._prepare_impl() Aug 12 01:17:30.731925 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 12 01:17:30.731925 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self.session.flush() Aug 12 01:17:30.731925 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 12 01:17:30.731925 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self._flush(objects) Aug 12 01:17:30.731925 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 12 01:17:30.731925 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 12 01:17:30.731925 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 12 01:17:30.731925 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application compat.raise_( Aug 12 01:17:30.731925 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 12 01:17:30.731925 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception Aug 12 01:17:30.731925 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 12 01:17:30.731925 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application flush_context.execute() Aug 12 01:17:30.731925 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 12 01:17:30.731925 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rec.execute(self) Aug 12 01:17:30.731925 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 12 01:17:30.731925 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 12 01:17:30.732790 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 12 01:17:30.732790 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 12 01:17:30.732790 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 12 01:17:30.732790 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 12 01:17:30.732790 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 12 01:17:30.732790 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 12 01:17:30.732790 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 12 01:17:30.732790 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 12 01:17:30.732790 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 12 01:17:30.732790 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 12 01:17:30.732790 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 12 01:17:30.732790 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 12 01:17:30.732790 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 12 01:17:30.732790 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 12 01:17:30.732790 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 12 01:17:30.732790 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception Aug 12 01:17:30.733585 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 12 01:17:30.733585 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 12 01:17:30.733585 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 12 01:17:30.733585 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 12 01:17:30.733585 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 12 01:17:30.733585 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application result = self._query(query) Aug 12 01:17:30.733585 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 12 01:17:30.733585 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application conn.query(q) Aug 12 01:17:30.733585 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 12 01:17:30.733585 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 12 01:17:30.733585 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 12 01:17:30.733585 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application result.read() Aug 12 01:17:30.733585 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 12 01:17:30.733585 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 12 01:17:30.733585 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 12 01:17:30.733585 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 12 01:17:30.735755 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 12 01:17:30.735755 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 12 01:17:30.735755 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 12 01:17:30.735755 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 12 01:17:30.735755 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 12 01:17:30.735755 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 12 01:17:30.735755 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [parameters: {'id': '4d495bfc5c734b939be29d290108bc9f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 12 01:17:30.735755 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 12 01:17:30.735755 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:17:30.735755 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 01:17:30.735755 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:17:30.735755 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:30.735755 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:30.735755 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:30.735755 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:30.735755 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:30.737627 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:30.737627 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:30.737627 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:30.737627 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:30.737627 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:30.737627 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:30.737627 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 12 01:17:30.737627 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 12 01:17:30.737627 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:30.737627 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:30.737627 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 12 01:17:30.737627 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 12 01:17:30.737627 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 12 01:17:30.737627 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 12 01:17:30.737627 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 12 01:17:30.737627 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:17:30.739536 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 237/478] 10.222.0.26 () {60 vars in 1131 bytes} [Fri Aug 12 01:17:30 2022] POST /identity/v3/roles => generated 144 bytes in 194 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:30.739667 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe7452-4987-41c0-84eb-f983befa447b None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:30.813222 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:30.856489 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe7452-4987-41c0-84eb-f983befa447b None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:30.892037 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d70ce3-532e-434f-b52f-f0368d94cf02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:30.892683 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d70ce3-532e-434f-b52f-f0368d94cf02 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:30.892960 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d70ce3-532e-434f-b52f-f0368d94cf02 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:30.893228 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d70ce3-532e-434f-b52f-f0368d94cf02 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:30.903827 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d70ce3-532e-434f-b52f-f0368d94cf02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:17:30.908509 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-98d70ce3-532e-434f-b52f-f0368d94cf02 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 01:17:30.908509 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:30.908509 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:30.908509 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:30.908509 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:30.908509 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:30.908509 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:30.908509 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:30.908509 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:30.908509 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:30.908509 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:30.908509 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:30.908509 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:17:30.908509 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:17:30.908509 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:17:30.908509 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:17:30.910540 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:17:30.910540 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:17:30.910540 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:17:30.910540 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:17:30.910540 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:30.910540 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:30.910540 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:30.910540 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:30.910540 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:30.910540 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:30.910540 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:30.910540 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:30.910540 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:30.910540 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:30.910540 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:30.910540 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:30.912448 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:30.912448 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:30.912448 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:30.912448 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:30.912448 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:17:30.912448 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:17:30.912448 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:17:30.912448 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:17:30.912448 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:17:30.912448 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:17:30.912448 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 12 01:17:30.912448 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:17:30.912448 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 242/479] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Aug 12 01:17:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:30.916071 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78122dcb-4845-456b-9776-e9519a800f46 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:31.034030 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78122dcb-4845-456b-9776-e9519a800f46 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:31.078029 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd9cd64-c429-4bd0-981e-96988ec9fe66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:31.078605 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9cd64-c429-4bd0-981e-96988ec9fe66 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:31.078881 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9cd64-c429-4bd0-981e-96988ec9fe66 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:31.079203 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9cd64-c429-4bd0-981e-96988ec9fe66 None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:31.079885 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd9cd64-c429-4bd0-981e-96988ec9fe66 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:31.080235 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd9cd64-c429-4bd0-981e-96988ec9fe66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:31.081617 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd9cd64-c429-4bd0-981e-96988ec9fe66 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:31.092818 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 238/480] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 01:17:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:31.093328 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:32.047411 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ffa5c-86ee-4918-8993-57e65085aeab None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:32.047932 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ffa5c-86ee-4918-8993-57e65085aeab None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:32.047932 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ffa5c-86ee-4918-8993-57e65085aeab None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:32.049556 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 243/481] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:17:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:17:32.054889 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03014a-a23f-4323-b60d-e0c5be8e8d2e None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:32.055365 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03014a-a23f-4323-b60d-e0c5be8e8d2e None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:32.055550 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03014a-a23f-4323-b60d-e0c5be8e8d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:32.079142 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-6d03014a-a23f-4323-b60d-e0c5be8e8d2e None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:17:32.080338 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-6d03014a-a23f-4323-b60d-e0c5be8e8d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:17:32.164046 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 239/482] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:17:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 01:17:32.483999 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19ffa5c-86ee-4918-8993-57e65085aeab None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:32.500757 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3db2a-22a2-4405-9a7c-5e98b2df5ca5 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:32.501043 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3db2a-22a2-4405-9a7c-5e98b2df5ca5 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:32.501323 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3db2a-22a2-4405-9a7c-5e98b2df5ca5 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:32.503402 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 240/483] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:17:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 01:17:32.509566 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a74f35-a5f1-4855-8ea1-eddffcff5949 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:32.509852 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a74f35-a5f1-4855-8ea1-eddffcff5949 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:32.510144 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a74f35-a5f1-4855-8ea1-eddffcff5949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:32.547617 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-47a74f35-a5f1-4855-8ea1-eddffcff5949 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:17:32.548914 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-47a74f35-a5f1-4855-8ea1-eddffcff5949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:17:32.667932 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19ffa5c-86ee-4918-8993-57e65085aeab None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:32.669552 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 241/484] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:17:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 01:17:32.671728 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1c182-ff08-4cc4-b667-41bc0b7a6f33 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:32.672018 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1c182-ff08-4cc4-b667-41bc0b7a6f33 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:32.672294 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1c182-ff08-4cc4-b667-41bc0b7a6f33 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:32.678073 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 242/485] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:17:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:17:32.679253 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3460425-3fcd-45dc-9150-8bdf3b8b6e79 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:32.679903 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3460425-3fcd-45dc-9150-8bdf3b8b6e79 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:32.680187 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3460425-3fcd-45dc-9150-8bdf3b8b6e79 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:32.681871 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 243/486] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:17:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:17:32.682987 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af59d1-2dc8-4d0f-a37a-ea4bfe43adbd None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:32.683269 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af59d1-2dc8-4d0f-a37a-ea4bfe43adbd None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:32.683542 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af59d1-2dc8-4d0f-a37a-ea4bfe43adbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:32.698506 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:32.705729 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-d3af59d1-2dc8-4d0f-a37a-ea4bfe43adbd None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:17:32.707646 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-d3af59d1-2dc8-4d0f-a37a-ea4bfe43adbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:17:32.712898 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c504756d-2915-402d-8c2f-2e79e9b291fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:32.713709 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c504756d-2915-402d-8c2f-2e79e9b291fa None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:32.714268 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c504756d-2915-402d-8c2f-2e79e9b291fa None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:32.714636 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c504756d-2915-402d-8c2f-2e79e9b291fa None admin] PATH_INFO: `/v3/roles/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:32.729072 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c504756d-2915-402d-8c2f-2e79e9b291fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:17:32.733812 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-c504756d-2915-402d-8c2f-2e79e9b291fa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 01:17:32.733812 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:32.733812 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:32.733812 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:32.733812 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:32.733812 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:32.733812 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:32.733812 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:32.733812 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:32.733812 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:32.733812 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:32.733812 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:32.733812 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:17:32.733812 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:17:32.733812 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:17:32.733812 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:17:32.734824 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:17:32.734824 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:17:32.734824 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:17:32.734824 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:17:32.734824 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:32.734824 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:32.734824 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:32.734824 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:32.734824 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:32.734824 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:32.734824 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:32.734824 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:32.734824 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:32.734824 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:32.734824 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:32.734824 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:32.735636 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:32.735636 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:32.735636 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:32.735636 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:32.735636 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:17:32.735636 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:17:32.735636 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:17:32.735636 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:17:32.735636 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:17:32.735636 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:17:32.735636 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 01:17:32.735636 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:17:32.735636 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 244/487] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Aug 12 01:17:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:32.740746 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da890544-8767-448c-ab2a-464efda32ccc None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:32.740746 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da890544-8767-448c-ab2a-464efda32ccc None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:32.740746 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da890544-8767-448c-ab2a-464efda32ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:32.757796 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-da890544-8767-448c-ab2a-464efda32ccc None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:17:32.759582 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-da890544-8767-448c-ab2a-464efda32ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:17:32.771513 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:32.785311 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 244/488] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:17:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 01:17:32.786402 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af59d1-2dc8-4d0f-a37a-ea4bfe43adbd None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:32.876343 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 245/489] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:17:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 01:17:32.939903 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af59d1-2dc8-4d0f-a37a-ea4bfe43adbd None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:32.945770 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da890544-8767-448c-ab2a-464efda32ccc None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:32.978302 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83292c5e-5fe5-46b6-85d2-ea65bd9d58b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:32.979185 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83292c5e-5fe5-46b6-85d2-ea65bd9d58b4 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:32.979600 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83292c5e-5fe5-46b6-85d2-ea65bd9d58b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:32.980003 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83292c5e-5fe5-46b6-85d2-ea65bd9d58b4 None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:32.980804 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83292c5e-5fe5-46b6-85d2-ea65bd9d58b4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:32.981238 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83292c5e-5fe5-46b6-85d2-ea65bd9d58b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:32.982885 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83292c5e-5fe5-46b6-85d2-ea65bd9d58b4 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:32.993524 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 245/490] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Aug 12 01:17:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:32.999000 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83292c5e-5fe5-46b6-85d2-ea65bd9d58b4 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:33.075798 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:33.125128 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83292c5e-5fe5-46b6-85d2-ea65bd9d58b4 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:33.163136 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da890544-8767-448c-ab2a-464efda32ccc None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:33.168275 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe62325d-5f77-4aa9-99b7-6931a6ebe6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:33.168984 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62325d-5f77-4aa9-99b7-6931a6ebe6e5 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:33.169325 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62325d-5f77-4aa9-99b7-6931a6ebe6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:33.169660 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62325d-5f77-4aa9-99b7-6931a6ebe6e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:33.175001 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:33.183350 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe62325d-5f77-4aa9-99b7-6931a6ebe6e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:33.185084 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe62325d-5f77-4aa9-99b7-6931a6ebe6e5 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:33.201220 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-fe62325d-5f77-4aa9-99b7-6931a6ebe6e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:33.201220 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:33.201220 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:33.201220 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:33.201220 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:33.201220 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:33.201220 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:33.201220 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:33.201220 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:33.201220 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:33.201220 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:33.201220 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:33.201220 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 01:17:33.201220 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 01:17:33.201220 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 01:17:33.201220 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 01:17:33.202200 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:33.202200 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:33.202200 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:33.202200 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:33.202200 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:33.202200 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:33.202200 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:33.202200 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:33.202200 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:33.202200 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:33.202200 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:33.202200 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:33.202200 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:33.202200 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:33.202200 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:33.202200 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:33.202200 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 01:17:33.203029 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 01:17:33.203029 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:33.203029 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:17:33.203029 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 246/491] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:17:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:33.203886 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe62325d-5f77-4aa9-99b7-6931a6ebe6e5 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:33.204476 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3580f3-d0c4-4f0a-b4fe-d81be567d00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:33.205114 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3580f3-d0c4-4f0a-b4fe-d81be567d00b None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:33.205388 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3580f3-d0c4-4f0a-b4fe-d81be567d00b None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:33.205652 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3580f3-d0c4-4f0a-b4fe-d81be567d00b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:33.216846 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3580f3-d0c4-4f0a-b4fe-d81be567d00b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:17:33.221541 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-2f3580f3-d0c4-4f0a-b4fe-d81be567d00b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 01:17:33.221541 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:33.221541 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:33.221541 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:33.221541 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:33.221541 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:33.221541 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:33.221541 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:33.221541 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:33.221541 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:33.221541 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:33.221541 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:33.221541 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:17:33.221541 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:17:33.221541 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:17:33.221541 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:17:33.222446 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:17:33.222446 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:17:33.222446 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:17:33.222446 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:17:33.222446 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:33.222446 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:33.222446 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:33.222446 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:33.222446 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:33.222446 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:33.222446 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:33.222446 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:33.222446 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:33.222446 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:33.222446 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:33.222446 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:33.223222 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:33.223222 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:33.223222 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:33.223222 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:33.223222 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:17:33.223222 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:17:33.223222 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:17:33.223222 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:17:33.223222 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:17:33.223222 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:17:33.223222 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 01:17:33.223222 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:17:33.223222 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 246/492] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Aug 12 01:17:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 01:17:33.224676 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3580f3-d0c4-4f0a-b4fe-d81be567d00b None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:33.323082 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe62325d-5f77-4aa9-99b7-6931a6ebe6e5 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:33.325840 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3580f3-d0c4-4f0a-b4fe-d81be567d00b None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:33.326070 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:33.362477 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304dc246-0efc-474d-a185-82f056c90b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:33.363114 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304dc246-0efc-474d-a185-82f056c90b9a None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:33.363390 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304dc246-0efc-474d-a185-82f056c90b9a None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:33.363660 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304dc246-0efc-474d-a185-82f056c90b9a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:33.363981 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0c00af-69c7-43b2-9ab8-eefcc5f39764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:33.364612 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c00af-69c7-43b2-9ab8-eefcc5f39764 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:33.364888 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c00af-69c7-43b2-9ab8-eefcc5f39764 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:33.365187 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c00af-69c7-43b2-9ab8-eefcc5f39764 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:33.374917 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304dc246-0efc-474d-a185-82f056c90b9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:17:33.378031 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0c00af-69c7-43b2-9ab8-eefcc5f39764 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:17:33.379977 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-304dc246-0efc-474d-a185-82f056c90b9a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 01:17:33.379977 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:33.379977 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:33.379977 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:33.379977 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:33.379977 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:33.379977 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:33.379977 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:33.379977 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:33.379977 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:33.379977 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:33.379977 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:33.379977 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:17:33.379977 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:17:33.379977 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:17:33.379977 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:17:33.380974 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:17:33.380974 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:17:33.380974 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:17:33.380974 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:17:33.380974 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:33.380974 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:33.380974 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:33.380974 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:33.380974 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:33.380974 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:33.380974 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:33.380974 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:33.380974 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:33.380974 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:33.380974 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:33.380974 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:33.381960 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:33.381960 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:33.381960 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:33.381960 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:33.381960 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:17:33.381960 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:17:33.381960 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:17:33.381960 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:17:33.381960 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:17:33.381960 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:17:33.381960 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 01:17:33.381960 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:17:33.383045 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-ab0c00af-69c7-43b2-9ab8-eefcc5f39764 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 01:17:33.383045 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:33.383045 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:33.383045 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:33.383045 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:33.383045 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:33.383045 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:33.383045 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:33.383045 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:33.383045 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:33.383045 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:33.383045 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:33.383045 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:17:33.383045 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:17:33.383045 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:17:33.383045 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:17:33.383819 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:17:33.383819 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:17:33.383819 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:17:33.383819 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:17:33.383819 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:33.383819 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:33.383819 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:33.383819 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:33.383819 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:33.383819 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:33.383819 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:33.383819 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:33.383819 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:33.383819 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:33.383819 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:33.383819 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:33.391828 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:33.391828 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:33.391828 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:33.391828 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:33.391828 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:17:33.391828 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:17:33.391828 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:17:33.391828 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:17:33.391828 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:17:33.391828 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:17:33.391828 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 01:17:33.391828 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:17:33.391828 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 247/493] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Aug 12 01:17:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:33.391828 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0c00af-69c7-43b2-9ab8-eefcc5f39764 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:33.394360 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 247/494] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Aug 12 01:17:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:33.394360 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304dc246-0efc-474d-a185-82f056c90b9a None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:33.418747 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:33.494601 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0c00af-69c7-43b2-9ab8-eefcc5f39764 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:33.496405 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304dc246-0efc-474d-a185-82f056c90b9a None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:33.530625 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea3c3d-3dcc-4d64-a4d8-17c5ecdea82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:33.531228 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea3c3d-3dcc-4d64-a4d8-17c5ecdea82f None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:33.531501 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea3c3d-3dcc-4d64-a4d8-17c5ecdea82f None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:33.531822 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea3c3d-3dcc-4d64-a4d8-17c5ecdea82f None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:33.532159 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654c8871-3d91-46cc-aa74-78612dbb1e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:33.532460 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ea3c3d-3dcc-4d64-a4d8-17c5ecdea82f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:33.532784 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ea3c3d-3dcc-4d64-a4d8-17c5ecdea82f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:33.532915 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c8871-3d91-46cc-aa74-78612dbb1e6f None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:33.533293 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c8871-3d91-46cc-aa74-78612dbb1e6f None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:33.533630 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c8871-3d91-46cc-aa74-78612dbb1e6f None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:33.534177 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ea3c3d-3dcc-4d64-a4d8-17c5ecdea82f None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:33.534454 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654c8871-3d91-46cc-aa74-78612dbb1e6f None admin] RBAC: Adding query filter params (name=service) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:33.534816 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654c8871-3d91-46cc-aa74-78612dbb1e6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:33.536240 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654c8871-3d91-46cc-aa74-78612dbb1e6f None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:33.545619 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 248/495] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Aug 12 01:17:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:33.547053 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654c8871-3d91-46cc-aa74-78612dbb1e6f None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:33.551492 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 248/496] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 01:17:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:33.551811 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea3c3d-3dcc-4d64-a4d8-17c5ecdea82f None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:33.578147 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:33.638700 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:33.649471 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654c8871-3d91-46cc-aa74-78612dbb1e6f None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:33.650942 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea3c3d-3dcc-4d64-a4d8-17c5ecdea82f None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:33.682095 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd61f0-431a-42bb-9c99-e0e15a87e333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:33.682724 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd61f0-431a-42bb-9c99-e0e15a87e333 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:33.683001 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd61f0-431a-42bb-9c99-e0e15a87e333 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:33.683271 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd61f0-431a-42bb-9c99-e0e15a87e333 None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:33.683483 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52e8429-d798-4831-bcdb-3c421e74993a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:33.683936 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bd61f0-431a-42bb-9c99-e0e15a87e333 None admin] RBAC: Adding query filter params (name=service) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:33.684084 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e8429-d798-4831-bcdb-3c421e74993a None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:33.684240 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bd61f0-431a-42bb-9c99-e0e15a87e333 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:33.684347 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e8429-d798-4831-bcdb-3c421e74993a None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:33.684612 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e8429-d798-4831-bcdb-3c421e74993a None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:33.685267 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52e8429-d798-4831-bcdb-3c421e74993a None admin] RBAC: Adding query filter params (name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:33.685567 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52e8429-d798-4831-bcdb-3c421e74993a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:33.685670 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bd61f0-431a-42bb-9c99-e0e15a87e333 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:33.686944 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52e8429-d798-4831-bcdb-3c421e74993a None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:33.693407 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 249/497] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Aug 12 01:17:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:33.694222 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd61f0-431a-42bb-9c99-e0e15a87e333 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:33.695009 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 249/498] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Aug 12 01:17:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:33.695615 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52e8429-d798-4831-bcdb-3c421e74993a None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:33.779985 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:33.792872 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd61f0-431a-42bb-9c99-e0e15a87e333 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:33.798736 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52e8429-d798-4831-bcdb-3c421e74993a None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:33.826544 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cc7fa2-9630-4726-ac52-5293741e8171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:33.827171 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc7fa2-9630-4726-ac52-5293741e8171 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:33.827444 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc7fa2-9630-4726-ac52-5293741e8171 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:33.827718 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc7fa2-9630-4726-ac52-5293741e8171 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:33.830808 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9789883e-d811-4097-ac72-63ad037dc528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:33.831376 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9789883e-d811-4097-ac72-63ad037dc528 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:33.831672 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9789883e-d811-4097-ac72-63ad037dc528 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:33.831915 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9789883e-d811-4097-ac72-63ad037dc528 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:33.838070 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cc7fa2-9630-4726-ac52-5293741e8171 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:33.839534 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cc7fa2-9630-4726-ac52-5293741e8171 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:33.839673 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9789883e-d811-4097-ac72-63ad037dc528 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:33.841117 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9789883e-d811-4097-ac72-63ad037dc528 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:33.853208 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-61cc7fa2-9630-4726-ac52-5293741e8171 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:33.853208 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:33.853208 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:33.853208 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:33.853208 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:33.853208 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:33.853208 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:33.853208 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:33.853208 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:33.853208 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:33.853208 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:33.853208 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:33.853208 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 01:17:33.853208 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 01:17:33.853208 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 01:17:33.853208 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 01:17:33.854126 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:33.854126 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:33.854126 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:33.854126 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:33.854126 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:33.854126 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:33.854126 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:33.854126 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:33.854126 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:33.854126 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:33.854126 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:33.854126 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:33.854126 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:33.854126 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:33.854126 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:33.854126 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:33.854126 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 01:17:33.854988 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 01:17:33.854988 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:33.854988 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:17:33.855149 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-9789883e-d811-4097-ac72-63ad037dc528 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 12 01:17:33.855149 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:33.855149 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:33.855149 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:33.855149 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:33.855149 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:33.855149 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:33.855149 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:33.855149 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:33.855149 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:33.855149 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:33.855149 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:33.855149 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 01:17:33.855149 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 01:17:33.855149 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 01:17:33.855149 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 01:17:33.855929 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:33.855929 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:33.855929 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 01:17:33.855929 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 01:17:33.855929 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 01:17:33.855929 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 01:17:33.855929 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:33.855929 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:33.855929 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:33.855929 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:33.855929 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:33.855929 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:33.855929 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:33.855929 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:33.855929 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:33.855929 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:33.855929 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:33.855929 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:33.856804 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:33.856804 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:33.856804 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 01:17:33.856804 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 01:17:33.856804 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 01:17:33.856804 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 01:17:33.856804 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 01:17:33.856804 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 01:17:33.856804 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 12 01:17:33.856804 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:17:33.857301 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 250/499] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:17:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:33.857301 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb113b9a-3fee-4fde-a4a3-43b451b50b56 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:33.857301 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb113b9a-3fee-4fde-a4a3-43b451b50b56 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:33.857301 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb113b9a-3fee-4fde-a4a3-43b451b50b56 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:33.857301 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 251/500] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:17:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:17:33.858146 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb113b9a-3fee-4fde-a4a3-43b451b50b56 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:33.863016 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 250/501] 10.222.0.26 () {56 vars in 1093 bytes} [Fri Aug 12 01:17:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:33.863016 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9789883e-d811-4097-ac72-63ad037dc528 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:33.874365 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:33.959816 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9789883e-d811-4097-ac72-63ad037dc528 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:33.960709 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb113b9a-3fee-4fde-a4a3-43b451b50b56 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:33.992403 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105061ff-6cde-49f3-8d5d-85423be664f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:33.992897 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c1eae2-cbd8-4e45-bb99-10920d24bfd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:33.993024 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105061ff-6cde-49f3-8d5d-85423be664f5 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:33.993298 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105061ff-6cde-49f3-8d5d-85423be664f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:33.993516 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c1eae2-cbd8-4e45-bb99-10920d24bfd0 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:33.993604 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105061ff-6cde-49f3-8d5d-85423be664f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:33.993792 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c1eae2-cbd8-4e45-bb99-10920d24bfd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:33.994060 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c1eae2-cbd8-4e45-bb99-10920d24bfd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:34.003358 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:34.004213 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105061ff-6cde-49f3-8d5d-85423be664f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:34.005806 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105061ff-6cde-49f3-8d5d-85423be664f5 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:34.005921 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c1eae2-cbd8-4e45-bb99-10920d24bfd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:34.007985 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c1eae2-cbd8-4e45-bb99-10920d24bfd0 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:34.020476 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-105061ff-6cde-49f3-8d5d-85423be664f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:34.020476 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:34.020476 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:34.020476 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:34.020476 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:34.020476 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:34.020476 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:34.020476 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:34.020476 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:34.020476 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:34.020476 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:34.020476 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:34.020476 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 01:17:34.020476 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 01:17:34.020476 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 01:17:34.020476 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 01:17:34.021409 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:34.021409 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:34.021409 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:34.021409 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:34.021409 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:34.021409 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:34.021409 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:34.021409 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:34.021409 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:34.021409 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:34.021409 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:34.021409 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:34.021409 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:34.021409 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:34.021409 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:34.021409 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:34.021409 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 01:17:34.022269 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 01:17:34.022269 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:34.022269 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:17:34.022269 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 251/502] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:17:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:34.022494 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-93c1eae2-cbd8-4e45-bb99-10920d24bfd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:34.022494 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:34.022494 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:34.022494 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:34.022494 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:34.022494 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:34.022494 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:34.022494 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:34.022494 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:34.022494 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:34.022494 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:34.022494 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:34.022494 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 01:17:34.022494 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 01:17:34.022494 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 01:17:34.022494 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 01:17:34.023271 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:34.023271 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:34.023271 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:34.023271 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:34.023271 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:34.023271 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:34.023271 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:34.023271 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:34.023271 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:34.023271 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:34.023271 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:34.023271 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:34.023271 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:34.023271 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:34.023271 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:34.023271 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:34.023271 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 01:17:34.024069 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 01:17:34.024069 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:34.024069 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:17:34.024229 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105061ff-6cde-49f3-8d5d-85423be664f5 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:34.024295 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 252/503] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:17:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:34.024295 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ca652-83b4-4232-b0d3-337516bf7cec None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:34.024982 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ca652-83b4-4232-b0d3-337516bf7cec None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:34.024982 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ca652-83b4-4232-b0d3-337516bf7cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:34.043125 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-875ca652-83b4-4232-b0d3-337516bf7cec None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:17:34.044440 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-875ca652-83b4-4232-b0d3-337516bf7cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:17:34.088587 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:34.109782 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 253/504] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:17:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 01:17:34.110735 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ca652-83b4-4232-b0d3-337516bf7cec None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:34.131495 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105061ff-6cde-49f3-8d5d-85423be664f5 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:34.168645 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9999af-7a19-4b05-b25d-1d6739969c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:34.169297 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9999af-7a19-4b05-b25d-1d6739969c5f None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:34.169567 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9999af-7a19-4b05-b25d-1d6739969c5f None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:34.169843 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9999af-7a19-4b05-b25d-1d6739969c5f None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:34.170453 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9999af-7a19-4b05-b25d-1d6739969c5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:34.170757 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9999af-7a19-4b05-b25d-1d6739969c5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:34.172353 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9999af-7a19-4b05-b25d-1d6739969c5f None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:34.189473 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 252/505] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 01:17:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:34.189473 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9999af-7a19-4b05-b25d-1d6739969c5f None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:34.221116 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ca652-83b4-4232-b0d3-337516bf7cec None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:34.245080 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:34.256889 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b7f3c6-5121-4e03-b491-98f3fb2a5fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:34.257512 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7f3c6-5121-4e03-b491-98f3fb2a5fc3 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:34.257772 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7f3c6-5121-4e03-b491-98f3fb2a5fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:34.258038 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7f3c6-5121-4e03-b491-98f3fb2a5fc3 None admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:34.258801 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b7f3c6-5121-4e03-b491-98f3fb2a5fc3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:34.259106 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b7f3c6-5121-4e03-b491-98f3fb2a5fc3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:34.260531 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b7f3c6-5121-4e03-b491-98f3fb2a5fc3 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:34.294434 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9999af-7a19-4b05-b25d-1d6739969c5f None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:34.303751 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 254/506] 10.222.0.26 () {56 vars in 1133 bytes} [Fri Aug 12 01:17:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:34.303751 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b7f3c6-5121-4e03-b491-98f3fb2a5fc3 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:34.320849 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:34.335827 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306df129-3d45-4320-aeec-14fb449f2db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:34.336444 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306df129-3d45-4320-aeec-14fb449f2db8 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:34.336731 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306df129-3d45-4320-aeec-14fb449f2db8 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:34.337003 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306df129-3d45-4320-aeec-14fb449f2db8 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:34.337797 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306df129-3d45-4320-aeec-14fb449f2db8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:34.338101 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306df129-3d45-4320-aeec-14fb449f2db8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:34.340343 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306df129-3d45-4320-aeec-14fb449f2db8 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:34.354742 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 253/507] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 01:17:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:34.355555 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306df129-3d45-4320-aeec-14fb449f2db8 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:34.405666 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b7f3c6-5121-4e03-b491-98f3fb2a5fc3 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:34.439139 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e02a98-d469-4bd2-ad16-1a70c1e8cf56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:34.439739 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e02a98-d469-4bd2-ad16-1a70c1e8cf56 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:34.440016 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e02a98-d469-4bd2-ad16-1a70c1e8cf56 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:34.440284 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e02a98-d469-4bd2-ad16-1a70c1e8cf56 None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:34.440917 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e02a98-d469-4bd2-ad16-1a70c1e8cf56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:34.441215 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e02a98-d469-4bd2-ad16-1a70c1e8cf56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:34.442623 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e02a98-d469-4bd2-ad16-1a70c1e8cf56 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:34.453945 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 255/508] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 01:17:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:34.454752 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e02a98-d469-4bd2-ad16-1a70c1e8cf56 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:34.457244 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306df129-3d45-4320-aeec-14fb449f2db8 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:34.494660 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af79b77-1597-4388-9a1e-301c1d41edfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:34.495272 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af79b77-1597-4388-9a1e-301c1d41edfd None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:34.495547 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af79b77-1597-4388-9a1e-301c1d41edfd None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:34.495813 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af79b77-1597-4388-9a1e-301c1d41edfd None admin] PATH_INFO: `/v3/users/glance` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:34.496831 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:34.503373 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af79b77-1597-4388-9a1e-301c1d41edfd None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:34.504816 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af79b77-1597-4388-9a1e-301c1d41edfd None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:34.515747 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-5af79b77-1597-4388-9a1e-301c1d41edfd None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 12 01:17:34.515747 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:34.515747 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:34.515747 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:34.515747 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:34.515747 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:34.515747 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:34.515747 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:34.515747 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:34.515747 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:34.515747 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:34.515747 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:34.515747 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 01:17:34.515747 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 01:17:34.515747 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 01:17:34.515747 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 01:17:34.516795 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:34.516795 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:34.516795 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 01:17:34.516795 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 01:17:34.516795 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 01:17:34.516795 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 01:17:34.516795 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:34.516795 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:34.516795 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:34.516795 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:34.516795 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:34.516795 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:34.516795 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:34.516795 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:34.516795 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:34.516795 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:34.516795 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:34.516795 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:34.517787 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:34.517787 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:34.517787 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 01:17:34.517787 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 01:17:34.517787 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 01:17:34.517787 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 01:17:34.517787 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 01:17:34.517787 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 01:17:34.517787 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 12 01:17:34.517787 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:17:34.517787 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 254/509] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 01:17:34 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:34.517787 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af79b77-1597-4388-9a1e-301c1d41edfd None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:34.556932 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e02a98-d469-4bd2-ad16-1a70c1e8cf56 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:34.559370 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:34.591712 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79059c4c-d543-4454-826f-a794ef37dcb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:34.592677 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79059c4c-d543-4454-826f-a794ef37dcb0 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:34.592956 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79059c4c-d543-4454-826f-a794ef37dcb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:34.593224 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79059c4c-d543-4454-826f-a794ef37dcb0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:34.616574 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af79b77-1597-4388-9a1e-301c1d41edfd None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:34.650040 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b51e1c1-dc3a-4d4a-81b9-8a7ff6e93af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:34.650693 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b51e1c1-dc3a-4d4a-81b9-8a7ff6e93af7 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:34.650969 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b51e1c1-dc3a-4d4a-81b9-8a7ff6e93af7 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:34.651238 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b51e1c1-dc3a-4d4a-81b9-8a7ff6e93af7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:34.659660 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b51e1c1-dc3a-4d4a-81b9-8a7ff6e93af7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:34.661114 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b51e1c1-dc3a-4d4a-81b9-8a7ff6e93af7 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:34.661318 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79059c4c-d543-4454-826f-a794ef37dcb0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:34.662823 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79059c4c-d543-4454-826f-a794ef37dcb0 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:34.672551 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-6b51e1c1-dc3a-4d4a-81b9-8a7ff6e93af7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 12 01:17:34.672551 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:34.672551 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:34.672551 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:34.672551 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:34.672551 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:34.672551 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:34.672551 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:34.672551 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:34.672551 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:34.672551 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:34.672551 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:34.672551 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 01:17:34.672551 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 01:17:34.672551 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 01:17:34.672551 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 01:17:34.673680 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:34.673680 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:34.673680 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 01:17:34.673680 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 01:17:34.673680 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 01:17:34.673680 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 01:17:34.673680 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:34.673680 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:34.673680 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:34.673680 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:34.673680 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:34.673680 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:34.673680 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:34.673680 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:34.673680 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:34.673680 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:34.673680 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:34.673680 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:34.674944 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:34.674944 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:34.674944 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 01:17:34.674944 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 01:17:34.674944 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 01:17:34.674944 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 01:17:34.674944 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 01:17:34.674944 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 01:17:34.674944 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 12 01:17:34.674944 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:17:34.674944 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 255/510] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 01:17:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:34.674944 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b51e1c1-dc3a-4d4a-81b9-8a7ff6e93af7 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:34.705875 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:34.763536 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 256/511] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 01:17:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 01:17:34.764360 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79059c4c-d543-4454-826f-a794ef37dcb0 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:34.780113 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b51e1c1-dc3a-4d4a-81b9-8a7ff6e93af7 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:34.781644 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:34.815406 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab81a8d6-f224-4641-86f4-daf5f565efb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:34.816028 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab81a8d6-f224-4641-86f4-daf5f565efb6 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:34.816300 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab81a8d6-f224-4641-86f4-daf5f565efb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:34.816564 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab81a8d6-f224-4641-86f4-daf5f565efb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:34.826901 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab81a8d6-f224-4641-86f4-daf5f565efb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:34.828331 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab81a8d6-f224-4641-86f4-daf5f565efb6 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:34.842789 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-ab81a8d6-f224-4641-86f4-daf5f565efb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:34.842789 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:34.842789 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:34.842789 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:34.842789 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:34.842789 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:34.842789 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:34.842789 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:34.842789 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:34.842789 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:34.842789 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:34.842789 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:34.842789 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 01:17:34.842789 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 01:17:34.842789 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 01:17:34.842789 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 01:17:34.846228 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:34.846228 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:34.846228 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:34.846228 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:34.846228 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:34.846228 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:34.846228 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:34.846228 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:34.846228 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:34.846228 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:34.846228 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:34.846228 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:34.846228 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:34.846228 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:34.846228 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:34.846228 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:34.846228 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 01:17:34.847327 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 01:17:34.847327 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:34.847327 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:17:34.847327 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 256/512] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:17:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:34.847327 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab81a8d6-f224-4641-86f4-daf5f565efb6 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:34.862999 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79059c4c-d543-4454-826f-a794ef37dcb0 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:34.895536 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2584f85f-3d59-4871-85f1-3fc3d647fcfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:34.896156 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584f85f-3d59-4871-85f1-3fc3d647fcfe None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:34.896479 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584f85f-3d59-4871-85f1-3fc3d647fcfe None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:34.896783 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584f85f-3d59-4871-85f1-3fc3d647fcfe None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:34.903399 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2584f85f-3d59-4871-85f1-3fc3d647fcfe None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:34.904823 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2584f85f-3d59-4871-85f1-3fc3d647fcfe None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:34.907643 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:34.919238 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-2584f85f-3d59-4871-85f1-3fc3d647fcfe None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 12 01:17:34.919238 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:34.919238 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:34.919238 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:34.919238 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:34.919238 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:34.919238 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:34.919238 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:34.919238 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:34.919238 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:34.919238 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:34.919238 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:34.919238 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 01:17:34.919238 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 01:17:34.919238 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 01:17:34.919238 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 01:17:34.920328 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:34.920328 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:34.920328 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 01:17:34.920328 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 01:17:34.920328 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 01:17:34.920328 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 01:17:34.920328 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:34.920328 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:34.920328 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:34.920328 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:34.920328 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:34.920328 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:34.920328 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:34.920328 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:34.920328 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:34.920328 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:34.920328 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:34.920328 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:34.921422 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:34.921422 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:34.921422 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 01:17:34.921422 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 01:17:34.921422 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 01:17:34.921422 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 01:17:34.921422 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 01:17:34.921422 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 01:17:34.921422 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 12 01:17:34.921422 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:17:34.921422 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 257/513] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Aug 12 01:17:34 2022] GET /identity/v3/users/neutron => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:34.921422 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2584f85f-3d59-4871-85f1-3fc3d647fcfe None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:34.949221 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab81a8d6-f224-4641-86f4-daf5f565efb6 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:34.982404 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50fdaa1-f8ac-412e-9500-3e0b30a6dffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:34.983024 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50fdaa1-f8ac-412e-9500-3e0b30a6dffd None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:34.983299 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50fdaa1-f8ac-412e-9500-3e0b30a6dffd None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:34.983561 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50fdaa1-f8ac-412e-9500-3e0b30a6dffd None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:34.984286 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50fdaa1-f8ac-412e-9500-3e0b30a6dffd None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:34.984584 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50fdaa1-f8ac-412e-9500-3e0b30a6dffd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:34.986068 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50fdaa1-f8ac-412e-9500-3e0b30a6dffd None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:35.020809 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 257/514] 10.222.0.26 () {56 vars in 1137 bytes} [Fri Aug 12 01:17:34 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:35.021745 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50fdaa1-f8ac-412e-9500-3e0b30a6dffd None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:35.023553 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2584f85f-3d59-4871-85f1-3fc3d647fcfe None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:35.035681 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:35.060402 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e878ba78-05cc-41d0-9e32-c0f1a8c6803f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:35.061002 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878ba78-05cc-41d0-9e32-c0f1a8c6803f None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:35.061273 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878ba78-05cc-41d0-9e32-c0f1a8c6803f None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:35.061539 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e878ba78-05cc-41d0-9e32-c0f1a8c6803f None admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:35.062294 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e878ba78-05cc-41d0-9e32-c0f1a8c6803f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:35.062589 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e878ba78-05cc-41d0-9e32-c0f1a8c6803f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:35.063998 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e878ba78-05cc-41d0-9e32-c0f1a8c6803f None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:35.080482 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 258/515] 10.222.0.26 () {56 vars in 1137 bytes} [Fri Aug 12 01:17:34 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:35.081271 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e878ba78-05cc-41d0-9e32-c0f1a8c6803f None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:35.119360 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50fdaa1-f8ac-412e-9500-3e0b30a6dffd None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:35.139916 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:35.151815 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddac2e4-e7e8-4756-ac6b-600f4a79ef8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:35.152462 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddac2e4-e7e8-4756-ac6b-600f4a79ef8f None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:35.152729 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddac2e4-e7e8-4756-ac6b-600f4a79ef8f None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:35.152977 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddac2e4-e7e8-4756-ac6b-600f4a79ef8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:35.163122 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddac2e4-e7e8-4756-ac6b-600f4a79ef8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:35.164578 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddac2e4-e7e8-4756-ac6b-600f4a79ef8f None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:35.178804 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-1ddac2e4-e7e8-4756-ac6b-600f4a79ef8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:35.178804 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:35.178804 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:35.178804 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:35.178804 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:35.178804 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:35.178804 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:35.178804 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:35.178804 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:35.178804 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:35.178804 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:35.178804 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:35.178804 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 01:17:35.178804 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 01:17:35.178804 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 01:17:35.178804 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 01:17:35.180330 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:35.180330 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:35.180330 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:35.180330 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:35.180330 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:35.180330 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:35.180330 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:35.180330 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:35.180330 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:35.180330 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:35.180330 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:35.180330 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:35.180330 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:35.180330 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:35.180330 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:35.180330 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:35.180330 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 01:17:35.181350 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 01:17:35.181350 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:35.181350 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:17:35.181558 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e878ba78-05cc-41d0-9e32-c0f1a8c6803f None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:35.184513 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 258/516] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:17:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:35.185347 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddac2e4-e7e8-4756-ac6b-600f4a79ef8f None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:35.213619 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2009d51-bee0-4372-aac6-532f45339106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:35.214290 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2009d51-bee0-4372-aac6-532f45339106 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:35.214561 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2009d51-bee0-4372-aac6-532f45339106 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:35.214848 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2009d51-bee0-4372-aac6-532f45339106 None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:35.215460 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2009d51-bee0-4372-aac6-532f45339106 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:35.215755 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2009d51-bee0-4372-aac6-532f45339106 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:35.217115 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2009d51-bee0-4372-aac6-532f45339106 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:35.228338 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 259/517] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 01:17:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:35.229118 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2009d51-bee0-4372-aac6-532f45339106 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:35.250629 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:35.287526 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddac2e4-e7e8-4756-ac6b-600f4a79ef8f None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:35.320758 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3000b187-6614-4e98-8d9b-858a83170bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:35.321469 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3000b187-6614-4e98-8d9b-858a83170bfa None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:35.321745 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3000b187-6614-4e98-8d9b-858a83170bfa None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:35.322024 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3000b187-6614-4e98-8d9b-858a83170bfa None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:35.323210 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3000b187-6614-4e98-8d9b-858a83170bfa None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:35.323513 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3000b187-6614-4e98-8d9b-858a83170bfa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:35.324957 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3000b187-6614-4e98-8d9b-858a83170bfa None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:35.329989 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2009d51-bee0-4372-aac6-532f45339106 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:35.346131 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 259/518] 10.222.0.26 () {56 vars in 1139 bytes} [Fri Aug 12 01:17:35 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:35.346621 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:35.346970 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3000b187-6614-4e98-8d9b-858a83170bfa None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:35.367881 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4038e1d0-1558-4ad9-af60-34f07d0e3b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:35.368489 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038e1d0-1558-4ad9-af60-34f07d0e3b7c None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:35.368764 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038e1d0-1558-4ad9-af60-34f07d0e3b7c None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:35.369033 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038e1d0-1558-4ad9-af60-34f07d0e3b7c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:35.436296 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4038e1d0-1558-4ad9-af60-34f07d0e3b7c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:35.437660 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4038e1d0-1558-4ad9-af60-34f07d0e3b7c None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:35.447269 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3000b187-6614-4e98-8d9b-858a83170bfa None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:35.469339 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:35.482577 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba520fae-d9f5-47ef-8bcb-402f39436041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:35.483191 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba520fae-d9f5-47ef-8bcb-402f39436041 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:35.483453 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba520fae-d9f5-47ef-8bcb-402f39436041 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:35.483715 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba520fae-d9f5-47ef-8bcb-402f39436041 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:35.538716 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 260/519] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 01:17:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 01:17:35.539556 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4038e1d0-1558-4ad9-af60-34f07d0e3b7c None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:35.549796 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba520fae-d9f5-47ef-8bcb-402f39436041 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:35.551301 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba520fae-d9f5-47ef-8bcb-402f39436041 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:35.557367 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:35.634356 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4038e1d0-1558-4ad9-af60-34f07d0e3b7c None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:35.654020 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 260/520] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 01:17:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 01:17:35.655023 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba520fae-d9f5-47ef-8bcb-402f39436041 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:35.669116 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135395dc-4b71-4f83-9a45-045c684811d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:35.669718 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135395dc-4b71-4f83-9a45-045c684811d5 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:35.669992 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135395dc-4b71-4f83-9a45-045c684811d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:35.670284 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135395dc-4b71-4f83-9a45-045c684811d5 None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:35.670920 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135395dc-4b71-4f83-9a45-045c684811d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:35.671234 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135395dc-4b71-4f83-9a45-045c684811d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:35.672586 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135395dc-4b71-4f83-9a45-045c684811d5 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:35.679225 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:35.684379 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 261/521] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 01:17:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:35.685173 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135395dc-4b71-4f83-9a45-045c684811d5 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:35.759992 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba520fae-d9f5-47ef-8bcb-402f39436041 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:35.761788 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:35.784323 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135395dc-4b71-4f83-9a45-045c684811d5 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:35.795937 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4891768-0f89-4066-88d4-601b4a2e6a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:35.796548 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4891768-0f89-4066-88d4-601b4a2e6a71 None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:35.796826 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4891768-0f89-4066-88d4-601b4a2e6a71 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:35.797097 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4891768-0f89-4066-88d4-601b4a2e6a71 None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:35.797750 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4891768-0f89-4066-88d4-601b4a2e6a71 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:35.799241 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4891768-0f89-4066-88d4-601b4a2e6a71 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:35.818928 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa8c6a4-0f3d-4392-84f6-d627713acbf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:35.819538 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8c6a4-0f3d-4392-84f6-d627713acbf9 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:35.819814 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8c6a4-0f3d-4392-84f6-d627713acbf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:35.820077 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8c6a4-0f3d-4392-84f6-d627713acbf9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:35.820626 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 261/522] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Aug 12 01:17:35 2022] POST /identity/v3/users => generated 247 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:17:35.821427 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4891768-0f89-4066-88d4-601b4a2e6a71 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:35.901502 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa8c6a4-0f3d-4392-84f6-d627713acbf9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:35.903198 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa8c6a4-0f3d-4392-84f6-d627713acbf9 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:35.909148 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:35.933255 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4891768-0f89-4066-88d4-601b4a2e6a71 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:35.974493 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a825a50-58a5-428c-873c-4bbd95f05028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:35.974903 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a825a50-58a5-428c-873c-4bbd95f05028 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:35.975381 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a825a50-58a5-428c-873c-4bbd95f05028 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:35.975487 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a825a50-58a5-428c-873c-4bbd95f05028 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:35.987897 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a825a50-58a5-428c-873c-4bbd95f05028 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:35.989498 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a825a50-58a5-428c-873c-4bbd95f05028 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:35.995949 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:36.005880 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-5a825a50-58a5-428c-873c-4bbd95f05028 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:36.005880 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:36.005880 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:36.005880 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:36.005880 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:36.005880 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:36.005880 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:36.005880 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:36.005880 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:36.005880 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:36.005880 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:36.005880 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:36.005880 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 01:17:36.005880 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 01:17:36.005880 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 01:17:36.005880 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 01:17:36.006993 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:36.006993 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:36.006993 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:36.006993 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:36.006993 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:36.006993 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:36.006993 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:36.006993 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:36.006993 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:36.006993 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:36.006993 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:36.006993 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:36.006993 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:36.006993 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:36.006993 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:36.006993 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:36.006993 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 01:17:36.007815 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 01:17:36.007815 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:36.007815 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:17:36.008320 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 262/523] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:17:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:36.009333 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a825a50-58a5-428c-873c-4bbd95f05028 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:36.027791 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 262/524] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 01:17:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 01:17:36.030986 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa8c6a4-0f3d-4392-84f6-d627713acbf9 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:36.117901 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a825a50-58a5-428c-873c-4bbd95f05028 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:36.140466 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa8c6a4-0f3d-4392-84f6-d627713acbf9 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:36.153425 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:36.162143 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1408a21d-a80e-4df1-973f-2e2b4bbef43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:36.162936 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408a21d-a80e-4df1-973f-2e2b4bbef43e None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:36.163207 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408a21d-a80e-4df1-973f-2e2b4bbef43e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:36.163954 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1408a21d-a80e-4df1-973f-2e2b4bbef43e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:36.174630 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1408a21d-a80e-4df1-973f-2e2b4bbef43e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:36.176127 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1408a21d-a80e-4df1-973f-2e2b4bbef43e None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:36.180078 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e06503-5c7f-4076-9433-455d256b92ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:36.180717 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e06503-5c7f-4076-9433-455d256b92ef None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:36.180993 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e06503-5c7f-4076-9433-455d256b92ef None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:36.181260 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e06503-5c7f-4076-9433-455d256b92ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:36.188234 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e06503-5c7f-4076-9433-455d256b92ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:36.189681 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e06503-5c7f-4076-9433-455d256b92ef None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:36.191131 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-1408a21d-a80e-4df1-973f-2e2b4bbef43e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:36.191131 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:36.191131 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:36.191131 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:36.191131 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:36.191131 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:36.191131 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:36.191131 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:36.191131 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:36.191131 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:36.191131 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:36.191131 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:36.191131 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 01:17:36.191131 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 01:17:36.191131 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 01:17:36.191131 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 01:17:36.197287 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:36.197287 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:36.197287 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:36.197287 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:36.197287 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:36.197287 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:36.197287 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:36.197287 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:36.197287 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:36.197287 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:36.197287 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:36.197287 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:36.197287 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:36.197287 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:36.197287 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:36.197287 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:36.197287 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 01:17:36.198349 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 01:17:36.198349 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:36.198349 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:17:36.198349 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 263/525] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:17:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:36.198349 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1408a21d-a80e-4df1-973f-2e2b4bbef43e None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:36.209713 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-17e06503-5c7f-4076-9433-455d256b92ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 01:17:36.209713 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:36.209713 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:36.209713 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:36.209713 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:36.209713 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:36.209713 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:36.209713 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:36.209713 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:36.209713 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:36.209713 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:36.209713 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:36.209713 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 01:17:36.209713 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 01:17:36.209713 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 01:17:36.210626 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 01:17:36.210626 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:36.210626 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:36.210626 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:36.210626 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:36.210626 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:36.210626 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:36.210626 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:36.210626 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:36.210626 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:36.210626 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:36.210626 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:36.210626 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:36.210626 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:36.210626 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:36.210626 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:36.210626 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:36.211504 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 01:17:36.211504 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 01:17:36.211504 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 01:17:36.211504 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 01:17:36.211504 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 01:17:36.211504 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 01:17:36.211504 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 01:17:36.211504 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:17:36.211504 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 263/526] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 01:17:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:36.211955 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e06503-5c7f-4076-9433-455d256b92ef None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:36.253642 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:36.306581 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1408a21d-a80e-4df1-973f-2e2b4bbef43e None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:36.318105 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e06503-5c7f-4076-9433-455d256b92ef None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:36.342374 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893dd2a3-1261-4c7c-b51f-068b4455669a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:36.342996 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893dd2a3-1261-4c7c-b51f-068b4455669a None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:36.343274 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893dd2a3-1261-4c7c-b51f-068b4455669a None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:36.343525 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893dd2a3-1261-4c7c-b51f-068b4455669a None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:36.344185 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893dd2a3-1261-4c7c-b51f-068b4455669a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:36.344490 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893dd2a3-1261-4c7c-b51f-068b4455669a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:36.345852 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893dd2a3-1261-4c7c-b51f-068b4455669a None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:36.357157 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb55c84-0cfb-47b4-aa4c-bb1d5fac9722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:36.362343 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb55c84-0cfb-47b4-aa4c-bb1d5fac9722 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:36.362470 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 264/527] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 01:17:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:36.362580 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb55c84-0cfb-47b4-aa4c-bb1d5fac9722 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:36.362580 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb55c84-0cfb-47b4-aa4c-bb1d5fac9722 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:36.362730 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893dd2a3-1261-4c7c-b51f-068b4455669a None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:36.373967 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb55c84-0cfb-47b4-aa4c-bb1d5fac9722 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:36.375468 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb55c84-0cfb-47b4-aa4c-bb1d5fac9722 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:36.391452 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-7cb55c84-0cfb-47b4-aa4c-bb1d5fac9722 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:36.391452 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:36.391452 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:36.391452 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:36.391452 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:36.391452 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:36.391452 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:36.391452 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:36.391452 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:36.391452 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:36.391452 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:36.391452 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:36.391452 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 01:17:36.391452 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 01:17:36.391452 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 01:17:36.391452 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 01:17:36.392335 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:36.392335 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:36.392335 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:36.392335 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:36.392335 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:36.392335 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:36.392335 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:36.392335 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:36.392335 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:36.392335 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:36.392335 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:36.392335 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:36.392335 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:36.392335 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:36.392335 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:36.392335 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:36.392335 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 01:17:36.393264 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 01:17:36.393264 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:36.393264 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:17:36.393264 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 264/528] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:17:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:36.393814 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb55c84-0cfb-47b4-aa4c-bb1d5fac9722 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:36.411778 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:36.476042 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893dd2a3-1261-4c7c-b51f-068b4455669a None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:36.490643 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:36.502339 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb55c84-0cfb-47b4-aa4c-bb1d5fac9722 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:36.517203 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f444e4-cb6b-402f-b2fb-7b116b4a3516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:36.517825 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f444e4-cb6b-402f-b2fb-7b116b4a3516 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:36.518102 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f444e4-cb6b-402f-b2fb-7b116b4a3516 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:36.518400 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f444e4-cb6b-402f-b2fb-7b116b4a3516 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:36.519043 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f444e4-cb6b-402f-b2fb-7b116b4a3516 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:36.519343 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f444e4-cb6b-402f-b2fb-7b116b4a3516 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:36.520724 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f444e4-cb6b-402f-b2fb-7b116b4a3516 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:36.532297 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 265/529] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 01:17:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:36.533104 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f444e4-cb6b-402f-b2fb-7b116b4a3516 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:36.545926 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ddfa7d-5a53-4682-afbd-7d044a091442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:36.546608 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ddfa7d-5a53-4682-afbd-7d044a091442 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:36.546931 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ddfa7d-5a53-4682-afbd-7d044a091442 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:36.547201 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ddfa7d-5a53-4682-afbd-7d044a091442 None admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:36.547905 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ddfa7d-5a53-4682-afbd-7d044a091442 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:36.548232 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ddfa7d-5a53-4682-afbd-7d044a091442 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:36.549765 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ddfa7d-5a53-4682-afbd-7d044a091442 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:36.568350 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 265/530] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Aug 12 01:17:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:36.568985 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ddfa7d-5a53-4682-afbd-7d044a091442 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:36.642849 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f444e4-cb6b-402f-b2fb-7b116b4a3516 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:36.644373 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:36.675473 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ddfa7d-5a53-4682-afbd-7d044a091442 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:36.680096 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142fdd2b-6948-40d9-a506-37fdb4aeb0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:36.680725 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142fdd2b-6948-40d9-a506-37fdb4aeb0b8 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:36.680999 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142fdd2b-6948-40d9-a506-37fdb4aeb0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:36.681265 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142fdd2b-6948-40d9-a506-37fdb4aeb0b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:36.687975 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142fdd2b-6948-40d9-a506-37fdb4aeb0b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:36.689440 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142fdd2b-6948-40d9-a506-37fdb4aeb0b8 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:36.701481 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-142fdd2b-6948-40d9-a506-37fdb4aeb0b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 01:17:36.701481 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:36.701481 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:36.701481 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:36.701481 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:36.701481 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:36.701481 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:36.701481 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:36.701481 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:36.701481 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:36.701481 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:36.701481 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:36.701481 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 01:17:36.701481 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 01:17:36.701481 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 01:17:36.702374 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 01:17:36.702374 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:36.702374 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:36.702374 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:36.702374 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:36.702374 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:36.702374 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:36.702374 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:36.702374 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:36.702374 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:36.702374 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:36.702374 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:36.702374 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:36.702374 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:36.702374 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:36.702374 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:36.702374 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:36.703187 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 01:17:36.703187 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 01:17:36.703187 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 01:17:36.703187 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 01:17:36.703187 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 01:17:36.703187 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 01:17:36.703187 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 01:17:36.703187 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:17:36.703187 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 266/531] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 01:17:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:36.703629 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142fdd2b-6948-40d9-a506-37fdb4aeb0b8 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:36.714460 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127c3504-79e4-4e45-b644-a026ee76c674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:36.715078 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c3504-79e4-4e45-b644-a026ee76c674 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:36.715359 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c3504-79e4-4e45-b644-a026ee76c674 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:36.715634 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127c3504-79e4-4e45-b644-a026ee76c674 None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:36.716279 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127c3504-79e4-4e45-b644-a026ee76c674 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:36.716577 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127c3504-79e4-4e45-b644-a026ee76c674 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:36.717945 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127c3504-79e4-4e45-b644-a026ee76c674 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:36.734396 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 266/532] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 01:17:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:36.735277 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127c3504-79e4-4e45-b644-a026ee76c674 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:36.747678 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:36.810099 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142fdd2b-6948-40d9-a506-37fdb4aeb0b8 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:36.844363 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127c3504-79e4-4e45-b644-a026ee76c674 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:36.844534 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4547809-3499-45ef-9ad5-96b8c1a20994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:36.845178 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4547809-3499-45ef-9ad5-96b8c1a20994 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:36.845457 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4547809-3499-45ef-9ad5-96b8c1a20994 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:36.845754 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4547809-3499-45ef-9ad5-96b8c1a20994 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:36.853247 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4547809-3499-45ef-9ad5-96b8c1a20994 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:36.854739 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4547809-3499-45ef-9ad5-96b8c1a20994 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:36.866412 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-f4547809-3499-45ef-9ad5-96b8c1a20994 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 01:17:36.866412 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:36.866412 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:36.866412 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:36.866412 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:36.866412 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:36.866412 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:36.866412 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:36.866412 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:36.866412 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:36.866412 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:36.866412 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:36.866412 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 01:17:36.866412 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 01:17:36.866412 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 01:17:36.867250 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 01:17:36.867250 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:36.867250 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:36.867250 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:36.867250 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:36.867250 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:36.867250 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:36.867250 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:36.867250 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:36.867250 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:36.867250 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:36.867250 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:36.867250 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:36.867250 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:36.867250 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:36.867250 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:36.867250 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:36.868092 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 01:17:36.868092 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 01:17:36.868092 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 01:17:36.868092 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 01:17:36.868092 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 01:17:36.868092 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 01:17:36.868092 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 01:17:36.868092 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:17:36.868092 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 267/533] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 01:17:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:36.868541 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4547809-3499-45ef-9ad5-96b8c1a20994 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:36.887314 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2830bf-3a72-4589-a132-8ba325c9ca76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:36.888279 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2830bf-3a72-4589-a132-8ba325c9ca76 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:36.888742 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2830bf-3a72-4589-a132-8ba325c9ca76 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:36.889196 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2830bf-3a72-4589-a132-8ba325c9ca76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:36.890101 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2830bf-3a72-4589-a132-8ba325c9ca76 None admin] RBAC: Adding query filter params (role.id=90d1ca7df8de4b03a689afc664d0cc3f, scope.project.id=fa91143910a74c6b896ced5b51f9966a, user.id=fcd5e95467b44175be2478c2c7c89926) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:36.890628 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2830bf-3a72-4589-a132-8ba325c9ca76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:36.892247 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2830bf-3a72-4589-a132-8ba325c9ca76 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:36.894544 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:36.900718 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 267/534] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 01:17:36 2022] GET /identity/v3/role_assignments?user.id=fcd5e95467b44175be2478c2c7c89926&scope.project.id=fa91143910a74c6b896ced5b51f9966a&role.id=90d1ca7df8de4b03a689afc664d0cc3f => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:36.902038 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2830bf-3a72-4589-a132-8ba325c9ca76 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:37.002359 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:37.010048 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4547809-3499-45ef-9ad5-96b8c1a20994 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:37.030620 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2830bf-3a72-4589-a132-8ba325c9ca76 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:37.050840 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108cca98-d2d9-4dfc-a62b-b2b4985544b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:37.051832 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108cca98-d2d9-4dfc-a62b-b2b4985544b3 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:37.052359 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108cca98-d2d9-4dfc-a62b-b2b4985544b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:37.053544 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108cca98-d2d9-4dfc-a62b-b2b4985544b3 None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:37.054822 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108cca98-d2d9-4dfc-a62b-b2b4985544b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:37.055323 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108cca98-d2d9-4dfc-a62b-b2b4985544b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:37.057901 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108cca98-d2d9-4dfc-a62b-b2b4985544b3 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:37.067461 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debe7d5c-630c-4e16-b8c4-12baa06610b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:37.068247 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe7d5c-630c-4e16-b8c4-12baa06610b2 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:37.068551 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe7d5c-630c-4e16-b8c4-12baa06610b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:37.068820 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe7d5c-630c-4e16-b8c4-12baa06610b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:37.077202 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debe7d5c-630c-4e16-b8c4-12baa06610b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:37.078739 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debe7d5c-630c-4e16-b8c4-12baa06610b2 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:37.079698 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 268/535] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Aug 12 01:17:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:37.080317 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108cca98-d2d9-4dfc-a62b-b2b4985544b3 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:37.090441 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-debe7d5c-630c-4e16-b8c4-12baa06610b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 01:17:37.090441 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:37.090441 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:37.090441 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:37.090441 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:37.090441 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:37.090441 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:37.090441 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:37.090441 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:37.090441 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:37.090441 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:37.090441 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:37.090441 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 01:17:37.090441 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 01:17:37.090441 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 01:17:37.091457 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 01:17:37.091457 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:37.091457 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:37.091457 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:37.091457 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:37.091457 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:37.091457 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:37.091457 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:37.091457 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:37.091457 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:37.091457 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:37.091457 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:37.091457 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:37.091457 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:37.091457 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:37.091457 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:37.091457 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:37.092428 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 01:17:37.092428 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 01:17:37.092428 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 01:17:37.092428 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 01:17:37.092428 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 01:17:37.092428 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 01:17:37.092428 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 01:17:37.092428 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:17:37.094834 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 268/536] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 01:17:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:37.095847 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debe7d5c-630c-4e16-b8c4-12baa06610b2 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:37.193105 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:37.213517 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108cca98-d2d9-4dfc-a62b-b2b4985544b3 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:37.215630 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debe7d5c-630c-4e16-b8c4-12baa06610b2 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:37.250518 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f554c6b9-4ba7-4d38-9c85-6fe48f481569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:37.251420 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f554c6b9-4ba7-4d38-9c85-6fe48f481569 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:37.251859 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f554c6b9-4ba7-4d38-9c85-6fe48f481569 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:37.252288 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f554c6b9-4ba7-4d38-9c85-6fe48f481569 None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:37.253165 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f554c6b9-4ba7-4d38-9c85-6fe48f481569 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:37.253630 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f554c6b9-4ba7-4d38-9c85-6fe48f481569 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:37.255264 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f554c6b9-4ba7-4d38-9c85-6fe48f481569 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:37.259928 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c03c3fb-b0dd-4075-930b-d1aba78ef2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:37.260617 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03c3fb-b0dd-4075-930b-d1aba78ef2a1 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:37.260963 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03c3fb-b0dd-4075-930b-d1aba78ef2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:37.261305 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03c3fb-b0dd-4075-930b-d1aba78ef2a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:37.262136 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c03c3fb-b0dd-4075-930b-d1aba78ef2a1 None admin] RBAC: Adding query filter params (role.id=90d1ca7df8de4b03a689afc664d0cc3f, scope.project.id=fa91143910a74c6b896ced5b51f9966a, user.id=bd73d9b9b63a499d909fec034bf9a259) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:37.262514 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c03c3fb-b0dd-4075-930b-d1aba78ef2a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:37.264027 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c03c3fb-b0dd-4075-930b-d1aba78ef2a1 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:37.266639 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:37.276783 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 269/538] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Aug 12 01:17:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:37.277023 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 269/538] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 01:17:37 2022] GET /identity/v3/role_assignments?user.id=bd73d9b9b63a499d909fec034bf9a259&scope.project.id=fa91143910a74c6b896ced5b51f9966a&role.id=90d1ca7df8de4b03a689afc664d0cc3f => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:37.278067 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c03c3fb-b0dd-4075-930b-d1aba78ef2a1 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:37.278296 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f554c6b9-4ba7-4d38-9c85-6fe48f481569 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:37.464503 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c03c3fb-b0dd-4075-930b-d1aba78ef2a1 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:37.469081 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f554c6b9-4ba7-4d38-9c85-6fe48f481569 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:37.501736 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af29be52-e82c-42e4-aa3b-3896ae210639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:37.502531 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29be52-e82c-42e4-aa3b-3896ae210639 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:37.502878 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29be52-e82c-42e4-aa3b-3896ae210639 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:37.503219 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29be52-e82c-42e4-aa3b-3896ae210639 None admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:37.503987 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af29be52-e82c-42e4-aa3b-3896ae210639 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:37.504362 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af29be52-e82c-42e4-aa3b-3896ae210639 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:37.505903 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af29be52-e82c-42e4-aa3b-3896ae210639 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:37.522247 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 270/539] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Aug 12 01:17:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:37.527746 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af29be52-e82c-42e4-aa3b-3896ae210639 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:37.533314 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e94314a-32c4-4739-beb5-1593d4d69606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:37.535660 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e94314a-32c4-4739-beb5-1593d4d69606 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:37.535965 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e94314a-32c4-4739-beb5-1593d4d69606 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:37.536243 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e94314a-32c4-4739-beb5-1593d4d69606 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:37.537127 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e94314a-32c4-4739-beb5-1593d4d69606 None admin] RBAC: Adding query filter params (role.id=90d1ca7df8de4b03a689afc664d0cc3f, scope.project.id=fa91143910a74c6b896ced5b51f9966a, user.id=7853d40c29af424c8d7913950d89750b) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:37.537438 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e94314a-32c4-4739-beb5-1593d4d69606 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:37.538963 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e94314a-32c4-4739-beb5-1593d4d69606 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:37.554811 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 270/540] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 01:17:37 2022] GET /identity/v3/role_assignments?user.id=7853d40c29af424c8d7913950d89750b&scope.project.id=fa91143910a74c6b896ced5b51f9966a&role.id=90d1ca7df8de4b03a689afc664d0cc3f => generated 259 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:37.622505 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:37.648296 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af29be52-e82c-42e4-aa3b-3896ae210639 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:37.685577 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca7aac9-ab8c-4ab2-a6f7-56882d02e4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:37.686240 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca7aac9-ab8c-4ab2-a6f7-56882d02e4fa None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:37.686520 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca7aac9-ab8c-4ab2-a6f7-56882d02e4fa None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:37.686791 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca7aac9-ab8c-4ab2-a6f7-56882d02e4fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:37.687534 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca7aac9-ab8c-4ab2-a6f7-56882d02e4fa None admin] RBAC: Adding query filter params (role.id=90d1ca7df8de4b03a689afc664d0cc3f, scope.project.id=fa91143910a74c6b896ced5b51f9966a, user.id=a80678458dc9405285b70da707a399c2) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:37.687893 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca7aac9-ab8c-4ab2-a6f7-56882d02e4fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:37.689467 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca7aac9-ab8c-4ab2-a6f7-56882d02e4fa None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:37.701080 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 271/541] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 01:17:37 2022] GET /identity/v3/role_assignments?user.id=a80678458dc9405285b70da707a399c2&scope.project.id=fa91143910a74c6b896ced5b51f9966a&role.id=90d1ca7df8de4b03a689afc664d0cc3f => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:37.869502 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e73acf-49cc-4910-bde4-9cbfe29e3095 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:37.869879 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e73acf-49cc-4910-bde4-9cbfe29e3095 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:37.870053 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e73acf-49cc-4910-bde4-9cbfe29e3095 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:37.871553 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 271/542] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:17:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:17:37.877180 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100cd997-498f-413f-bcfb-6b8ef3fab96c None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:37.877536 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100cd997-498f-413f-bcfb-6b8ef3fab96c None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:37.877814 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100cd997-498f-413f-bcfb-6b8ef3fab96c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:37.909158 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-100cd997-498f-413f-bcfb-6b8ef3fab96c None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:17:37.910392 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-100cd997-498f-413f-bcfb-6b8ef3fab96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:17:37.994348 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 272/543] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:17:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 01:17:38.504038 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e73acf-49cc-4910-bde4-9cbfe29e3095 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:38.519269 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:38.644119 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e73acf-49cc-4910-bde4-9cbfe29e3095 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:38.687355 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cb4a83-52b5-4b3b-9086-afba13bf2c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:38.688354 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb4a83-52b5-4b3b-9086-afba13bf2c29 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:38.688855 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb4a83-52b5-4b3b-9086-afba13bf2c29 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:38.689311 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb4a83-52b5-4b3b-9086-afba13bf2c29 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:38.700387 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cb4a83-52b5-4b3b-9086-afba13bf2c29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:17:38.705237 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-47cb4a83-52b5-4b3b-9086-afba13bf2c29 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 01:17:38.705237 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:38.705237 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:38.705237 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:38.705237 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:38.705237 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:38.705237 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:38.705237 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:38.705237 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:38.705237 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:38.705237 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:38.705237 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:38.705237 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:17:38.705237 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:17:38.705237 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:17:38.705237 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:17:38.706141 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:17:38.706141 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:17:38.706141 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:17:38.706141 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:17:38.706141 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:38.706141 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:38.706141 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:38.706141 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:38.706141 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:38.706141 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:38.706141 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:38.706141 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:38.706141 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:38.706141 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:38.706141 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:38.706141 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:38.706944 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:38.706944 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:38.706944 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:38.706944 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:38.706944 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:17:38.706944 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:17:38.706944 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:17:38.706944 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:17:38.706944 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:17:38.706944 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:17:38.706944 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 01:17:38.706944 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:17:38.709511 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 272/544] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Aug 12 01:17:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:38.719240 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100cd997-498f-413f-bcfb-6b8ef3fab96c None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:38.794025 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:38.857768 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100cd997-498f-413f-bcfb-6b8ef3fab96c None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:38.902977 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53c5dac-1877-4724-a480-95c4101ec887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:38.903589 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c5dac-1877-4724-a480-95c4101ec887 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:38.903861 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c5dac-1877-4724-a480-95c4101ec887 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:38.904129 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c5dac-1877-4724-a480-95c4101ec887 None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:38.904791 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53c5dac-1877-4724-a480-95c4101ec887 None admin] RBAC: Adding query filter params (name=service) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:38.905085 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53c5dac-1877-4724-a480-95c4101ec887 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:38.906480 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53c5dac-1877-4724-a480-95c4101ec887 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:38.917843 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 273/545] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Aug 12 01:17:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:38.922997 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cb4a83-52b5-4b3b-9086-afba13bf2c29 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:38.991313 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:39.027527 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cb4a83-52b5-4b3b-9086-afba13bf2c29 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:39.082967 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8a5750-03d8-476f-8cd6-0df127131cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:39.083575 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8a5750-03d8-476f-8cd6-0df127131cb6 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:39.084131 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8a5750-03d8-476f-8cd6-0df127131cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:39.084736 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8a5750-03d8-476f-8cd6-0df127131cb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:39.104133 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8a5750-03d8-476f-8cd6-0df127131cb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:39.105608 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8a5750-03d8-476f-8cd6-0df127131cb6 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:39.125922 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-5d8a5750-03d8-476f-8cd6-0df127131cb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:39.125922 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:39.125922 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:39.125922 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:39.125922 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:39.125922 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:39.125922 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:39.125922 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:39.125922 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:39.125922 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:39.125922 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:39.125922 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:39.125922 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 01:17:39.125922 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 01:17:39.125922 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 01:17:39.125922 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 01:17:39.126865 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:39.126865 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:39.126865 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:39.126865 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:39.126865 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:39.126865 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:39.126865 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:39.126865 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:39.126865 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:39.126865 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:39.126865 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:39.126865 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:39.126865 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:39.126865 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:39.126865 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:39.126865 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:39.126865 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 01:17:39.127685 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 01:17:39.127685 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:39.127685 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:17:39.127685 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 273/546] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:17:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:39.133782 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53c5dac-1877-4724-a480-95c4101ec887 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:39.160137 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd42e844-8623-4925-8063-58371dc676d7 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:39.160457 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd42e844-8623-4925-8063-58371dc676d7 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:39.160688 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd42e844-8623-4925-8063-58371dc676d7 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:39.163425 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 274/547] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:17:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 01:17:39.169033 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9131898-61f2-4993-8bd8-85497f418a7b None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:39.169499 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9131898-61f2-4993-8bd8-85497f418a7b None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:39.169900 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9131898-61f2-4993-8bd8-85497f418a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:39.206126 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-b9131898-61f2-4993-8bd8-85497f418a7b None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:17:39.207326 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-b9131898-61f2-4993-8bd8-85497f418a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:17:39.279125 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53c5dac-1877-4724-a480-95c4101ec887 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:39.306230 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 275/548] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:17:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 01:17:39.307142 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:39.350343 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a1cb26-cbbb-4235-99f7-57f21bc4eadb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:39.350878 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a1cb26-cbbb-4235-99f7-57f21bc4eadb None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:39.351156 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a1cb26-cbbb-4235-99f7-57f21bc4eadb None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:39.351423 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a1cb26-cbbb-4235-99f7-57f21bc4eadb None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:39.352069 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a1cb26-cbbb-4235-99f7-57f21bc4eadb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:39.352360 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a1cb26-cbbb-4235-99f7-57f21bc4eadb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:39.353711 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a1cb26-cbbb-4235-99f7-57f21bc4eadb None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:39.371264 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 274/549] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 01:17:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:39.376530 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9131898-61f2-4993-8bd8-85497f418a7b None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:39.512300 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:39.588242 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9131898-61f2-4993-8bd8-85497f418a7b None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:39.615133 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a1cb26-cbbb-4235-99f7-57f21bc4eadb None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:39.644580 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f9597-fc16-4372-8b9e-69a3254150a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:39.645620 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f9597-fc16-4372-8b9e-69a3254150a5 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:39.646389 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f9597-fc16-4372-8b9e-69a3254150a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:39.646664 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f9597-fc16-4372-8b9e-69a3254150a5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:39.657610 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43f9597-fc16-4372-8b9e-69a3254150a5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:39.659129 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43f9597-fc16-4372-8b9e-69a3254150a5 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:39.675298 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-f43f9597-fc16-4372-8b9e-69a3254150a5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 12 01:17:39.675298 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:39.675298 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:39.675298 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:39.675298 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:39.675298 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:39.675298 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:39.675298 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:39.675298 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:39.675298 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:39.675298 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:39.675298 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:39.675298 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 01:17:39.675298 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 01:17:39.675298 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 01:17:39.675298 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 01:17:39.676695 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:39.676695 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:39.676695 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 01:17:39.676695 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 01:17:39.676695 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 01:17:39.676695 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 01:17:39.676695 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:39.676695 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:39.676695 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:39.676695 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:39.676695 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:39.676695 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:39.676695 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:39.676695 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:39.676695 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:39.676695 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:39.676695 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:39.676695 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:39.678695 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:39.678695 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:39.678695 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 01:17:39.678695 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 01:17:39.678695 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 01:17:39.678695 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 01:17:39.678695 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 01:17:39.678695 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 01:17:39.678695 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 12 01:17:39.678695 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:17:39.678695 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 276/550] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Aug 12 01:17:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:39.683691 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d6b1c2-d8c1-4fac-9b67-92006e91f238 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:39.683855 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d6b1c2-d8c1-4fac-9b67-92006e91f238 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:39.684114 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d6b1c2-d8c1-4fac-9b67-92006e91f238 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:39.686188 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 277/551] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:17:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:17:39.687307 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d6b1c2-d8c1-4fac-9b67-92006e91f238 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:39.739157 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a1cb26-cbbb-4235-99f7-57f21bc4eadb None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:39.783965 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64704f1-8e8c-4cfe-a979-e29791d2db15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:39.784536 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64704f1-8e8c-4cfe-a979-e29791d2db15 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:39.784808 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64704f1-8e8c-4cfe-a979-e29791d2db15 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:39.785099 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64704f1-8e8c-4cfe-a979-e29791d2db15 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:39.799427 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64704f1-8e8c-4cfe-a979-e29791d2db15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:17:39.805842 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-b64704f1-8e8c-4cfe-a979-e29791d2db15 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 01:17:39.805842 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:39.805842 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:39.805842 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:39.805842 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:39.805842 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:39.805842 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:39.805842 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:39.805842 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:39.805842 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:39.805842 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:39.805842 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:39.805842 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:17:39.805842 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:17:39.805842 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:17:39.805842 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:17:39.807687 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:17:39.807687 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:17:39.807687 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:17:39.807687 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:17:39.807687 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:39.807687 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:39.807687 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:39.807687 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:39.807687 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:39.807687 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:39.807687 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:39.807687 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:39.807687 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:39.807687 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:39.807687 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:39.807687 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:39.809664 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:39.809664 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:39.809664 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:39.809664 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:39.809664 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:17:39.809664 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:17:39.809664 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:17:39.809664 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:17:39.809664 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:17:39.809664 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:17:39.809664 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 01:17:39.809664 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:17:39.809664 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 275/552] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Aug 12 01:17:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:39.809664 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98274e08-ad6d-43de-afc0-fc5d43e3555e None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:39.811199 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98274e08-ad6d-43de-afc0-fc5d43e3555e None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:39.811199 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98274e08-ad6d-43de-afc0-fc5d43e3555e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:39.816220 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d6b1c2-d8c1-4fac-9b67-92006e91f238 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:39.827295 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:39.835026 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-98274e08-ad6d-43de-afc0-fc5d43e3555e None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:17:39.836745 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-98274e08-ad6d-43de-afc0-fc5d43e3555e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:17:39.861144 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2a53fb-641e-49b7-b158-40ab8aa469f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:39.861874 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a53fb-641e-49b7-b158-40ab8aa469f3 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:39.862235 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a53fb-641e-49b7-b158-40ab8aa469f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:39.862565 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a53fb-641e-49b7-b158-40ab8aa469f3 None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:39.863399 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2a53fb-641e-49b7-b158-40ab8aa469f3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:39.863765 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2a53fb-641e-49b7-b158-40ab8aa469f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:39.865644 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2a53fb-641e-49b7-b158-40ab8aa469f3 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:39.873647 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:39.889245 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 278/553] 10.222.0.26 () {56 vars in 1135 bytes} [Fri Aug 12 01:17:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:39.889245 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2a53fb-641e-49b7-b158-40ab8aa469f3 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:39.935920 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 276/554] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:17:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 01:17:39.937017 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98274e08-ad6d-43de-afc0-fc5d43e3555e None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:40.034613 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2a53fb-641e-49b7-b158-40ab8aa469f3 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:40.067328 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98274e08-ad6d-43de-afc0-fc5d43e3555e None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:40.079120 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74346193-a84c-4270-ad9c-245ce8887cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:40.079891 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74346193-a84c-4270-ad9c-245ce8887cc2 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:40.080195 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74346193-a84c-4270-ad9c-245ce8887cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:40.080469 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74346193-a84c-4270-ad9c-245ce8887cc2 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:40.081419 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74346193-a84c-4270-ad9c-245ce8887cc2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:40.082166 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74346193-a84c-4270-ad9c-245ce8887cc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:40.083991 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74346193-a84c-4270-ad9c-245ce8887cc2 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:40.100537 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 279/555] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Aug 12 01:17:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:40.100537 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b7647-cfa7-4910-8c55-22d074fd7627 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:40.100537 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b7647-cfa7-4910-8c55-22d074fd7627 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:40.100537 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b7647-cfa7-4910-8c55-22d074fd7627 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:40.100537 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 280/556] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:17:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:17:40.100537 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67572b00-2020-429b-8dd5-975088c77dfd None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:40.101111 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67572b00-2020-429b-8dd5-975088c77dfd None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:40.101111 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67572b00-2020-429b-8dd5-975088c77dfd None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:40.103879 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 281/557] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:17:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:17:40.103879 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67572b00-2020-429b-8dd5-975088c77dfd None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:40.112209 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73d5e92-d1d5-45e2-991f-f4545d496931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:40.112823 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d5e92-d1d5-45e2-991f-f4545d496931 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:40.113090 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d5e92-d1d5-45e2-991f-f4545d496931 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:40.113353 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d5e92-d1d5-45e2-991f-f4545d496931 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:40.137195 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:40.147852 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:40.185445 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73d5e92-d1d5-45e2-991f-f4545d496931 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:40.187037 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73d5e92-d1d5-45e2-991f-f4545d496931 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:40.216939 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67572b00-2020-429b-8dd5-975088c77dfd None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:40.250627 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd10dd3-2ece-4329-811f-e66d43cf96cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:40.251251 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd10dd3-2ece-4329-811f-e66d43cf96cc None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:40.251525 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd10dd3-2ece-4329-811f-e66d43cf96cc None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:40.251793 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd10dd3-2ece-4329-811f-e66d43cf96cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:40.262165 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd10dd3-2ece-4329-811f-e66d43cf96cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:40.263603 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd10dd3-2ece-4329-811f-e66d43cf96cc None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:40.277789 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-0fd10dd3-2ece-4329-811f-e66d43cf96cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:40.277789 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:40.277789 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:40.277789 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:40.277789 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:40.277789 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:40.277789 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:40.277789 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:40.277789 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:40.277789 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:40.277789 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:40.277789 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:40.277789 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 01:17:40.277789 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 01:17:40.277789 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 01:17:40.277789 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 01:17:40.278838 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:40.278838 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:40.278838 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:40.278838 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:40.278838 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:40.278838 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:40.278838 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:40.278838 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:40.278838 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:40.278838 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:40.278838 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:40.278838 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:40.278838 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:40.278838 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:40.278838 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:40.278838 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:40.278838 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 01:17:40.279705 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 01:17:40.279705 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:40.279705 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:17:40.279705 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 282/558] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:17:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:40.280010 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b5412b-a43a-4b30-b83e-9d5485838645 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:40.280286 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b5412b-a43a-4b30-b83e-9d5485838645 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:40.280554 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b5412b-a43a-4b30-b83e-9d5485838645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:40.289732 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 277/559] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 01:17:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 01:17:40.291068 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431ff08-57da-44fb-bc94-adbcad9deb93 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:40.291356 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431ff08-57da-44fb-bc94-adbcad9deb93 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:40.291625 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431ff08-57da-44fb-bc94-adbcad9deb93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:40.299808 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-79b5412b-a43a-4b30-b83e-9d5485838645 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:17:40.300992 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-79b5412b-a43a-4b30-b83e-9d5485838645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:17:40.309210 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-7431ff08-57da-44fb-bc94-adbcad9deb93 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:17:40.310408 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-7431ff08-57da-44fb-bc94-adbcad9deb93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:17:40.366807 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 283/560] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:17:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 01:17:40.367971 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b5412b-a43a-4b30-b83e-9d5485838645 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:40.373100 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:40.382728 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:40.386251 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 278/561] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:17:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 01:17:40.388783 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7431ff08-57da-44fb-bc94-adbcad9deb93 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:40.480980 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b5412b-a43a-4b30-b83e-9d5485838645 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:40.521348 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bc7ea8-5147-4a76-8001-0ec91fdea880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:40.522089 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc7ea8-5147-4a76-8001-0ec91fdea880 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:40.522465 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc7ea8-5147-4a76-8001-0ec91fdea880 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:40.522833 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc7ea8-5147-4a76-8001-0ec91fdea880 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:40.528819 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7431ff08-57da-44fb-bc94-adbcad9deb93 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:40.533839 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bc7ea8-5147-4a76-8001-0ec91fdea880 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:17:40.538695 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-b4bc7ea8-5147-4a76-8001-0ec91fdea880 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 01:17:40.538695 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:40.538695 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:40.538695 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:40.538695 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:40.538695 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:40.538695 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:40.538695 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:40.538695 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:40.538695 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:40.538695 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:40.538695 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:40.538695 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:17:40.538695 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:17:40.538695 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:17:40.538695 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:17:40.539829 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:17:40.539829 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:17:40.539829 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:17:40.539829 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:17:40.539829 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:40.539829 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:40.539829 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:40.539829 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:40.539829 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:40.539829 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:40.539829 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:40.539829 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:40.539829 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:40.539829 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:40.539829 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:40.539829 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:40.540843 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:40.540843 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:40.540843 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:40.540843 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:40.540843 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:17:40.540843 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:17:40.540843 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:17:40.540843 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:17:40.540843 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:17:40.540843 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:17:40.540843 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 01:17:40.540843 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:17:40.547269 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 284/562] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Aug 12 01:17:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:40.547269 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bc7ea8-5147-4a76-8001-0ec91fdea880 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:40.580894 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd08ae0-69ad-4702-a8d5-750aeda90e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:40.582884 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd08ae0-69ad-4702-a8d5-750aeda90e9f None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:40.583366 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd08ae0-69ad-4702-a8d5-750aeda90e9f None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:40.583896 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd08ae0-69ad-4702-a8d5-750aeda90e9f None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:40.584867 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd08ae0-69ad-4702-a8d5-750aeda90e9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:40.585317 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd08ae0-69ad-4702-a8d5-750aeda90e9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:40.586856 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd08ae0-69ad-4702-a8d5-750aeda90e9f None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:40.602689 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 279/563] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 01:17:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:40.603811 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd08ae0-69ad-4702-a8d5-750aeda90e9f None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:40.624275 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:40.659956 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bc7ea8-5147-4a76-8001-0ec91fdea880 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:40.671557 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:40.694251 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a61b5d5-eab6-44bb-9f9a-c1743864843e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:40.694891 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a61b5d5-eab6-44bb-9f9a-c1743864843e None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:40.695164 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a61b5d5-eab6-44bb-9f9a-c1743864843e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:40.695429 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a61b5d5-eab6-44bb-9f9a-c1743864843e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:40.705522 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a61b5d5-eab6-44bb-9f9a-c1743864843e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:40.707047 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a61b5d5-eab6-44bb-9f9a-c1743864843e None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:40.721063 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd08ae0-69ad-4702-a8d5-750aeda90e9f None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:40.721982 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-1a61b5d5-eab6-44bb-9f9a-c1743864843e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:40.721982 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:40.721982 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:40.721982 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:40.721982 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:40.721982 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:40.721982 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:40.721982 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:40.721982 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:40.721982 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:40.721982 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:40.721982 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:40.721982 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 01:17:40.721982 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 01:17:40.721982 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 01:17:40.721982 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 01:17:40.722927 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:40.722927 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:40.722927 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:40.722927 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:40.722927 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:40.722927 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:40.722927 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:40.722927 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:40.722927 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:40.722927 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:40.722927 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:40.722927 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:40.722927 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:40.722927 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:40.722927 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:40.722927 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:40.722927 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 01:17:40.723780 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 01:17:40.723780 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:40.723780 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:17:40.723780 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 285/564] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:17:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:40.724045 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a61b5d5-eab6-44bb-9f9a-c1743864843e None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:40.759121 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bff9ff-8712-4240-842f-ba454a3b5b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:40.759726 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bff9ff-8712-4240-842f-ba454a3b5b90 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:40.759999 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bff9ff-8712-4240-842f-ba454a3b5b90 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:40.760270 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bff9ff-8712-4240-842f-ba454a3b5b90 None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:40.760926 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bff9ff-8712-4240-842f-ba454a3b5b90 None admin] RBAC: Adding query filter params (name=service) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:40.761225 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bff9ff-8712-4240-842f-ba454a3b5b90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:40.762614 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bff9ff-8712-4240-842f-ba454a3b5b90 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:40.770320 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 280/565] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Aug 12 01:17:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:40.771597 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bff9ff-8712-4240-842f-ba454a3b5b90 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:40.820407 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a61b5d5-eab6-44bb-9f9a-c1743864843e None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:40.842324 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:40.855516 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3113698d-5801-454d-b3d3-85c387591548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:40.856133 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113698d-5801-454d-b3d3-85c387591548 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:40.856405 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113698d-5801-454d-b3d3-85c387591548 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:40.856669 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113698d-5801-454d-b3d3-85c387591548 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:40.864084 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3113698d-5801-454d-b3d3-85c387591548 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:40.865694 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3113698d-5801-454d-b3d3-85c387591548 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:40.874944 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bff9ff-8712-4240-842f-ba454a3b5b90 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:40.876523 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-3113698d-5801-454d-b3d3-85c387591548 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 12 01:17:40.876523 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:40.876523 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:40.876523 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:40.876523 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:40.876523 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:40.876523 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:40.876523 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:40.876523 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:40.876523 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:40.876523 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:40.876523 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:40.876523 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 01:17:40.876523 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 01:17:40.876523 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 01:17:40.876523 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 01:17:40.877510 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:40.877510 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:40.877510 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 01:17:40.877510 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 01:17:40.877510 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 01:17:40.877510 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 01:17:40.877510 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:40.877510 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:40.877510 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:40.877510 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:40.877510 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:40.877510 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:40.877510 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:40.877510 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:40.877510 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:40.877510 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:40.877510 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:40.877510 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:40.878875 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:40.878875 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:40.878875 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 01:17:40.878875 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 01:17:40.878875 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 01:17:40.878875 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 01:17:40.878875 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 01:17:40.878875 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 01:17:40.878875 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 12 01:17:40.878875 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:17:40.878875 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 286/566] 10.222.0.26 () {56 vars in 1093 bytes} [Fri Aug 12 01:17:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:40.878875 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3113698d-5801-454d-b3d3-85c387591548 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:40.893358 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:40.911228 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bb79a5-0f18-45fa-a6bd-193b51cc0202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:40.911864 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb79a5-0f18-45fa-a6bd-193b51cc0202 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:40.912139 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb79a5-0f18-45fa-a6bd-193b51cc0202 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:40.912401 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb79a5-0f18-45fa-a6bd-193b51cc0202 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:40.922363 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bb79a5-0f18-45fa-a6bd-193b51cc0202 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:17:40.927362 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-49bb79a5-0f18-45fa-a6bd-193b51cc0202 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 01:17:40.927362 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:40.927362 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:40.927362 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:40.927362 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:40.927362 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:40.927362 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:40.927362 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:40.927362 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:40.927362 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:40.927362 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:40.927362 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:40.927362 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:17:40.927362 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:17:40.927362 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:17:40.927362 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:17:40.928295 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:17:40.928295 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:17:40.928295 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:17:40.928295 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:17:40.928295 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:40.928295 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:40.928295 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:40.928295 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:40.928295 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:40.928295 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:40.928295 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:40.928295 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:40.928295 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:40.928295 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:40.928295 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:40.928295 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:40.929113 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:40.929113 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:40.929113 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:40.929113 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:40.929113 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:17:40.929113 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:17:40.929113 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:17:40.929113 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:17:40.929113 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:17:40.929113 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:17:40.929113 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 01:17:40.929113 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:17:40.929113 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 281/567] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Aug 12 01:17:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:40.929811 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bb79a5-0f18-45fa-a6bd-193b51cc0202 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:40.979757 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3113698d-5801-454d-b3d3-85c387591548 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:41.011397 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6262d908-4980-48ab-9693-687b58e9667a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:41.012018 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262d908-4980-48ab-9693-687b58e9667a None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:41.012311 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262d908-4980-48ab-9693-687b58e9667a None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:41.012564 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262d908-4980-48ab-9693-687b58e9667a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:41.022521 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6262d908-4980-48ab-9693-687b58e9667a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:17:41.027043 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bb79a5-0f18-45fa-a6bd-193b51cc0202 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:41.027479 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-6262d908-4980-48ab-9693-687b58e9667a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 01:17:41.027479 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:41.027479 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:41.027479 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:41.027479 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:41.027479 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:41.027479 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:41.027479 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:41.027479 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:41.027479 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:41.027479 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:41.027479 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:41.027479 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:17:41.027479 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:17:41.027479 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:17:41.027479 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:17:41.028402 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:17:41.028402 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:17:41.028402 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:17:41.028402 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:17:41.028402 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:41.028402 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:41.028402 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:41.028402 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:41.028402 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:41.028402 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:41.028402 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:41.028402 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:41.028402 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:41.028402 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:41.028402 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:41.028402 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:41.029232 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:41.029232 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:41.029232 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:41.029232 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:41.029232 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:17:41.029232 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:17:41.029232 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:17:41.029232 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:17:41.029232 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:17:41.029232 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:17:41.029232 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 01:17:41.029232 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:17:41.029232 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 287/568] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Aug 12 01:17:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:41.029908 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6262d908-4980-48ab-9693-687b58e9667a None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:41.062487 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166d43bf-99f5-4825-ac82-fb424a398d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:41.063264 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d43bf-99f5-4825-ac82-fb424a398d2f None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:41.063547 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d43bf-99f5-4825-ac82-fb424a398d2f None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:41.063821 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d43bf-99f5-4825-ac82-fb424a398d2f None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:41.064453 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166d43bf-99f5-4825-ac82-fb424a398d2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:41.064752 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166d43bf-99f5-4825-ac82-fb424a398d2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:41.066135 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166d43bf-99f5-4825-ac82-fb424a398d2f None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:41.073148 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:41.079319 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 282/569] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 01:17:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:41.080193 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166d43bf-99f5-4825-ac82-fb424a398d2f None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:41.114042 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:41.133035 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6262d908-4980-48ab-9693-687b58e9667a None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:41.167879 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc6cdb7-6d0f-4f82-b70c-2b45f9d5518d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:41.168439 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc6cdb7-6d0f-4f82-b70c-2b45f9d5518d None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:41.168708 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc6cdb7-6d0f-4f82-b70c-2b45f9d5518d None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:41.168982 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc6cdb7-6d0f-4f82-b70c-2b45f9d5518d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:41.177708 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166d43bf-99f5-4825-ac82-fb424a398d2f None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:41.180062 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc6cdb7-6d0f-4f82-b70c-2b45f9d5518d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:41.181530 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc6cdb7-6d0f-4f82-b70c-2b45f9d5518d None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:41.194974 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-0dc6cdb7-6d0f-4f82-b70c-2b45f9d5518d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:41.194974 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:41.194974 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:41.194974 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:41.194974 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:41.194974 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:41.194974 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:41.194974 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:41.194974 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:41.194974 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:41.194974 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:41.194974 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:41.194974 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 01:17:41.194974 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 01:17:41.194974 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 01:17:41.194974 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 01:17:41.196073 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:41.196073 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:41.196073 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:41.196073 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:41.196073 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:41.196073 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:41.196073 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:41.196073 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:41.196073 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:41.196073 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:41.196073 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:41.196073 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:41.196073 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:41.196073 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:41.196073 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:41.196073 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:41.196073 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 01:17:41.197249 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 01:17:41.197249 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:41.197249 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:17:41.197249 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 288/570] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:17:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:41.197249 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc6cdb7-6d0f-4f82-b70c-2b45f9d5518d None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:41.213004 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90400d4f-7807-4f48-9565-b1ff46623cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:41.213593 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90400d4f-7807-4f48-9565-b1ff46623cfb None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:41.213860 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90400d4f-7807-4f48-9565-b1ff46623cfb None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:41.214152 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90400d4f-7807-4f48-9565-b1ff46623cfb None admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:41.214859 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90400d4f-7807-4f48-9565-b1ff46623cfb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:41.215157 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90400d4f-7807-4f48-9565-b1ff46623cfb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:41.216564 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90400d4f-7807-4f48-9565-b1ff46623cfb None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:41.234684 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 283/571] 10.222.0.26 () {56 vars in 1133 bytes} [Fri Aug 12 01:17:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:41.235488 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90400d4f-7807-4f48-9565-b1ff46623cfb None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:41.290421 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:41.297289 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc6cdb7-6d0f-4f82-b70c-2b45f9d5518d None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:41.327074 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:41.330285 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ae6e86-04ff-4150-8630-5bfcc084f42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:41.330896 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae6e86-04ff-4150-8630-5bfcc084f42c None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:41.331171 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae6e86-04ff-4150-8630-5bfcc084f42c None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:41.331441 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae6e86-04ff-4150-8630-5bfcc084f42c None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:41.332097 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ae6e86-04ff-4150-8630-5bfcc084f42c None admin] RBAC: Adding query filter params (name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:41.332394 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ae6e86-04ff-4150-8630-5bfcc084f42c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:41.334324 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90400d4f-7807-4f48-9565-b1ff46623cfb None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:41.334455 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ae6e86-04ff-4150-8630-5bfcc084f42c None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:41.342324 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 289/572] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Aug 12 01:17:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:41.343011 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ae6e86-04ff-4150-8630-5bfcc084f42c None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:41.367326 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba18b9f2-e398-459d-8e97-e8c5c5c3426b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:41.367928 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18b9f2-e398-459d-8e97-e8c5c5c3426b None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:41.368201 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18b9f2-e398-459d-8e97-e8c5c5c3426b None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:41.368470 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18b9f2-e398-459d-8e97-e8c5c5c3426b None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:41.369152 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba18b9f2-e398-459d-8e97-e8c5c5c3426b None admin] RBAC: Adding query filter params (name=service) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:41.369446 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba18b9f2-e398-459d-8e97-e8c5c5c3426b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:41.370792 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba18b9f2-e398-459d-8e97-e8c5c5c3426b None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:41.378504 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 284/573] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Aug 12 01:17:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:41.379260 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba18b9f2-e398-459d-8e97-e8c5c5c3426b None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:41.449755 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ae6e86-04ff-4150-8630-5bfcc084f42c None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:41.476694 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba18b9f2-e398-459d-8e97-e8c5c5c3426b None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:41.482966 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d5b20-110c-4457-a0bf-d7fe35d4b748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:41.483605 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d5b20-110c-4457-a0bf-d7fe35d4b748 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:41.483880 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d5b20-110c-4457-a0bf-d7fe35d4b748 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:41.484147 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d5b20-110c-4457-a0bf-d7fe35d4b748 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:41.491863 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3d5b20-110c-4457-a0bf-d7fe35d4b748 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:41.493364 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3d5b20-110c-4457-a0bf-d7fe35d4b748 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:41.504354 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-7b3d5b20-110c-4457-a0bf-d7fe35d4b748 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 01:17:41.504354 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:41.504354 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:41.504354 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:41.504354 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:41.504354 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:41.504354 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:41.504354 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:41.504354 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:41.504354 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:41.504354 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:41.504354 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:41.504354 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 01:17:41.504354 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 01:17:41.504354 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 01:17:41.505667 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 01:17:41.505667 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:41.505667 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:41.505667 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:41.505667 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:41.505667 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:41.505667 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:41.505667 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:41.505667 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:41.505667 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:41.505667 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:41.505667 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:41.505667 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:41.505667 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:41.505667 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:41.505667 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:41.505667 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:41.507178 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 01:17:41.507178 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 01:17:41.507178 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 01:17:41.507178 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 01:17:41.507178 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 01:17:41.507178 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 01:17:41.507178 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 01:17:41.507178 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:17:41.510260 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 290/574] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 01:17:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:41.511322 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d5b20-110c-4457-a0bf-d7fe35d4b748 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:41.512583 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8731c893-bb9a-4bc4-9896-ef63cb954448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:41.513194 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731c893-bb9a-4bc4-9896-ef63cb954448 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:41.513474 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731c893-bb9a-4bc4-9896-ef63cb954448 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:41.513747 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731c893-bb9a-4bc4-9896-ef63cb954448 None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:41.514406 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8731c893-bb9a-4bc4-9896-ef63cb954448 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:41.514709 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8731c893-bb9a-4bc4-9896-ef63cb954448 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:41.516062 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8731c893-bb9a-4bc4-9896-ef63cb954448 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:41.527855 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 285/575] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 01:17:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:41.528642 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8731c893-bb9a-4bc4-9896-ef63cb954448 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:41.530351 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:41.547996 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:41.610778 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d5b20-110c-4457-a0bf-d7fe35d4b748 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:41.627992 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8731c893-bb9a-4bc4-9896-ef63cb954448 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:41.642413 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dda76d-e4aa-4a07-abaf-edd5b05744a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:41.643041 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dda76d-e4aa-4a07-abaf-edd5b05744a3 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:41.643316 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dda76d-e4aa-4a07-abaf-edd5b05744a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:41.643582 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dda76d-e4aa-4a07-abaf-edd5b05744a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:41.654015 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dda76d-e4aa-4a07-abaf-edd5b05744a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:41.655531 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dda76d-e4aa-4a07-abaf-edd5b05744a3 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:41.660146 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d828157-a6f2-44f6-926a-02bba8746f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:41.660763 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d828157-a6f2-44f6-926a-02bba8746f94 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:41.661032 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d828157-a6f2-44f6-926a-02bba8746f94 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:41.661295 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d828157-a6f2-44f6-926a-02bba8746f94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:41.669844 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-61dda76d-e4aa-4a07-abaf-edd5b05744a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:41.669844 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:41.669844 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:41.669844 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:41.669844 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:41.669844 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:41.669844 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:41.669844 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:41.669844 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:41.669844 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:41.669844 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:41.669844 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:41.669844 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 01:17:41.669844 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 01:17:41.669844 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 01:17:41.669844 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 01:17:41.670820 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:41.670820 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:41.670820 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:41.670820 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:41.670820 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:41.670820 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:41.670820 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:41.670820 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:41.670820 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:41.670820 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:41.670820 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:41.670820 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:41.670820 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:41.670820 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:41.670820 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:41.670820 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:41.670820 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 01:17:41.671686 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 01:17:41.671686 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:41.671686 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:17:41.671686 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 291/576] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:17:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:41.671903 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dda76d-e4aa-4a07-abaf-edd5b05744a3 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:41.674295 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d828157-a6f2-44f6-926a-02bba8746f94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:41.675737 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d828157-a6f2-44f6-926a-02bba8746f94 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:41.690025 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-1d828157-a6f2-44f6-926a-02bba8746f94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:41.690025 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:41.690025 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:41.690025 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:41.690025 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:41.690025 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:41.690025 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:41.690025 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:41.690025 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:41.690025 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:41.690025 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:41.690025 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:41.690025 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 01:17:41.690025 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 01:17:41.690025 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 01:17:41.690025 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 01:17:41.690990 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:41.690990 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:41.690990 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:41.690990 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:41.690990 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:41.690990 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:41.690990 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:41.690990 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:41.690990 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:41.690990 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:41.690990 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:41.690990 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:41.690990 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:41.690990 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:41.690990 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:41.690990 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:41.690990 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 01:17:41.691893 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 01:17:41.691893 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:41.691893 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:17:41.691893 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 286/577] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:17:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:41.691893 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d828157-a6f2-44f6-926a-02bba8746f94 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:41.747105 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:41.758502 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:41.783057 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dda76d-e4aa-4a07-abaf-edd5b05744a3 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:41.792703 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d828157-a6f2-44f6-926a-02bba8746f94 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:41.818108 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a2cdd9-ce80-42f0-8640-04c233431a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:41.818749 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a2cdd9-ce80-42f0-8640-04c233431a64 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:41.819019 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a2cdd9-ce80-42f0-8640-04c233431a64 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:41.819280 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a2cdd9-ce80-42f0-8640-04c233431a64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:41.827405 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0efb2e-970a-4fa9-b32c-815ead8b4382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:41.828013 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0efb2e-970a-4fa9-b32c-815ead8b4382 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:41.828286 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0efb2e-970a-4fa9-b32c-815ead8b4382 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:41.828554 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0efb2e-970a-4fa9-b32c-815ead8b4382 None admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:41.829236 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0efb2e-970a-4fa9-b32c-815ead8b4382 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:41.829334 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a2cdd9-ce80-42f0-8640-04c233431a64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:41.829534 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0efb2e-970a-4fa9-b32c-815ead8b4382 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:41.830781 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a2cdd9-ce80-42f0-8640-04c233431a64 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:41.830971 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0efb2e-970a-4fa9-b32c-815ead8b4382 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:41.843145 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 287/578] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Aug 12 01:17:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:41.843922 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0efb2e-970a-4fa9-b32c-815ead8b4382 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:41.844581 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-51a2cdd9-ce80-42f0-8640-04c233431a64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:41.844581 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:41.844581 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:41.844581 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:41.844581 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:41.844581 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:41.844581 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:41.844581 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:41.844581 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:41.844581 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:41.844581 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:41.844581 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:41.844581 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 01:17:41.844581 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 01:17:41.844581 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 01:17:41.844581 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 01:17:41.845637 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:41.845637 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:41.845637 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:41.845637 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:41.845637 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:41.845637 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:41.845637 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:41.845637 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:41.845637 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:41.845637 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:41.845637 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:41.845637 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:41.845637 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:41.845637 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:41.845637 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:41.845637 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:41.845637 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 01:17:41.846539 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 01:17:41.846539 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:41.846539 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:17:41.846539 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 292/579] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:17:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:41.846539 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a2cdd9-ce80-42f0-8640-04c233431a64 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:41.946960 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0efb2e-970a-4fa9-b32c-815ead8b4382 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:41.947167 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a2cdd9-ce80-42f0-8640-04c233431a64 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:41.965862 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:41.973100 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:41.980554 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558182ef-3dd4-45c9-a01f-98db13c3f086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:41.981002 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b0a86f-b747-4fa8-96dc-ecab4bf31004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:41.981163 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558182ef-3dd4-45c9-a01f-98db13c3f086 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:41.981440 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558182ef-3dd4-45c9-a01f-98db13c3f086 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:41.981629 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b0a86f-b747-4fa8-96dc-ecab4bf31004 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:41.981720 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558182ef-3dd4-45c9-a01f-98db13c3f086 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:41.981900 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b0a86f-b747-4fa8-96dc-ecab4bf31004 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:41.982195 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b0a86f-b747-4fa8-96dc-ecab4bf31004 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:41.982376 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558182ef-3dd4-45c9-a01f-98db13c3f086 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:41.982677 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558182ef-3dd4-45c9-a01f-98db13c3f086 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:41.984089 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558182ef-3dd4-45c9-a01f-98db13c3f086 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:41.989089 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b0a86f-b747-4fa8-96dc-ecab4bf31004 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:41.990663 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b0a86f-b747-4fa8-96dc-ecab4bf31004 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:41.995887 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 293/580] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 01:17:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:41.996662 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558182ef-3dd4-45c9-a01f-98db13c3f086 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:42.002376 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-f8b0a86f-b747-4fa8-96dc-ecab4bf31004 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 12 01:17:42.002376 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:42.002376 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:42.002376 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:42.002376 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:42.002376 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:42.002376 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:42.002376 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:42.002376 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:42.002376 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:42.002376 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:42.002376 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:42.002376 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 01:17:42.002376 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 01:17:42.002376 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 01:17:42.002376 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 01:17:42.003404 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:42.003404 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:42.003404 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 01:17:42.003404 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 01:17:42.003404 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 01:17:42.003404 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 01:17:42.003404 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:42.003404 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:42.003404 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:42.003404 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:42.003404 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:42.003404 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:42.003404 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:42.003404 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:42.003404 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:42.003404 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:42.003404 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:42.003404 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:42.004337 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:42.004337 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:42.004337 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 01:17:42.004337 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 01:17:42.004337 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 01:17:42.004337 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 01:17:42.004337 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 01:17:42.004337 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 01:17:42.004337 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 12 01:17:42.004337 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:17:42.004337 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 288/581] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 01:17:41 2022] GET /identity/v3/users/glance => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:42.004909 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b0a86f-b747-4fa8-96dc-ecab4bf31004 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:42.097236 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558182ef-3dd4-45c9-a01f-98db13c3f086 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:42.109487 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b0a86f-b747-4fa8-96dc-ecab4bf31004 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:42.132840 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a33e36e-ae77-4261-850e-645a0e361688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:42.133460 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a33e36e-ae77-4261-850e-645a0e361688 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:42.133733 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a33e36e-ae77-4261-850e-645a0e361688 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:42.133997 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a33e36e-ae77-4261-850e-645a0e361688 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:42.134680 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a33e36e-ae77-4261-850e-645a0e361688 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:42.134976 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a33e36e-ae77-4261-850e-645a0e361688 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:42.136336 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a33e36e-ae77-4261-850e-645a0e361688 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:42.144300 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ff23a-fec9-4124-bad8-083f879ab3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:42.144931 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ff23a-fec9-4124-bad8-083f879ab3c7 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:42.145204 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ff23a-fec9-4124-bad8-083f879ab3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:42.145472 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ff23a-fec9-4124-bad8-083f879ab3c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:42.146791 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425ff23a-fec9-4124-bad8-083f879ab3c7 None admin] RBAC: Adding query filter params (role.id=90d1ca7df8de4b03a689afc664d0cc3f, scope.project.id=fa91143910a74c6b896ced5b51f9966a, user.id=32c1ba237f864b5d9699cb817e42e647) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:42.147097 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425ff23a-fec9-4124-bad8-083f879ab3c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:42.147610 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 294/582] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 01:17:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:42.148396 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a33e36e-ae77-4261-850e-645a0e361688 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:42.148518 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425ff23a-fec9-4124-bad8-083f879ab3c7 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:42.164229 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 289/583] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 01:17:42 2022] GET /identity/v3/role_assignments?user.id=32c1ba237f864b5d9699cb817e42e647&scope.project.id=fa91143910a74c6b896ced5b51f9966a&role.id=90d1ca7df8de4b03a689afc664d0cc3f => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:42.164229 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ff23a-fec9-4124-bad8-083f879ab3c7 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:42.209473 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:42.216345 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:42.270577 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ff23a-fec9-4124-bad8-083f879ab3c7 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:42.278068 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a33e36e-ae77-4261-850e-645a0e361688 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:42.314227 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9cc9b2-e4fd-41db-b66a-dbb0144545a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:42.314877 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9cc9b2-e4fd-41db-b66a-dbb0144545a9 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:42.315154 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9cc9b2-e4fd-41db-b66a-dbb0144545a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:42.315426 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9cc9b2-e4fd-41db-b66a-dbb0144545a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:42.322523 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfdb996-c7f0-4da7-86ee-050d67febe86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:42.322673 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9cc9b2-e4fd-41db-b66a-dbb0144545a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:42.323134 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfdb996-c7f0-4da7-86ee-050d67febe86 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:42.323405 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfdb996-c7f0-4da7-86ee-050d67febe86 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:42.323669 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfdb996-c7f0-4da7-86ee-050d67febe86 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:42.324036 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9cc9b2-e4fd-41db-b66a-dbb0144545a9 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:42.324305 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfdb996-c7f0-4da7-86ee-050d67febe86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:42.324603 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfdb996-c7f0-4da7-86ee-050d67febe86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:42.325954 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfdb996-c7f0-4da7-86ee-050d67febe86 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:42.335662 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-fa9cc9b2-e4fd-41db-b66a-dbb0144545a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 01:17:42.335662 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:42.335662 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:42.335662 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:42.335662 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:42.335662 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:42.335662 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:42.335662 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:42.335662 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:42.335662 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:42.335662 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:42.335662 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:42.335662 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 01:17:42.335662 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 01:17:42.335662 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 01:17:42.336589 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 01:17:42.336589 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:42.336589 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:42.336589 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:42.336589 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:42.336589 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:42.336589 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:42.336589 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:42.336589 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:42.336589 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:42.336589 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:42.336589 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:42.336589 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:42.336589 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:42.336589 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:42.336589 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:42.336589 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:42.337493 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 01:17:42.337493 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 01:17:42.337493 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 01:17:42.337493 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 01:17:42.337493 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 01:17:42.337493 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 01:17:42.337493 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 01:17:42.337493 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:17:42.337493 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 290/584] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 01:17:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:42.338752 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9cc9b2-e4fd-41db-b66a-dbb0144545a9 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:42.347896 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 295/585] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 01:17:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:42.347896 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfdb996-c7f0-4da7-86ee-050d67febe86 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:42.451341 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:42.454426 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfdb996-c7f0-4da7-86ee-050d67febe86 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:42.454907 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9cc9b2-e4fd-41db-b66a-dbb0144545a9 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:42.470286 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:42.495186 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f24d15-f0aa-4d86-a51a-bb6ce83cf89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:42.495820 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f24d15-f0aa-4d86-a51a-bb6ce83cf89a None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:42.496092 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f24d15-f0aa-4d86-a51a-bb6ce83cf89a None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:42.496405 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f24d15-f0aa-4d86-a51a-bb6ce83cf89a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:42.498016 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a46990-f114-425c-984c-e8ee8dd4f46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:42.498724 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a46990-f114-425c-984c-e8ee8dd4f46b None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:42.498993 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a46990-f114-425c-984c-e8ee8dd4f46b None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:42.499259 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a46990-f114-425c-984c-e8ee8dd4f46b None admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:42.500041 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a46990-f114-425c-984c-e8ee8dd4f46b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:42.500347 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a46990-f114-425c-984c-e8ee8dd4f46b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:42.501763 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a46990-f114-425c-984c-e8ee8dd4f46b None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:42.504809 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f24d15-f0aa-4d86-a51a-bb6ce83cf89a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:42.506407 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f24d15-f0aa-4d86-a51a-bb6ce83cf89a None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:42.518069 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-02f24d15-f0aa-4d86-a51a-bb6ce83cf89a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 12 01:17:42.518069 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:42.518069 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:42.518069 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:42.518069 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:42.518069 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:42.518069 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:42.518069 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:42.518069 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:42.518069 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:42.518069 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:42.518069 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:42.518069 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 01:17:42.518069 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 01:17:42.518069 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 01:17:42.518069 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 01:17:42.519024 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:42.519024 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:42.519024 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 01:17:42.519024 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 01:17:42.519024 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 01:17:42.519024 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 01:17:42.519024 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:42.519024 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:42.519024 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:42.519024 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:42.519024 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:42.519024 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:42.519024 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:42.519024 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:42.519024 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:42.519024 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:42.519024 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:42.519024 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:42.520014 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:42.520014 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:42.520014 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 01:17:42.520014 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 01:17:42.520014 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 01:17:42.520014 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 01:17:42.520014 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 01:17:42.520014 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 01:17:42.520014 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 12 01:17:42.520014 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:17:42.520014 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 296/586] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Aug 12 01:17:42 2022] GET /identity/v3/users/neutron => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:42.520652 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f24d15-f0aa-4d86-a51a-bb6ce83cf89a None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:42.521847 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 291/587] 10.222.0.26 () {56 vars in 1137 bytes} [Fri Aug 12 01:17:42 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:42.522948 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a46990-f114-425c-984c-e8ee8dd4f46b None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:42.627044 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f24d15-f0aa-4d86-a51a-bb6ce83cf89a None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:42.627708 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a46990-f114-425c-984c-e8ee8dd4f46b None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:42.663322 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d1d6dc-2f8f-4bf2-b5a7-6443d00a9d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:42.663932 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d1d6dc-2f8f-4bf2-b5a7-6443d00a9d8a None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:42.664201 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d1d6dc-2f8f-4bf2-b5a7-6443d00a9d8a None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:42.664464 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d1d6dc-2f8f-4bf2-b5a7-6443d00a9d8a None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:42.665151 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d1d6dc-2f8f-4bf2-b5a7-6443d00a9d8a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:42.665447 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d1d6dc-2f8f-4bf2-b5a7-6443d00a9d8a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:42.667205 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d1d6dc-2f8f-4bf2-b5a7-6443d00a9d8a None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:42.670839 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a87232-2e95-480c-9439-4e155041eff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:42.671647 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a87232-2e95-480c-9439-4e155041eff9 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:42.672055 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a87232-2e95-480c-9439-4e155041eff9 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:42.672507 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a87232-2e95-480c-9439-4e155041eff9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:42.679363 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 297/588] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Aug 12 01:17:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:42.680218 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d1d6dc-2f8f-4bf2-b5a7-6443d00a9d8a None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:42.685359 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a87232-2e95-480c-9439-4e155041eff9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:42.687050 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a87232-2e95-480c-9439-4e155041eff9 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:42.699838 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-28a87232-2e95-480c-9439-4e155041eff9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 12 01:17:42.699838 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:42.699838 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:42.699838 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:42.699838 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:42.699838 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:42.699838 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:42.699838 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:42.699838 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:42.699838 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:42.699838 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:42.699838 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:42.699838 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 01:17:42.699838 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 01:17:42.699838 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 01:17:42.699838 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 01:17:42.700785 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:42.700785 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:42.700785 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 01:17:42.700785 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 01:17:42.700785 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 01:17:42.700785 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 01:17:42.700785 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:42.700785 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:42.700785 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:42.700785 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:42.700785 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:42.700785 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:42.700785 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:42.700785 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:42.700785 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:42.700785 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:42.700785 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:42.700785 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:42.701765 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:42.701765 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:42.701765 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 01:17:42.701765 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 01:17:42.701765 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 01:17:42.701765 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 01:17:42.701765 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 01:17:42.701765 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 01:17:42.701765 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 12 01:17:42.701765 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:17:42.703730 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:42.705624 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 292/589] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 01:17:42 2022] GET /identity/v3/users/cinder => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:42.707030 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a87232-2e95-480c-9439-4e155041eff9 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:42.738304 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:42.787982 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d1d6dc-2f8f-4bf2-b5a7-6443d00a9d8a None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:42.814624 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a87232-2e95-480c-9439-4e155041eff9 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:42.821306 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9106b455-a593-4be9-862a-260a374f5493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:42.821914 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9106b455-a593-4be9-862a-260a374f5493 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:42.822211 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9106b455-a593-4be9-862a-260a374f5493 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:42.822474 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9106b455-a593-4be9-862a-260a374f5493 None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:42.823188 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9106b455-a593-4be9-862a-260a374f5493 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:42.823484 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9106b455-a593-4be9-862a-260a374f5493 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:42.824928 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9106b455-a593-4be9-862a-260a374f5493 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:42.843721 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 298/590] 10.222.0.26 () {56 vars in 1139 bytes} [Fri Aug 12 01:17:42 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:42.844631 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9106b455-a593-4be9-862a-260a374f5493 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:42.855919 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393027ad-a529-4cc4-bf92-e7bad64bc0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:42.856555 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393027ad-a529-4cc4-bf92-e7bad64bc0a0 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:42.857067 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393027ad-a529-4cc4-bf92-e7bad64bc0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:42.857067 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393027ad-a529-4cc4-bf92-e7bad64bc0a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:42.868325 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393027ad-a529-4cc4-bf92-e7bad64bc0a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:42.869798 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393027ad-a529-4cc4-bf92-e7bad64bc0a0 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:42.885124 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-393027ad-a529-4cc4-bf92-e7bad64bc0a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:42.885124 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:42.885124 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:42.885124 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:42.885124 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:42.885124 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:42.885124 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:42.885124 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:42.885124 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:42.885124 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:42.885124 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:42.885124 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:42.885124 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 01:17:42.885124 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 01:17:42.885124 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 01:17:42.885124 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 01:17:42.886053 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:42.886053 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:42.886053 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:42.886053 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:42.886053 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:42.886053 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:42.886053 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:42.886053 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:42.886053 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:42.886053 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:42.886053 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:42.886053 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:42.886053 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:42.886053 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:42.886053 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:42.886053 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:42.886053 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 01:17:42.892033 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 01:17:42.892033 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:42.892033 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:17:42.892033 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 293/591] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:17:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:42.892033 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393027ad-a529-4cc4-bf92-e7bad64bc0a0 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:42.933453 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:42.956863 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9106b455-a593-4be9-862a-260a374f5493 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:42.971963 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:42.990520 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393027ad-a529-4cc4-bf92-e7bad64bc0a0 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:42.992766 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5b567-db0e-4ff6-a27f-bb2244d7de74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:42.993431 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5b567-db0e-4ff6-a27f-bb2244d7de74 None admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:42.993701 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5b567-db0e-4ff6-a27f-bb2244d7de74 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:42.993966 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5b567-db0e-4ff6-a27f-bb2244d7de74 None admin] PATH_INFO: `/v3/projects/fa91143910a74c6b896ced5b51f9966a/users/fcd5e95467b44175be2478c2c7c89926/roles/90d1ca7df8de4b03a689afc664d0cc3f` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:43.008289 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa5b567-db0e-4ff6-a27f-bb2244d7de74 None admin] RBAC: Authorizing `identity:create_grant(project_id=fa91143910a74c6b896ced5b51f9966a, user_id=fcd5e95467b44175be2478c2c7c89926, role_id=90d1ca7df8de4b03a689afc664d0cc3f)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:43.009859 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa5b567-db0e-4ff6-a27f-bb2244d7de74 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:43.024093 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 299/592] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Aug 12 01:17:42 2022] PUT /identity/v3/projects/fa91143910a74c6b896ced5b51f9966a/users/fcd5e95467b44175be2478c2c7c89926/roles/90d1ca7df8de4b03a689afc664d0cc3f => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:17:43.024897 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5b567-db0e-4ff6-a27f-bb2244d7de74 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:43.037647 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a985bbad-fc21-4dc4-9df7-ce4d191aae8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:43.038750 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a985bbad-fc21-4dc4-9df7-ce4d191aae8c None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:43.038954 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a985bbad-fc21-4dc4-9df7-ce4d191aae8c None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:43.039334 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a985bbad-fc21-4dc4-9df7-ce4d191aae8c None admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:43.040149 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a985bbad-fc21-4dc4-9df7-ce4d191aae8c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:43.040517 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a985bbad-fc21-4dc4-9df7-ce4d191aae8c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:43.042391 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a985bbad-fc21-4dc4-9df7-ce4d191aae8c None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:43.064201 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 294/593] 10.222.0.26 () {56 vars in 1137 bytes} [Fri Aug 12 01:17:42 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:43.065162 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a985bbad-fc21-4dc4-9df7-ce4d191aae8c None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:43.160064 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5b567-db0e-4ff6-a27f-bb2244d7de74 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:43.176414 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a985bbad-fc21-4dc4-9df7-ce4d191aae8c None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:43.195053 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:43.207333 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d19d3c-e110-41ff-9c69-ebc8b650fd1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:43.208254 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d19d3c-e110-41ff-9c69-ebc8b650fd1d None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:43.208708 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d19d3c-e110-41ff-9c69-ebc8b650fd1d None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:43.209343 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d19d3c-e110-41ff-9c69-ebc8b650fd1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:43.217259 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2563eb-8e45-49e1-9709-5cdf5bf8646b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:43.217867 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2563eb-8e45-49e1-9709-5cdf5bf8646b None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:43.218153 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2563eb-8e45-49e1-9709-5cdf5bf8646b None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:43.222165 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2563eb-8e45-49e1-9709-5cdf5bf8646b None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:43.222165 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2563eb-8e45-49e1-9709-5cdf5bf8646b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:43.222165 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2563eb-8e45-49e1-9709-5cdf5bf8646b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:43.222165 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2563eb-8e45-49e1-9709-5cdf5bf8646b None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:43.225633 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d19d3c-e110-41ff-9c69-ebc8b650fd1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:43.227247 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d19d3c-e110-41ff-9c69-ebc8b650fd1d None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:43.230008 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:43.234997 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 295/594] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 01:17:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:43.234997 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2563eb-8e45-49e1-9709-5cdf5bf8646b None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:43.262291 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-d2d19d3c-e110-41ff-9c69-ebc8b650fd1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:43.262291 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:43.262291 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:43.262291 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:43.262291 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:43.262291 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:43.262291 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:43.262291 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:43.262291 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:43.262291 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:43.262291 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:43.262291 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:43.262291 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 01:17:43.262291 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 01:17:43.262291 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 01:17:43.262291 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 01:17:43.263443 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:43.263443 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:43.263443 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:43.263443 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:43.263443 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:43.263443 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:43.263443 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:43.263443 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:43.263443 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:43.263443 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:43.263443 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:43.263443 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:43.263443 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:43.263443 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:43.263443 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:43.263443 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:43.263443 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 01:17:43.264308 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 01:17:43.264308 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:43.264308 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:17:43.264308 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 300/595] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:17:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:43.270201 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d19d3c-e110-41ff-9c69-ebc8b650fd1d None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:43.368102 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2563eb-8e45-49e1-9709-5cdf5bf8646b None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:43.389235 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d19d3c-e110-41ff-9c69-ebc8b650fd1d None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:43.405905 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d15d9-e175-48d7-9b2c-02242492d213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:43.406781 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d15d9-e175-48d7-9b2c-02242492d213 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:43.407149 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d15d9-e175-48d7-9b2c-02242492d213 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:43.407505 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d15d9-e175-48d7-9b2c-02242492d213 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:43.420162 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4d15d9-e175-48d7-9b2c-02242492d213 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:43.422001 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4d15d9-e175-48d7-9b2c-02242492d213 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:43.423632 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c16dbc-1f78-4199-a65b-996fdb73d1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:43.424329 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c16dbc-1f78-4199-a65b-996fdb73d1d3 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:43.424663 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c16dbc-1f78-4199-a65b-996fdb73d1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:43.424988 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c16dbc-1f78-4199-a65b-996fdb73d1d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:43.431912 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c16dbc-1f78-4199-a65b-996fdb73d1d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:43.433413 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c16dbc-1f78-4199-a65b-996fdb73d1d3 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:43.437660 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-5d4d15d9-e175-48d7-9b2c-02242492d213 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:43.437660 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:43.437660 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:43.437660 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:43.437660 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:43.437660 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:43.437660 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:43.437660 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:43.437660 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:43.437660 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:43.437660 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:43.437660 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:43.437660 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 01:17:43.437660 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 01:17:43.437660 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 01:17:43.437660 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 01:17:43.439454 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:43.439454 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:43.439454 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:43.439454 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:43.439454 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:43.439454 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:43.439454 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:43.439454 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:43.439454 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:43.439454 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:43.439454 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:43.439454 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:43.439454 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:43.439454 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:43.439454 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:43.439454 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:43.439454 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 01:17:43.441332 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 01:17:43.441332 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:43.441332 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:17:43.446133 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 296/596] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:17:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:43.446133 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d15d9-e175-48d7-9b2c-02242492d213 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:43.446678 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-31c16dbc-1f78-4199-a65b-996fdb73d1d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 01:17:43.446678 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:43.446678 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:43.446678 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:43.446678 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:43.446678 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:43.446678 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:43.446678 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:43.446678 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:43.446678 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:43.446678 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:43.446678 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:43.446678 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 01:17:43.446678 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 01:17:43.446678 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 01:17:43.448523 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 01:17:43.448523 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:43.448523 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:43.448523 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:43.448523 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:43.448523 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:43.448523 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:43.448523 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:43.448523 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:43.448523 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:43.448523 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:43.448523 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:43.448523 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:43.448523 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:43.448523 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:43.448523 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:43.448523 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:43.450591 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 01:17:43.450591 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 01:17:43.450591 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 01:17:43.450591 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 01:17:43.450591 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 01:17:43.450591 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 01:17:43.450591 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 01:17:43.450591 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:17:43.450591 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 301/597] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 01:17:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:43.450591 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c16dbc-1f78-4199-a65b-996fdb73d1d3 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:43.492210 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:43.507826 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:43.549887 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c16dbc-1f78-4199-a65b-996fdb73d1d3 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:43.562259 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d15d9-e175-48d7-9b2c-02242492d213 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:43.583304 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f67fd-0611-4712-8bce-7f358faec7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:43.584315 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f67fd-0611-4712-8bce-7f358faec7d9 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:43.584315 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f67fd-0611-4712-8bce-7f358faec7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:43.584522 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f67fd-0611-4712-8bce-7f358faec7d9 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:43.585144 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388f67fd-0611-4712-8bce-7f358faec7d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:43.585446 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388f67fd-0611-4712-8bce-7f358faec7d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:43.586846 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388f67fd-0611-4712-8bce-7f358faec7d9 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:43.603271 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 302/598] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 01:17:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:43.603271 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f67fd-0611-4712-8bce-7f358faec7d9 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:43.603511 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edff6d6-3b1f-48f9-b5d3-68df5e5a4228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:43.603511 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edff6d6-3b1f-48f9-b5d3-68df5e5a4228 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:43.603511 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edff6d6-3b1f-48f9-b5d3-68df5e5a4228 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:43.603747 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edff6d6-3b1f-48f9-b5d3-68df5e5a4228 None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:43.604202 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edff6d6-3b1f-48f9-b5d3-68df5e5a4228 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:43.606513 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edff6d6-3b1f-48f9-b5d3-68df5e5a4228 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:43.608102 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edff6d6-3b1f-48f9-b5d3-68df5e5a4228 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:43.626401 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 297/599] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 01:17:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:43.627546 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edff6d6-3b1f-48f9-b5d3-68df5e5a4228 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:43.701332 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f67fd-0611-4712-8bce-7f358faec7d9 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:43.734194 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edff6d6-3b1f-48f9-b5d3-68df5e5a4228 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:43.735714 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f29eed-9484-45fd-acf0-c4882d2cf4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:43.736341 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f29eed-9484-45fd-acf0-c4882d2cf4dc None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:43.736630 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f29eed-9484-45fd-acf0-c4882d2cf4dc None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:43.736853 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f29eed-9484-45fd-acf0-c4882d2cf4dc None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:43.737534 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f29eed-9484-45fd-acf0-c4882d2cf4dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:43.737830 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f29eed-9484-45fd-acf0-c4882d2cf4dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:43.739380 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f29eed-9484-45fd-acf0-c4882d2cf4dc None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:43.746561 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:43.750640 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:43.751681 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 303/600] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Aug 12 01:17:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:43.754817 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f29eed-9484-45fd-acf0-c4882d2cf4dc None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:43.775848 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623f7b7b-52e3-41fa-ad13-88ae3a8cbecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:43.776863 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f7b7b-52e3-41fa-ad13-88ae3a8cbecd None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:43.777389 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f7b7b-52e3-41fa-ad13-88ae3a8cbecd None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:43.777856 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f7b7b-52e3-41fa-ad13-88ae3a8cbecd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:43.785144 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623f7b7b-52e3-41fa-ad13-88ae3a8cbecd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:43.787099 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623f7b7b-52e3-41fa-ad13-88ae3a8cbecd None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:43.799769 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-623f7b7b-52e3-41fa-ad13-88ae3a8cbecd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 01:17:43.799769 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:43.799769 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:43.799769 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:43.799769 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:43.799769 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:43.799769 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:43.799769 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:43.799769 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:43.799769 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:43.799769 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:43.799769 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:43.799769 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 01:17:43.799769 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 01:17:43.799769 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 01:17:43.800704 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 01:17:43.800704 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:43.800704 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:43.800704 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:43.800704 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:43.800704 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:43.800704 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:43.800704 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:43.800704 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:43.800704 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:43.800704 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:43.800704 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:43.800704 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:43.800704 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:43.800704 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:43.800704 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:43.800704 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:43.801593 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 01:17:43.801593 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 01:17:43.801593 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 01:17:43.801593 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 01:17:43.801593 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 01:17:43.801593 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 01:17:43.801593 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 01:17:43.801593 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:17:43.808851 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 298/601] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 01:17:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:43.809876 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623f7b7b-52e3-41fa-ad13-88ae3a8cbecd None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:43.855263 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f29eed-9484-45fd-acf0-c4882d2cf4dc None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:43.893107 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0126ce-8754-4389-a468-c38fb23f722d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:43.893660 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0126ce-8754-4389-a468-c38fb23f722d None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:43.893933 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0126ce-8754-4389-a468-c38fb23f722d None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:43.894227 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0126ce-8754-4389-a468-c38fb23f722d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:43.902022 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0126ce-8754-4389-a468-c38fb23f722d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:43.903617 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0126ce-8754-4389-a468-c38fb23f722d None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:43.915240 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623f7b7b-52e3-41fa-ad13-88ae3a8cbecd None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:43.915708 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-ef0126ce-8754-4389-a468-c38fb23f722d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 01:17:43.915708 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:43.915708 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:43.915708 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:43.915708 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:43.915708 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:43.915708 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:43.915708 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:43.915708 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:43.915708 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:43.915708 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:43.915708 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:43.915708 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 01:17:43.915708 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 01:17:43.915708 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 01:17:43.916506 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 01:17:43.916506 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:43.916506 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:43.916506 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:43.916506 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:43.916506 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:43.916506 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:43.916506 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:43.916506 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:43.916506 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:43.916506 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:43.916506 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:43.916506 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:43.916506 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:43.916506 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:43.916506 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:43.916506 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:43.918184 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 01:17:43.918184 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 01:17:43.918184 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 01:17:43.918184 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 01:17:43.918184 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 01:17:43.918184 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 01:17:43.918184 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 01:17:43.918184 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:17:43.922163 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 304/602] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 01:17:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:43.922865 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0126ce-8754-4389-a468-c38fb23f722d None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:43.946646 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:43.955938 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a3a512-77ce-4cb0-a99f-05d6853d7b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:43.957131 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3a512-77ce-4cb0-a99f-05d6853d7b85 None admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:43.957622 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3a512-77ce-4cb0-a99f-05d6853d7b85 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:43.958171 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3a512-77ce-4cb0-a99f-05d6853d7b85 None admin] PATH_INFO: `/v3/projects/fa91143910a74c6b896ced5b51f9966a/users/bd73d9b9b63a499d909fec034bf9a259/roles/90d1ca7df8de4b03a689afc664d0cc3f` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:43.974673 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a3a512-77ce-4cb0-a99f-05d6853d7b85 None admin] RBAC: Authorizing `identity:create_grant(project_id=fa91143910a74c6b896ced5b51f9966a, user_id=bd73d9b9b63a499d909fec034bf9a259, role_id=90d1ca7df8de4b03a689afc664d0cc3f)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:43.976596 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a3a512-77ce-4cb0-a99f-05d6853d7b85 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:43.993856 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 299/603] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Aug 12 01:17:43 2022] PUT /identity/v3/projects/fa91143910a74c6b896ced5b51f9966a/users/bd73d9b9b63a499d909fec034bf9a259/roles/90d1ca7df8de4b03a689afc664d0cc3f => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:17:43.995074 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a3a512-77ce-4cb0-a99f-05d6853d7b85 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:44.034270 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:44.039287 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0126ce-8754-4389-a468-c38fb23f722d None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:44.086935 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1c1e59-7e84-411f-9ffa-b7d430ae36cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:44.087899 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1c1e59-7e84-411f-9ffa-b7d430ae36cc None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:44.088356 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1c1e59-7e84-411f-9ffa-b7d430ae36cc None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:44.088789 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1c1e59-7e84-411f-9ffa-b7d430ae36cc None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:44.089701 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1c1e59-7e84-411f-9ffa-b7d430ae36cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:44.090234 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1c1e59-7e84-411f-9ffa-b7d430ae36cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:44.099143 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1c1e59-7e84-411f-9ffa-b7d430ae36cc None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:44.122334 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 305/604] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Aug 12 01:17:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:44.124181 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1c1e59-7e84-411f-9ffa-b7d430ae36cc None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:44.134241 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a3a512-77ce-4cb0-a99f-05d6853d7b85 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:44.202093 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ee4da9-0ca8-4569-a155-e54b938dfc06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:44.202918 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee4da9-0ca8-4569-a155-e54b938dfc06 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:44.203302 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee4da9-0ca8-4569-a155-e54b938dfc06 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:44.203734 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee4da9-0ca8-4569-a155-e54b938dfc06 None admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:44.204576 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ee4da9-0ca8-4569-a155-e54b938dfc06 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:44.205006 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ee4da9-0ca8-4569-a155-e54b938dfc06 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:44.206675 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ee4da9-0ca8-4569-a155-e54b938dfc06 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:44.221082 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 300/605] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Aug 12 01:17:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:44.227934 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be877c26-3d95-45b6-ad04-eac6b89a6c34 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:44.227934 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be877c26-3d95-45b6-ad04-eac6b89a6c34 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:44.228481 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be877c26-3d95-45b6-ad04-eac6b89a6c34 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:44.230078 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 301/606] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:17:44 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:17:44.230916 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be877c26-3d95-45b6-ad04-eac6b89a6c34 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:44.252837 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:44.285843 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1c1e59-7e84-411f-9ffa-b7d430ae36cc None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:44.325029 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:44.341277 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c441d35b-a272-41f8-adc7-d60d4d6eba3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:44.342514 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441d35b-a272-41f8-adc7-d60d4d6eba3b None admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:44.343372 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441d35b-a272-41f8-adc7-d60d4d6eba3b None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:44.343938 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441d35b-a272-41f8-adc7-d60d4d6eba3b None admin] PATH_INFO: `/v3/projects/fa91143910a74c6b896ced5b51f9966a/users/7853d40c29af424c8d7913950d89750b/roles/90d1ca7df8de4b03a689afc664d0cc3f` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:44.347126 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be877c26-3d95-45b6-ad04-eac6b89a6c34 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:44.361133 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c441d35b-a272-41f8-adc7-d60d4d6eba3b None admin] RBAC: Authorizing `identity:create_grant(project_id=fa91143910a74c6b896ced5b51f9966a, user_id=7853d40c29af424c8d7913950d89750b, role_id=90d1ca7df8de4b03a689afc664d0cc3f)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:44.362882 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c441d35b-a272-41f8-adc7-d60d4d6eba3b None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:44.379445 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 306/607] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Aug 12 01:17:44 2022] PUT /identity/v3/projects/fa91143910a74c6b896ced5b51f9966a/users/7853d40c29af424c8d7913950d89750b/roles/90d1ca7df8de4b03a689afc664d0cc3f => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:17:44.381094 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c8721-2ca7-439a-be44-688e40d9ddd6 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:44.381625 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c8721-2ca7-439a-be44-688e40d9ddd6 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:44.382060 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c8721-2ca7-439a-be44-688e40d9ddd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:44.405109 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-938c8721-2ca7-439a-be44-688e40d9ddd6 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:17:44.406911 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-938c8721-2ca7-439a-be44-688e40d9ddd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:17:44.410198 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a324aa-2b6f-4c1f-b67a-627f62ea03ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:44.411559 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a324aa-2b6f-4c1f-b67a-627f62ea03ba None admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:44.411559 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a324aa-2b6f-4c1f-b67a-627f62ea03ba None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:44.411828 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a324aa-2b6f-4c1f-b67a-627f62ea03ba None admin] PATH_INFO: `/v3/projects/fa91143910a74c6b896ced5b51f9966a/users/a80678458dc9405285b70da707a399c2/roles/90d1ca7df8de4b03a689afc664d0cc3f` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:44.444288 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a324aa-2b6f-4c1f-b67a-627f62ea03ba None admin] RBAC: Authorizing `identity:create_grant(project_id=fa91143910a74c6b896ced5b51f9966a, user_id=a80678458dc9405285b70da707a399c2, role_id=90d1ca7df8de4b03a689afc664d0cc3f)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:44.445866 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a324aa-2b6f-4c1f-b67a-627f62ea03ba None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:44.469054 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 302/608] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Aug 12 01:17:44 2022] PUT /identity/v3/projects/fa91143910a74c6b896ced5b51f9966a/users/a80678458dc9405285b70da707a399c2/roles/90d1ca7df8de4b03a689afc664d0cc3f => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:17:44.519331 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 307/609] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:17:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 01:17:44.842707 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a324aa-2b6f-4c1f-b67a-627f62ea03ba None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:44.945794 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a324aa-2b6f-4c1f-b67a-627f62ea03ba None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:44.979307 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:44.982312 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022b0f0e-8be9-41b3-953f-5bdec7aa60fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:44.983269 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b0f0e-8be9-41b3-953f-5bdec7aa60fb None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:44.983439 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b0f0e-8be9-41b3-953f-5bdec7aa60fb None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:44.983664 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b0f0e-8be9-41b3-953f-5bdec7aa60fb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:44.995693 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022b0f0e-8be9-41b3-953f-5bdec7aa60fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:17:45.000618 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-022b0f0e-8be9-41b3-953f-5bdec7aa60fb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 01:17:45.000618 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:45.000618 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:45.000618 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:45.000618 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:45.000618 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:45.000618 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:45.000618 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:45.000618 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:45.000618 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:45.000618 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:45.000618 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:45.000618 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:17:45.000618 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:17:45.000618 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:17:45.000618 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:17:45.001743 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:17:45.001743 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:17:45.001743 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:17:45.001743 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:17:45.001743 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:45.001743 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:45.001743 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:45.001743 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:45.001743 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:45.001743 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:45.001743 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:45.001743 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:45.001743 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:45.001743 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:45.001743 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:45.001743 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:45.002651 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:45.002651 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:45.002651 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:45.002651 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:45.002651 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:17:45.002651 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:17:45.002651 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:17:45.002651 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:17:45.002651 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:17:45.002651 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:17:45.002651 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 01:17:45.002651 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:17:45.006241 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 303/610] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Aug 12 01:17:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:45.008418 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938c8721-2ca7-439a-be44-688e40d9ddd6 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:45.085473 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:45.121541 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9457b-ee80-461f-8e48-3fcf1e23e2b1 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:45.121734 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9457b-ee80-461f-8e48-3fcf1e23e2b1 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:45.121989 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9457b-ee80-461f-8e48-3fcf1e23e2b1 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:45.123370 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 304/611] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:17:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:17:45.131337 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174b1a9-5f40-4352-9d56-0f9f7c92f393 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:45.131622 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174b1a9-5f40-4352-9d56-0f9f7c92f393 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:45.131901 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174b1a9-5f40-4352-9d56-0f9f7c92f393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:45.144557 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938c8721-2ca7-439a-be44-688e40d9ddd6 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:45.175194 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-8174b1a9-5f40-4352-9d56-0f9f7c92f393 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:17:45.176395 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-8174b1a9-5f40-4352-9d56-0f9f7c92f393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:17:45.185693 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a52d192-9182-4ff3-a629-eb9b93fbf5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:45.186650 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52d192-9182-4ff3-a629-eb9b93fbf5d2 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:45.187131 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52d192-9182-4ff3-a629-eb9b93fbf5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:45.187587 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52d192-9182-4ff3-a629-eb9b93fbf5d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:45.188443 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a52d192-9182-4ff3-a629-eb9b93fbf5d2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:45.188930 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a52d192-9182-4ff3-a629-eb9b93fbf5d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:45.190589 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a52d192-9182-4ff3-a629-eb9b93fbf5d2 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:45.205207 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 308/612] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Aug 12 01:17:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:17:45.207626 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a52d192-9182-4ff3-a629-eb9b93fbf5d2 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:45.322968 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 305/613] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:17:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 01:17:45.363992 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a52d192-9182-4ff3-a629-eb9b93fbf5d2 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:45.398975 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:45.417642 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d396fa1b-8513-44ec-8c23-d631e1be1677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:45.418302 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d396fa1b-8513-44ec-8c23-d631e1be1677 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:45.418569 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d396fa1b-8513-44ec-8c23-d631e1be1677 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:45.418837 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d396fa1b-8513-44ec-8c23-d631e1be1677 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:45.433616 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d396fa1b-8513-44ec-8c23-d631e1be1677 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:45.435091 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d396fa1b-8513-44ec-8c23-d631e1be1677 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:45.457706 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-d396fa1b-8513-44ec-8c23-d631e1be1677 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:45.457706 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:45.457706 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:45.457706 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:45.457706 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:45.457706 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:45.457706 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:45.457706 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:45.457706 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:45.457706 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:45.457706 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:45.457706 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:45.457706 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 01:17:45.457706 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 01:17:45.457706 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 01:17:45.457706 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 01:17:45.458818 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:45.458818 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:45.458818 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:45.458818 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:45.458818 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:45.458818 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:45.458818 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:45.458818 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:45.458818 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:45.458818 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:45.458818 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:45.458818 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:45.458818 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:45.458818 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:45.458818 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:45.458818 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:45.458818 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 01:17:45.459696 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 01:17:45.459696 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:45.459696 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:17:45.459696 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 309/614] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:17:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:45.464956 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8174b1a9-5f40-4352-9d56-0f9f7c92f393 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:45.594804 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8174b1a9-5f40-4352-9d56-0f9f7c92f393 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:45.617651 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:45.628973 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4467e6-0415-439c-b4e8-20527d0b874d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:45.629584 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4467e6-0415-439c-b4e8-20527d0b874d None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:45.629954 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4467e6-0415-439c-b4e8-20527d0b874d None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:45.630262 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4467e6-0415-439c-b4e8-20527d0b874d None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:45.630902 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4467e6-0415-439c-b4e8-20527d0b874d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:45.631398 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4467e6-0415-439c-b4e8-20527d0b874d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:45.632931 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4467e6-0415-439c-b4e8-20527d0b874d None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:45.645904 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 306/615] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 01:17:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:45.651599 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d396fa1b-8513-44ec-8c23-d631e1be1677 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:45.774060 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d396fa1b-8513-44ec-8c23-d631e1be1677 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:45.815559 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac7f49-2413-460f-94c3-9b099afc79ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:45.816198 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac7f49-2413-460f-94c3-9b099afc79ce None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:45.816467 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac7f49-2413-460f-94c3-9b099afc79ce None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:45.816729 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac7f49-2413-460f-94c3-9b099afc79ce None admin] PATH_INFO: `/v3/users/swift` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:45.828418 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ac7f49-2413-460f-94c3-9b099afc79ce None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:45.829875 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ac7f49-2413-460f-94c3-9b099afc79ce None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:45.844374 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-65ac7f49-2413-460f-94c3-9b099afc79ce None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 12 01:17:45.844374 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:45.844374 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:45.844374 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:45.844374 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:45.844374 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:45.844374 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:45.844374 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:45.844374 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:45.844374 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:45.844374 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:45.844374 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:45.844374 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 01:17:45.844374 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 01:17:45.844374 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 01:17:45.844374 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 01:17:45.845403 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:45.845403 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:45.845403 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 01:17:45.845403 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 01:17:45.845403 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 01:17:45.845403 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 01:17:45.845403 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:45.845403 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:45.845403 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:45.845403 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:45.845403 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:45.845403 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:45.845403 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:45.845403 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:45.845403 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:45.845403 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:45.845403 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:45.845403 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:45.846368 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:45.846368 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:45.846368 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 01:17:45.846368 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 01:17:45.846368 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 01:17:45.846368 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 01:17:45.846368 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 01:17:45.846368 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 01:17:45.846368 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 12 01:17:45.846368 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:17:45.846368 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 310/616] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Aug 12 01:17:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:45.851540 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4467e6-0415-439c-b4e8-20527d0b874d None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:45.958872 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4467e6-0415-439c-b4e8-20527d0b874d None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:45.964063 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac7f49-2413-460f-94c3-9b099afc79ce None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:45.994763 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7c9dc3-6fab-406b-a876-e40f264edb97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:45.995385 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c9dc3-6fab-406b-a876-e40f264edb97 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:45.995652 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c9dc3-6fab-406b-a876-e40f264edb97 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:45.995921 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c9dc3-6fab-406b-a876-e40f264edb97 None admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:45.996641 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7c9dc3-6fab-406b-a876-e40f264edb97 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:45.996938 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7c9dc3-6fab-406b-a876-e40f264edb97 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:45.998376 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7c9dc3-6fab-406b-a876-e40f264edb97 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:46.021241 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 307/617] 10.222.0.26 () {56 vars in 1135 bytes} [Fri Aug 12 01:17:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:46.022666 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7c9dc3-6fab-406b-a876-e40f264edb97 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:46.056337 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:46.066478 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:46.142874 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac7f49-2413-460f-94c3-9b099afc79ce None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:46.165265 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7c9dc3-6fab-406b-a876-e40f264edb97 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:46.178132 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60213efd-e465-455e-b9d6-e3ba6f668044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:46.178791 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60213efd-e465-455e-b9d6-e3ba6f668044 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:46.179076 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60213efd-e465-455e-b9d6-e3ba6f668044 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:46.179352 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60213efd-e465-455e-b9d6-e3ba6f668044 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:46.191246 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60213efd-e465-455e-b9d6-e3ba6f668044 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:17:46.203127 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-60213efd-e465-455e-b9d6-e3ba6f668044 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 01:17:46.203127 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:46.203127 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:46.203127 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:46.203127 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:46.203127 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:46.203127 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:46.203127 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:46.203127 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:46.203127 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:46.203127 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:46.203127 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:46.203127 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:17:46.203127 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:17:46.203127 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:17:46.203127 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:17:46.204096 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:17:46.204096 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:17:46.204096 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:17:46.204096 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:17:46.204096 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:46.204096 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:46.204096 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:46.204096 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:46.204096 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:46.204096 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:46.204096 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:46.204096 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:46.204096 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:46.204096 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:46.204096 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:46.204096 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:46.204944 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:46.204944 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:46.204944 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:46.204944 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:46.204944 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:17:46.204944 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:17:46.204944 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:17:46.204944 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:17:46.204944 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:17:46.204944 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:17:46.204944 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 01:17:46.204944 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:17:46.207046 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 311/618] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Aug 12 01:17:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:46.208257 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0660af12-4f18-47a9-9736-8799f3fb3fcd None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:46.208556 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0660af12-4f18-47a9-9736-8799f3fb3fcd None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:46.208810 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0660af12-4f18-47a9-9736-8799f3fb3fcd None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:46.210089 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 312/619] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:17:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:17:46.214874 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0660af12-4f18-47a9-9736-8799f3fb3fcd None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:46.230001 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce460d9-7c2e-40a1-8455-6e91531c213d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:46.230688 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce460d9-7c2e-40a1-8455-6e91531c213d None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:46.230961 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce460d9-7c2e-40a1-8455-6e91531c213d None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:46.231231 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce460d9-7c2e-40a1-8455-6e91531c213d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:46.243407 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce460d9-7c2e-40a1-8455-6e91531c213d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:46.245032 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce460d9-7c2e-40a1-8455-6e91531c213d None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:46.261303 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-4ce460d9-7c2e-40a1-8455-6e91531c213d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:46.261303 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:46.261303 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:46.261303 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:46.261303 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:46.261303 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:46.261303 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:46.261303 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:46.261303 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:46.261303 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:46.261303 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:46.261303 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:46.261303 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 01:17:46.261303 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 01:17:46.261303 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 01:17:46.261303 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 01:17:46.263515 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:46.263515 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:46.263515 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:46.263515 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:46.263515 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:46.263515 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:46.263515 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:46.263515 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:46.263515 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:46.263515 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:46.263515 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:46.263515 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:46.263515 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:46.263515 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:46.263515 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:46.263515 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:46.263515 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 01:17:46.265725 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 01:17:46.265725 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:46.265725 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:17:46.268956 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 308/620] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:17:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:46.268956 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d439b0-150f-42e6-85af-92df12a93b50 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:46.269314 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d439b0-150f-42e6-85af-92df12a93b50 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:46.269464 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d439b0-150f-42e6-85af-92df12a93b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:46.290749 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-c6d439b0-150f-42e6-85af-92df12a93b50 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:17:46.292268 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-c6d439b0-150f-42e6-85af-92df12a93b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:17:46.319254 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:46.327267 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0660af12-4f18-47a9-9736-8799f3fb3fcd None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:46.372036 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ca95d1-75cc-44ea-b06b-196777bbe1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:46.372929 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca95d1-75cc-44ea-b06b-196777bbe1c9 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:46.373209 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca95d1-75cc-44ea-b06b-196777bbe1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:46.373480 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca95d1-75cc-44ea-b06b-196777bbe1c9 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:46.374198 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ca95d1-75cc-44ea-b06b-196777bbe1c9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:46.374502 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ca95d1-75cc-44ea-b06b-196777bbe1c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:46.375969 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ca95d1-75cc-44ea-b06b-196777bbe1c9 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:46.376842 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 309/621] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:17:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 01:17:46.377751 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d439b0-150f-42e6-85af-92df12a93b50 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:46.397161 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 313/622] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Aug 12 01:17:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:17:46.404403 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ca95d1-75cc-44ea-b06b-196777bbe1c9 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:46.428445 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:46.579299 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d439b0-150f-42e6-85af-92df12a93b50 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:46.591416 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ca95d1-75cc-44ea-b06b-196777bbe1c9 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:46.645154 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9469b7d-15a5-4a41-8092-f2db238d0266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:46.646360 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9469b7d-15a5-4a41-8092-f2db238d0266 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:46.646360 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9469b7d-15a5-4a41-8092-f2db238d0266 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:46.647180 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9469b7d-15a5-4a41-8092-f2db238d0266 None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:46.647180 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9469b7d-15a5-4a41-8092-f2db238d0266 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:46.647515 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9469b7d-15a5-4a41-8092-f2db238d0266 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:46.648825 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9469b7d-15a5-4a41-8092-f2db238d0266 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:46.655735 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b097e7-ba13-4b2d-b257-d4be59a81f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:46.656375 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b097e7-ba13-4b2d-b257-d4be59a81f9c None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:46.656649 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b097e7-ba13-4b2d-b257-d4be59a81f9c None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:46.656916 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b097e7-ba13-4b2d-b257-d4be59a81f9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:46.676517 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 310/623] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 01:17:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:46.677673 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b097e7-ba13-4b2d-b257-d4be59a81f9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:46.679175 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b097e7-ba13-4b2d-b257-d4be59a81f9c None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:46.683362 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9469b7d-15a5-4a41-8092-f2db238d0266 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:46.706393 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-c2b097e7-ba13-4b2d-b257-d4be59a81f9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:46.706393 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:46.706393 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:46.706393 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:46.706393 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:46.706393 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:46.706393 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:46.706393 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:46.706393 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:46.706393 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:46.706393 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:46.706393 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:46.706393 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 01:17:46.706393 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 01:17:46.706393 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 01:17:46.706393 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 01:17:46.707387 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:46.707387 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:46.707387 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:46.707387 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:46.707387 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:46.707387 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:46.707387 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:46.707387 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:46.707387 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:46.707387 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:46.707387 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:46.707387 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:46.707387 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:46.707387 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:46.707387 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:46.707387 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:46.707387 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 01:17:46.709601 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 01:17:46.709601 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:46.709601 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:17:46.709601 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 314/624] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:17:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:46.716912 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b097e7-ba13-4b2d-b257-d4be59a81f9c None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:46.747571 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:46.804636 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:46.825892 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9469b7d-15a5-4a41-8092-f2db238d0266 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:46.833556 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b097e7-ba13-4b2d-b257-d4be59a81f9c None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:46.858293 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b76709-4a60-43c3-95ca-1499a3730f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:46.858914 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b76709-4a60-43c3-95ca-1499a3730f34 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:46.859185 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b76709-4a60-43c3-95ca-1499a3730f34 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:46.859444 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b76709-4a60-43c3-95ca-1499a3730f34 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:46.865991 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b76709-4a60-43c3-95ca-1499a3730f34 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:46.866803 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9ce932-33e2-4e99-aabf-5c80064cd083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:46.867405 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ce932-33e2-4e99-aabf-5c80064cd083 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:46.867501 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b76709-4a60-43c3-95ca-1499a3730f34 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:46.867679 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ce932-33e2-4e99-aabf-5c80064cd083 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:46.867945 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ce932-33e2-4e99-aabf-5c80064cd083 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:46.868582 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9ce932-33e2-4e99-aabf-5c80064cd083 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:46.868887 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9ce932-33e2-4e99-aabf-5c80064cd083 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:46.870273 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9ce932-33e2-4e99-aabf-5c80064cd083 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:46.878306 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-a2b76709-4a60-43c3-95ca-1499a3730f34 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 01:17:46.878306 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:46.878306 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:46.878306 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:46.878306 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:46.878306 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:46.878306 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:46.878306 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:46.878306 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:46.878306 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:46.878306 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:46.878306 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:46.878306 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 01:17:46.878306 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 01:17:46.878306 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 01:17:46.879186 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 01:17:46.879186 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:46.879186 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:46.879186 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:46.879186 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:46.879186 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:46.879186 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:46.879186 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:46.879186 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:46.879186 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:46.879186 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:46.879186 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:46.879186 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:46.879186 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:46.879186 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:46.879186 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:46.879186 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:46.880277 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 01:17:46.880277 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 01:17:46.880277 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 01:17:46.880277 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 01:17:46.880277 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 01:17:46.880277 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 01:17:46.880277 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 01:17:46.880277 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:17:46.880277 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 311/625] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 01:17:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 01:17:46.880949 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b76709-4a60-43c3-95ca-1499a3730f34 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:46.883810 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 315/626] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 01:17:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:17:46.887529 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8d486-c04e-4e7f-9b37-7ec03317597e None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:46.887772 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8d486-c04e-4e7f-9b37-7ec03317597e None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:46.888208 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8d486-c04e-4e7f-9b37-7ec03317597e None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:46.889671 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 316/627] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:17:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:17:46.890755 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d0f13a-924c-4242-8a95-a0ca09263848 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:46.890994 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d0f13a-924c-4242-8a95-a0ca09263848 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:46.891290 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d0f13a-924c-4242-8a95-a0ca09263848 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:46.897173 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 317/628] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:17:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:17:46.897173 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d0f13a-924c-4242-8a95-a0ca09263848 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:46.961876 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:46.981528 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b76709-4a60-43c3-95ca-1499a3730f34 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:46.997711 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d0f13a-924c-4242-8a95-a0ca09263848 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:47.015255 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f967eb-679c-4420-8b38-7954393eca0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:47.015880 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f967eb-679c-4420-8b38-7954393eca0d None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:47.016154 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f967eb-679c-4420-8b38-7954393eca0d None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:47.016420 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f967eb-679c-4420-8b38-7954393eca0d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:47.026754 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f967eb-679c-4420-8b38-7954393eca0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:17:47.031725 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb35a55-0beb-4c1a-a369-e7fcaf11396f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:47.031856 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-22f967eb-679c-4420-8b38-7954393eca0d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 01:17:47.031856 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:47.031856 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:47.031856 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:47.031856 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:47.031856 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:47.031856 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:47.031856 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:47.031856 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:47.031856 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:47.031856 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:47.031856 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:47.031856 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:17:47.031856 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:17:47.031856 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:17:47.031856 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:17:47.032861 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:17:47.032861 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:17:47.032861 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:17:47.032861 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:17:47.032861 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:47.032861 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:47.032861 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:47.032861 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:47.032861 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:47.032861 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:47.032861 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:47.032861 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:47.032861 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:47.032861 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:47.032861 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:47.032861 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:47.033706 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:47.033706 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:47.033706 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:47.033706 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:47.033706 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:17:47.033706 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:17:47.033706 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:17:47.033706 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:17:47.033706 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:17:47.033706 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:17:47.033706 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 01:17:47.033706 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:17:47.034497 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb35a55-0beb-4c1a-a369-e7fcaf11396f None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:47.034497 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb35a55-0beb-4c1a-a369-e7fcaf11396f None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:47.034497 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb35a55-0beb-4c1a-a369-e7fcaf11396f None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:47.034688 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 312/629] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Aug 12 01:17:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:47.034760 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb35a55-0beb-4c1a-a369-e7fcaf11396f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:47.034829 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f967eb-679c-4420-8b38-7954393eca0d None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:47.034907 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb35a55-0beb-4c1a-a369-e7fcaf11396f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:47.035602 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb35a55-0beb-4c1a-a369-e7fcaf11396f None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:47.037563 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:47.047554 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 318/630] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Aug 12 01:17:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:47.048766 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a4784-a3b6-48bb-a163-de1007d3afac None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:47.049036 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a4784-a3b6-48bb-a163-de1007d3afac None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:47.049320 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a4784-a3b6-48bb-a163-de1007d3afac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:47.066631 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-f93a4784-a3b6-48bb-a163-de1007d3afac None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:17:47.067859 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f93a4784-a3b6-48bb-a163-de1007d3afac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:17:47.132840 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 319/631] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:17:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 01:17:47.134063 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f25b31-012b-4be4-9c81-a4bf7a1f99d4 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:47.134392 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f25b31-012b-4be4-9c81-a4bf7a1f99d4 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:47.134662 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f25b31-012b-4be4-9c81-a4bf7a1f99d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:47.149717 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f967eb-679c-4420-8b38-7954393eca0d None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:47.151711 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-a7f25b31-012b-4be4-9c81-a4bf7a1f99d4 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:17:47.152877 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-a7f25b31-012b-4be4-9c81-a4bf7a1f99d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:17:47.186787 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b57d39-38e9-40a7-bd20-21af29e3ad3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:47.187464 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b57d39-38e9-40a7-bd20-21af29e3ad3f None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:47.187739 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b57d39-38e9-40a7-bd20-21af29e3ad3f None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:47.188005 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b57d39-38e9-40a7-bd20-21af29e3ad3f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:47.196350 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b57d39-38e9-40a7-bd20-21af29e3ad3f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:47.198041 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b57d39-38e9-40a7-bd20-21af29e3ad3f None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:47.207543 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:47.210272 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-c1b57d39-38e9-40a7-bd20-21af29e3ad3f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 12 01:17:47.210272 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:47.210272 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:47.210272 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:47.210272 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:47.210272 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:47.210272 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:47.210272 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:47.210272 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:47.210272 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:47.210272 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:47.210272 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:47.210272 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 01:17:47.210272 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 01:17:47.210272 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 01:17:47.210272 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 01:17:47.211491 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:47.211491 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:47.211491 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 01:17:47.211491 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 01:17:47.211491 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 01:17:47.211491 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 01:17:47.211491 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:47.211491 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:47.211491 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:47.211491 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:47.211491 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:47.211491 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:47.211491 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:47.211491 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:47.211491 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:47.211491 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:47.211491 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:47.211491 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:47.212415 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:47.212415 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:47.212415 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 01:17:47.212415 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 01:17:47.212415 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 01:17:47.212415 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 01:17:47.212415 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 01:17:47.212415 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 01:17:47.212415 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 12 01:17:47.212415 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:17:47.216134 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 313/632] 10.222.0.26 () {56 vars in 1093 bytes} [Fri Aug 12 01:17:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:47.216951 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b57d39-38e9-40a7-bd20-21af29e3ad3f None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:47.234292 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 320/633] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:17:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 01:17:47.234292 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f25b31-012b-4be4-9c81-a4bf7a1f99d4 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:47.290223 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:47.337328 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f25b31-012b-4be4-9c81-a4bf7a1f99d4 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:47.337622 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b57d39-38e9-40a7-bd20-21af29e3ad3f None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:47.373785 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43298297-86f1-4127-a57b-614df8be5754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:47.375114 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43298297-86f1-4127-a57b-614df8be5754 None admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:47.375393 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43298297-86f1-4127-a57b-614df8be5754 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:47.375663 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43298297-86f1-4127-a57b-614df8be5754 None admin] PATH_INFO: `/v3/projects/fa91143910a74c6b896ced5b51f9966a/users/32c1ba237f864b5d9699cb817e42e647/roles/90d1ca7df8de4b03a689afc664d0cc3f` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:47.380551 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec5b87-fa54-42ca-8758-e020d4e01266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:47.381262 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec5b87-fa54-42ca-8758-e020d4e01266 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:47.381606 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec5b87-fa54-42ca-8758-e020d4e01266 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:47.381946 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec5b87-fa54-42ca-8758-e020d4e01266 None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:47.382705 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ec5b87-fa54-42ca-8758-e020d4e01266 None admin] RBAC: Adding query filter params (name=service) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:47.383118 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ec5b87-fa54-42ca-8758-e020d4e01266 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:47.385063 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ec5b87-fa54-42ca-8758-e020d4e01266 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:47.390940 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43298297-86f1-4127-a57b-614df8be5754 None admin] RBAC: Authorizing `identity:create_grant(project_id=fa91143910a74c6b896ced5b51f9966a, user_id=32c1ba237f864b5d9699cb817e42e647, role_id=90d1ca7df8de4b03a689afc664d0cc3f)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:47.392879 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43298297-86f1-4127-a57b-614df8be5754 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:47.395597 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 314/634] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Aug 12 01:17:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:47.397280 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec5b87-fa54-42ca-8758-e020d4e01266 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:47.411460 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 321/635] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Aug 12 01:17:47 2022] PUT /identity/v3/projects/fa91143910a74c6b896ced5b51f9966a/users/32c1ba237f864b5d9699cb817e42e647/roles/90d1ca7df8de4b03a689afc664d0cc3f => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:17:47.412373 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43298297-86f1-4127-a57b-614df8be5754 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:47.464508 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:47.538359 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec5b87-fa54-42ca-8758-e020d4e01266 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:47.541296 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43298297-86f1-4127-a57b-614df8be5754 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:47.565949 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:47.580100 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec8b146-7b12-492f-b235-660783f53177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:47.580463 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec8b146-7b12-492f-b235-660783f53177 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:47.580731 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec8b146-7b12-492f-b235-660783f53177 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:47.580999 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec8b146-7b12-492f-b235-660783f53177 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:47.582712 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a1590-0320-4c4b-900b-4957d353eeb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:47.583684 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a1590-0320-4c4b-900b-4957d353eeb2 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:47.583962 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a1590-0320-4c4b-900b-4957d353eeb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:47.584423 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a1590-0320-4c4b-900b-4957d353eeb2 None admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:47.585550 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1a1590-0320-4c4b-900b-4957d353eeb2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:47.585859 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1a1590-0320-4c4b-900b-4957d353eeb2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:47.587351 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1a1590-0320-4c4b-900b-4957d353eeb2 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:47.595563 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec8b146-7b12-492f-b235-660783f53177 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:47.597182 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec8b146-7b12-492f-b235-660783f53177 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:47.609952 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 315/636] 10.222.0.26 () {56 vars in 1133 bytes} [Fri Aug 12 01:17:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:47.610837 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a1590-0320-4c4b-900b-4957d353eeb2 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:47.613646 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-fec8b146-7b12-492f-b235-660783f53177 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:47.613646 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:47.613646 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:47.613646 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:47.613646 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:47.613646 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:47.613646 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:47.613646 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:47.613646 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:47.613646 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:47.613646 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:47.613646 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:47.613646 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 01:17:47.613646 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 01:17:47.613646 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 01:17:47.613646 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 01:17:47.614782 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:47.614782 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:47.614782 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:47.614782 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:47.614782 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:47.614782 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:47.614782 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:47.614782 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:47.614782 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:47.614782 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:47.614782 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:47.614782 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:47.614782 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:47.614782 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:47.614782 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:47.614782 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:47.614782 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 01:17:47.615652 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 01:17:47.615652 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:47.615652 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:17:47.617773 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 322/637] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:17:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:47.618830 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec8b146-7b12-492f-b235-660783f53177 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:47.712317 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:47.716525 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a1590-0320-4c4b-900b-4957d353eeb2 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:47.723007 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec8b146-7b12-492f-b235-660783f53177 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:47.751915 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5e1a25-751b-48de-b805-629e8f741f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:47.752547 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e1a25-751b-48de-b805-629e8f741f35 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:47.752813 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e1a25-751b-48de-b805-629e8f741f35 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:47.753100 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e1a25-751b-48de-b805-629e8f741f35 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:47.758725 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60307ca9-73c6-47cb-9f39-9b8a6c09425c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:47.759360 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60307ca9-73c6-47cb-9f39-9b8a6c09425c None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:47.759640 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60307ca9-73c6-47cb-9f39-9b8a6c09425c None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:47.759908 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60307ca9-73c6-47cb-9f39-9b8a6c09425c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:47.763834 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5e1a25-751b-48de-b805-629e8f741f35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:17:47.768612 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-fc5e1a25-751b-48de-b805-629e8f741f35 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 01:17:47.768612 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:47.768612 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:47.768612 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:47.768612 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:47.768612 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:47.768612 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:47.768612 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:47.768612 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:47.768612 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:47.768612 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:47.768612 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:47.768612 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:17:47.768612 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:17:47.768612 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:17:47.768612 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:17:47.769519 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:17:47.769519 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:17:47.769519 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:17:47.769519 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:17:47.769519 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:47.769519 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:47.769519 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:47.769519 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:47.769519 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:47.769519 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:47.769519 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:47.769519 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:47.769519 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:47.769519 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:47.769519 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:47.769519 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:47.770519 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:47.770519 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:47.770519 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:47.770519 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:47.770519 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:17:47.770519 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:17:47.770519 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:17:47.770519 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:17:47.770519 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:17:47.770519 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:17:47.770519 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 01:17:47.770519 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:17:47.770519 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 316/638] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Aug 12 01:17:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:47.771242 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5e1a25-751b-48de-b805-629e8f741f35 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:47.775894 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60307ca9-73c6-47cb-9f39-9b8a6c09425c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:17:47.781118 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-60307ca9-73c6-47cb-9f39-9b8a6c09425c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 01:17:47.781118 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:47.781118 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:47.781118 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:47.781118 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:47.781118 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:47.781118 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:47.781118 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:47.781118 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:47.781118 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:47.781118 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:47.781118 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:47.781118 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:17:47.781118 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:17:47.781118 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:17:47.781118 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:17:47.781997 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:17:47.781997 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:17:47.781997 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:17:47.781997 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:17:47.781997 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:47.781997 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:47.781997 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:47.781997 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:47.781997 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:47.781997 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:47.781997 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:47.781997 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:47.781997 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:47.781997 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:47.781997 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:47.781997 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:47.782925 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:47.782925 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:47.782925 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:47.782925 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:47.782925 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:17:47.782925 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:17:47.782925 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:17:47.782925 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:17:47.782925 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:17:47.782925 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:17:47.782925 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 01:17:47.782925 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:17:47.782925 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 323/639] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Aug 12 01:17:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:47.784869 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60307ca9-73c6-47cb-9f39-9b8a6c09425c None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:47.820783 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:47.883057 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5e1a25-751b-48de-b805-629e8f741f35 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:47.886405 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60307ca9-73c6-47cb-9f39-9b8a6c09425c None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:47.918200 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea66f619-2b62-4fb5-9804-23969379cc71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:47.918806 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea66f619-2b62-4fb5-9804-23969379cc71 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:47.919081 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea66f619-2b62-4fb5-9804-23969379cc71 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:47.919352 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea66f619-2b62-4fb5-9804-23969379cc71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:47.923633 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857cbb57-9307-4c88-a459-a6f636838714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:47.924241 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857cbb57-9307-4c88-a459-a6f636838714 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:47.924518 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857cbb57-9307-4c88-a459-a6f636838714 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:47.924789 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857cbb57-9307-4c88-a459-a6f636838714 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:47.925431 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857cbb57-9307-4c88-a459-a6f636838714 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:47.925729 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857cbb57-9307-4c88-a459-a6f636838714 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:47.927355 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857cbb57-9307-4c88-a459-a6f636838714 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:47.944851 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 324/640] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 01:17:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:47.945479 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857cbb57-9307-4c88-a459-a6f636838714 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:47.957918 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:47.988854 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea66f619-2b62-4fb5-9804-23969379cc71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:47.990391 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea66f619-2b62-4fb5-9804-23969379cc71 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:48.033720 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:48.051759 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857cbb57-9307-4c88-a459-a6f636838714 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:48.087892 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a829d290-ab41-4d79-8663-33db2d3fd170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:48.088511 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a829d290-ab41-4d79-8663-33db2d3fd170 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:48.088684 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a829d290-ab41-4d79-8663-33db2d3fd170 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:48.088953 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a829d290-ab41-4d79-8663-33db2d3fd170 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:48.089620 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a829d290-ab41-4d79-8663-33db2d3fd170 None admin] RBAC: Adding query filter params (name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:48.089922 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a829d290-ab41-4d79-8663-33db2d3fd170 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:48.091324 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a829d290-ab41-4d79-8663-33db2d3fd170 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:48.099793 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 317/641] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 01:17:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 01:17:48.099793 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea66f619-2b62-4fb5-9804-23969379cc71 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:48.104505 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 325/642] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Aug 12 01:17:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:48.109280 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a829d290-ab41-4d79-8663-33db2d3fd170 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:48.181996 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:48.207815 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea66f619-2b62-4fb5-9804-23969379cc71 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:48.212084 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a829d290-ab41-4d79-8663-33db2d3fd170 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:48.242449 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5653a393-b70a-4771-b957-983dba9e90f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:48.243052 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5653a393-b70a-4771-b957-983dba9e90f4 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:48.243328 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5653a393-b70a-4771-b957-983dba9e90f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:48.243596 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5653a393-b70a-4771-b957-983dba9e90f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:48.244252 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5653a393-b70a-4771-b957-983dba9e90f4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:48.244550 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5653a393-b70a-4771-b957-983dba9e90f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:48.245922 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5653a393-b70a-4771-b957-983dba9e90f4 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:48.246883 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b197a8a-6af2-41aa-87b4-3b432de50b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:48.247512 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b197a8a-6af2-41aa-87b4-3b432de50b7b None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:48.247790 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b197a8a-6af2-41aa-87b4-3b432de50b7b None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:48.248109 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b197a8a-6af2-41aa-87b4-3b432de50b7b None admin] PATH_INFO: `/v3/users/glance` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:48.254167 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 318/643] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Aug 12 01:17:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:48.255243 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5653a393-b70a-4771-b957-983dba9e90f4 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:48.257210 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b197a8a-6af2-41aa-87b4-3b432de50b7b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:48.258706 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b197a8a-6af2-41aa-87b4-3b432de50b7b None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:48.262395 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:48.272469 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-9b197a8a-6af2-41aa-87b4-3b432de50b7b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 12 01:17:48.272469 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:48.272469 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:48.272469 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:48.272469 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:48.272469 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:48.272469 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:48.272469 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:48.272469 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:48.272469 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:48.272469 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:48.272469 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:48.272469 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 01:17:48.272469 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 01:17:48.272469 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 01:17:48.272469 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 01:17:48.273703 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:48.273703 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:48.273703 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 01:17:48.273703 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 01:17:48.273703 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 01:17:48.273703 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 01:17:48.273703 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:48.273703 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:48.273703 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:48.273703 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:48.273703 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:48.273703 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:48.273703 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:48.273703 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:48.273703 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:48.273703 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:48.273703 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:48.273703 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:48.274827 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:48.274827 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:48.274827 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 01:17:48.274827 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 01:17:48.274827 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 01:17:48.274827 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 01:17:48.274827 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 01:17:48.274827 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 01:17:48.274827 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 12 01:17:48.274827 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:17:48.274827 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 326/644] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 01:17:48 2022] GET /identity/v3/users/glance => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:48.274827 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b197a8a-6af2-41aa-87b4-3b432de50b7b None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:48.367539 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5653a393-b70a-4771-b957-983dba9e90f4 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:48.382751 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b197a8a-6af2-41aa-87b4-3b432de50b7b None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:48.402842 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd8384-cd5d-4323-a575-643aa6d1add0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:48.403477 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd8384-cd5d-4323-a575-643aa6d1add0 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:48.403750 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd8384-cd5d-4323-a575-643aa6d1add0 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:48.404016 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd8384-cd5d-4323-a575-643aa6d1add0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:48.413922 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:48.415855 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edd8384-cd5d-4323-a575-643aa6d1add0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:48.417910 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edd8384-cd5d-4323-a575-643aa6d1add0 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:48.419715 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9339d4-366e-42b0-9306-1cc803332d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:48.421019 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9339d4-366e-42b0-9306-1cc803332d64 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:48.421305 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9339d4-366e-42b0-9306-1cc803332d64 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:48.421575 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9339d4-366e-42b0-9306-1cc803332d64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:48.432687 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-6edd8384-cd5d-4323-a575-643aa6d1add0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:48.432687 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:48.432687 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:48.432687 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:48.432687 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:48.432687 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:48.432687 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:48.432687 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:48.432687 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:48.432687 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:48.432687 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:48.432687 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:48.432687 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 01:17:48.432687 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 01:17:48.432687 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 01:17:48.432687 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 01:17:48.433704 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:48.433704 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:48.433704 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:48.433704 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:48.433704 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:48.433704 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:48.433704 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:48.433704 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:48.433704 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:48.433704 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:48.433704 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:48.433704 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:48.433704 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:48.433704 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:48.433704 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:48.433704 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:48.433704 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 01:17:48.434802 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 01:17:48.434802 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:48.434802 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:17:48.434802 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 319/645] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:17:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:48.434802 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd8384-cd5d-4323-a575-643aa6d1add0 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:48.439565 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9339d4-366e-42b0-9306-1cc803332d64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:48.441121 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9339d4-366e-42b0-9306-1cc803332d64 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:48.456677 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-ba9339d4-366e-42b0-9306-1cc803332d64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:48.456677 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:48.456677 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:48.456677 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:48.456677 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:48.456677 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:48.456677 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:48.456677 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:48.456677 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:48.456677 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:48.456677 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:48.456677 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:48.456677 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 01:17:48.456677 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 01:17:48.456677 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 01:17:48.456677 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 01:17:48.457660 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:48.457660 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:48.457660 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:48.457660 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:48.457660 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:48.457660 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:48.457660 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:48.457660 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:48.457660 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:48.457660 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:48.457660 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:48.457660 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:48.457660 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:48.457660 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:48.457660 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:48.457660 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:48.457660 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 01:17:48.458631 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 01:17:48.458631 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:48.458631 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:17:48.458631 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 327/646] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:17:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:48.459751 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9339d4-366e-42b0-9306-1cc803332d64 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:48.506441 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:48.555198 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd8384-cd5d-4323-a575-643aa6d1add0 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:48.568905 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9339d4-366e-42b0-9306-1cc803332d64 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:48.591493 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc34986-62c6-4d6c-b551-2a062313ca33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:48.592147 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc34986-62c6-4d6c-b551-2a062313ca33 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:48.592409 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc34986-62c6-4d6c-b551-2a062313ca33 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:48.592684 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc34986-62c6-4d6c-b551-2a062313ca33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:48.602818 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930fff4e-8058-4e56-b5e7-4ffcfdd75131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:48.603591 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc34986-62c6-4d6c-b551-2a062313ca33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:48.603726 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930fff4e-8058-4e56-b5e7-4ffcfdd75131 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:48.604121 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930fff4e-8058-4e56-b5e7-4ffcfdd75131 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:48.604521 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930fff4e-8058-4e56-b5e7-4ffcfdd75131 None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:48.605055 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc34986-62c6-4d6c-b551-2a062313ca33 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:48.605596 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930fff4e-8058-4e56-b5e7-4ffcfdd75131 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:48.606053 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930fff4e-8058-4e56-b5e7-4ffcfdd75131 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:48.607615 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930fff4e-8058-4e56-b5e7-4ffcfdd75131 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:48.619330 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-4fc34986-62c6-4d6c-b551-2a062313ca33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:48.619330 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:48.619330 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:48.619330 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:48.619330 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:48.619330 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:48.619330 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:48.619330 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:48.619330 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:48.619330 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:48.619330 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:48.619330 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:48.619330 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 01:17:48.619330 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 01:17:48.619330 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 01:17:48.619330 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 01:17:48.620279 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:48.620279 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:48.620279 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:48.620279 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:48.620279 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:48.620279 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:48.620279 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:48.620279 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:48.620279 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:48.620279 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:48.620279 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:48.620279 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:48.620279 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:48.620279 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:48.620279 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:48.620279 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:48.620279 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 01:17:48.621163 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 01:17:48.621163 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:48.621163 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:17:48.621163 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 320/647] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:17:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:48.621896 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc34986-62c6-4d6c-b551-2a062313ca33 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:48.634167 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 328/648] 10.222.0.26 () {56 vars in 1137 bytes} [Fri Aug 12 01:17:48 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:48.634902 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930fff4e-8058-4e56-b5e7-4ffcfdd75131 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:48.679204 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:48.727146 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc34986-62c6-4d6c-b551-2a062313ca33 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:48.736037 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:48.739299 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930fff4e-8058-4e56-b5e7-4ffcfdd75131 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:48.762809 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41fa625-44f1-45a9-ab85-2c7e6d318ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:48.763421 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41fa625-44f1-45a9-ab85-2c7e6d318ef0 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:48.763697 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41fa625-44f1-45a9-ab85-2c7e6d318ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:48.763965 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41fa625-44f1-45a9-ab85-2c7e6d318ef0 None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:48.764607 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41fa625-44f1-45a9-ab85-2c7e6d318ef0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:48.764903 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41fa625-44f1-45a9-ab85-2c7e6d318ef0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:48.766296 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41fa625-44f1-45a9-ab85-2c7e6d318ef0 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:48.781290 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 321/649] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 01:17:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:48.781290 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41fa625-44f1-45a9-ab85-2c7e6d318ef0 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:48.786380 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3adbfb-f1b5-4f6b-a44b-a4a36c7ff797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:48.787020 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3adbfb-f1b5-4f6b-a44b-a4a36c7ff797 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:48.787294 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3adbfb-f1b5-4f6b-a44b-a4a36c7ff797 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:48.787561 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3adbfb-f1b5-4f6b-a44b-a4a36c7ff797 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:48.788647 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3adbfb-f1b5-4f6b-a44b-a4a36c7ff797 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:48.788945 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3adbfb-f1b5-4f6b-a44b-a4a36c7ff797 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:48.790705 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3adbfb-f1b5-4f6b-a44b-a4a36c7ff797 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:48.807639 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 329/650] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 01:17:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:48.807639 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3adbfb-f1b5-4f6b-a44b-a4a36c7ff797 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:48.888596 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41fa625-44f1-45a9-ab85-2c7e6d318ef0 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:48.911137 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3adbfb-f1b5-4f6b-a44b-a4a36c7ff797 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:48.913119 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:48.923807 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba7d86-aaf0-4918-82c2-d399a8bc4de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:48.924415 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba7d86-aaf0-4918-82c2-d399a8bc4de5 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:48.924675 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba7d86-aaf0-4918-82c2-d399a8bc4de5 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:48.924959 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba7d86-aaf0-4918-82c2-d399a8bc4de5 None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:48.925591 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ba7d86-aaf0-4918-82c2-d399a8bc4de5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:48.925883 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ba7d86-aaf0-4918-82c2-d399a8bc4de5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:48.927829 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ba7d86-aaf0-4918-82c2-d399a8bc4de5 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:48.944208 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 322/651] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 01:17:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:48.944208 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba7d86-aaf0-4918-82c2-d399a8bc4de5 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:48.952868 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c22255-8bd9-45b8-a575-dbc19f486933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:48.953471 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c22255-8bd9-45b8-a575-dbc19f486933 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:48.953748 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c22255-8bd9-45b8-a575-dbc19f486933 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:48.954017 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c22255-8bd9-45b8-a575-dbc19f486933 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:48.972310 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:49.032102 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c22255-8bd9-45b8-a575-dbc19f486933 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:49.033847 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c22255-8bd9-45b8-a575-dbc19f486933 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:49.054040 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba7d86-aaf0-4918-82c2-d399a8bc4de5 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:49.091708 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69db4c6-15c5-48f6-b22d-cefc5e5a6226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:49.092344 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69db4c6-15c5-48f6-b22d-cefc5e5a6226 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:49.092619 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69db4c6-15c5-48f6-b22d-cefc5e5a6226 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:49.092893 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69db4c6-15c5-48f6-b22d-cefc5e5a6226 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:49.099799 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69db4c6-15c5-48f6-b22d-cefc5e5a6226 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:49.101244 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69db4c6-15c5-48f6-b22d-cefc5e5a6226 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:49.113228 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-c69db4c6-15c5-48f6-b22d-cefc5e5a6226 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 01:17:49.113228 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:49.113228 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:49.113228 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:49.113228 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:49.113228 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:49.113228 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:49.113228 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:49.113228 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:49.113228 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:49.113228 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:49.113228 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:49.113228 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 01:17:49.113228 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 01:17:49.113228 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 01:17:49.114359 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 01:17:49.114359 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:49.114359 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:49.114359 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:49.114359 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:49.114359 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:49.114359 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:49.114359 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:49.114359 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:49.114359 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:49.114359 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:49.114359 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:49.114359 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:49.114359 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:49.114359 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:49.114359 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:49.114359 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:49.115446 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 01:17:49.115446 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 01:17:49.115446 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 01:17:49.115446 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 01:17:49.115446 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 01:17:49.115446 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 01:17:49.115446 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 01:17:49.115446 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:17:49.115446 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 323/652] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 01:17:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:49.115446 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69db4c6-15c5-48f6-b22d-cefc5e5a6226 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:49.148353 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 330/653] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 01:17:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 01:17:49.148353 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c22255-8bd9-45b8-a575-dbc19f486933 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:49.149663 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:49.216784 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:49.231545 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69db4c6-15c5-48f6-b22d-cefc5e5a6226 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:49.249687 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c22255-8bd9-45b8-a575-dbc19f486933 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:49.268962 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b84ddbb-1366-4ffc-b592-a0f5de2e66eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:49.269603 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b84ddbb-1366-4ffc-b592-a0f5de2e66eb None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:49.269876 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b84ddbb-1366-4ffc-b592-a0f5de2e66eb None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:49.270630 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b84ddbb-1366-4ffc-b592-a0f5de2e66eb None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:49.278591 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b84ddbb-1366-4ffc-b592-a0f5de2e66eb None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:49.280041 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b84ddbb-1366-4ffc-b592-a0f5de2e66eb None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:49.284337 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bbeecc-6cb1-4c17-93b2-7a72efdc97dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:49.284967 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bbeecc-6cb1-4c17-93b2-7a72efdc97dc None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:49.285235 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bbeecc-6cb1-4c17-93b2-7a72efdc97dc None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:49.285499 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bbeecc-6cb1-4c17-93b2-7a72efdc97dc None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:49.291358 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-2b84ddbb-1366-4ffc-b592-a0f5de2e66eb None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 12 01:17:49.291358 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:49.291358 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:49.291358 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:49.291358 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:49.291358 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:49.291358 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:49.291358 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:49.291358 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:49.291358 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:49.291358 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:49.291358 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:49.291358 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 01:17:49.291358 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 01:17:49.291358 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 01:17:49.291358 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 01:17:49.292611 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:49.292611 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:49.292611 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 01:17:49.292611 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 01:17:49.292611 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 01:17:49.292611 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 01:17:49.292611 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:49.292611 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:49.292611 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:49.292611 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:49.292611 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:49.292611 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:49.292611 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:49.292611 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:49.292611 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:49.292611 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:49.292611 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:49.292611 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:49.293518 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:49.293518 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:49.293518 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 01:17:49.293518 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 01:17:49.293518 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 01:17:49.293518 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 01:17:49.293518 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 01:17:49.293518 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 01:17:49.293518 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 12 01:17:49.293518 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:17:49.293518 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 324/654] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Aug 12 01:17:49 2022] GET /identity/v3/users/neutron => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:49.293518 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b84ddbb-1366-4ffc-b592-a0f5de2e66eb None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:49.298188 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bbeecc-6cb1-4c17-93b2-7a72efdc97dc None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:49.299646 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bbeecc-6cb1-4c17-93b2-7a72efdc97dc None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:49.311444 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-56bbeecc-6cb1-4c17-93b2-7a72efdc97dc None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 12 01:17:49.311444 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:49.311444 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:49.311444 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:49.311444 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:49.311444 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:49.311444 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:49.311444 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:49.311444 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:49.311444 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:49.311444 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:49.311444 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:49.311444 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 01:17:49.311444 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 01:17:49.311444 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 01:17:49.311444 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 01:17:49.312417 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:49.312417 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:49.312417 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 01:17:49.312417 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 01:17:49.312417 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 01:17:49.312417 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 01:17:49.312417 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:49.312417 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:49.312417 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:49.312417 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:49.312417 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:49.312417 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:49.312417 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:49.312417 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:49.312417 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:49.312417 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:49.312417 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:49.312417 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:49.313353 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:49.313353 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:49.313353 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 01:17:49.313353 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 01:17:49.313353 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 01:17:49.313353 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 01:17:49.313353 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 01:17:49.313353 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 01:17:49.313353 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 12 01:17:49.313353 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:17:49.313353 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 331/655] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 01:17:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:49.313353 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bbeecc-6cb1-4c17-93b2-7a72efdc97dc None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:49.377495 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:49.402249 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b84ddbb-1366-4ffc-b592-a0f5de2e66eb None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:49.419217 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bbeecc-6cb1-4c17-93b2-7a72efdc97dc None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:49.434953 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e9d6b0-5780-47c6-9e4f-2f117abaebeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:49.435563 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9d6b0-5780-47c6-9e4f-2f117abaebeb None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:49.435838 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9d6b0-5780-47c6-9e4f-2f117abaebeb None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:49.436108 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9d6b0-5780-47c6-9e4f-2f117abaebeb None admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:49.436800 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e9d6b0-5780-47c6-9e4f-2f117abaebeb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:49.437103 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e9d6b0-5780-47c6-9e4f-2f117abaebeb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:49.438554 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e9d6b0-5780-47c6-9e4f-2f117abaebeb None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:49.450247 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 325/656] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Aug 12 01:17:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:49.451014 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e9d6b0-5780-47c6-9e4f-2f117abaebeb None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:49.452440 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30425c5b-413d-46d0-812f-7800fbcaf2e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:49.453069 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30425c5b-413d-46d0-812f-7800fbcaf2e3 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:49.453340 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30425c5b-413d-46d0-812f-7800fbcaf2e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:49.453603 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30425c5b-413d-46d0-812f-7800fbcaf2e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:49.463363 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:49.464418 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30425c5b-413d-46d0-812f-7800fbcaf2e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:49.465985 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30425c5b-413d-46d0-812f-7800fbcaf2e3 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:49.480910 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-30425c5b-413d-46d0-812f-7800fbcaf2e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:49.480910 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:49.480910 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:49.480910 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:49.480910 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:49.480910 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:49.480910 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:49.480910 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:49.480910 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:49.480910 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:49.480910 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:49.480910 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:49.480910 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 01:17:49.480910 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 01:17:49.480910 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 01:17:49.480910 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 01:17:49.481873 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:49.481873 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:49.481873 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:49.481873 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:49.481873 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:49.481873 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:49.481873 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:49.481873 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:49.481873 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:49.481873 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:49.481873 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:49.481873 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:49.481873 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:49.481873 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:49.481873 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:49.481873 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:49.481873 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 01:17:49.482791 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 01:17:49.482791 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:49.482791 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:17:49.482791 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 332/657] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:17:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:49.483012 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30425c5b-413d-46d0-812f-7800fbcaf2e3 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:49.556421 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e9d6b0-5780-47c6-9e4f-2f117abaebeb None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:49.580722 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30425c5b-413d-46d0-812f-7800fbcaf2e3 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:49.590413 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d687093-5162-4101-bd65-2184294c3b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:49.591019 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d687093-5162-4101-bd65-2184294c3b7d None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:49.591288 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d687093-5162-4101-bd65-2184294c3b7d None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:49.591557 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d687093-5162-4101-bd65-2184294c3b7d None admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:49.592274 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d687093-5162-4101-bd65-2184294c3b7d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:49.592572 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d687093-5162-4101-bd65-2184294c3b7d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:49.593999 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d687093-5162-4101-bd65-2184294c3b7d None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:49.595493 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:49.616147 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 326/658] 10.222.0.26 () {56 vars in 1139 bytes} [Fri Aug 12 01:17:49 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:49.616147 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d0477-3c9e-4cf4-ae1b-5fbc9e1ccc48 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:49.616147 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d0477-3c9e-4cf4-ae1b-5fbc9e1ccc48 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:49.616147 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d0477-3c9e-4cf4-ae1b-5fbc9e1ccc48 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:49.616147 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 327/659] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:17:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:17:49.616147 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40d0477-3c9e-4cf4-ae1b-5fbc9e1ccc48 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:49.620178 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da47bcf0-ca82-4176-8353-f4c7151c8ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:49.620792 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da47bcf0-ca82-4176-8353-f4c7151c8ba9 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:49.621070 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da47bcf0-ca82-4176-8353-f4c7151c8ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:49.621338 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da47bcf0-ca82-4176-8353-f4c7151c8ba9 None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:49.622068 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da47bcf0-ca82-4176-8353-f4c7151c8ba9 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:49.622404 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da47bcf0-ca82-4176-8353-f4c7151c8ba9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:49.623847 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da47bcf0-ca82-4176-8353-f4c7151c8ba9 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:49.640804 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 333/660] 10.222.0.26 () {56 vars in 1137 bytes} [Fri Aug 12 01:17:49 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:49.641624 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da47bcf0-ca82-4176-8353-f4c7151c8ba9 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:49.683011 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:49.717450 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40d0477-3c9e-4cf4-ae1b-5fbc9e1ccc48 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:49.743716 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da47bcf0-ca82-4176-8353-f4c7151c8ba9 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:49.749863 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b36cc4-af61-47c6-917d-4f817336daaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:49.750501 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b36cc4-af61-47c6-917d-4f817336daaf None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:49.750773 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b36cc4-af61-47c6-917d-4f817336daaf None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:49.751041 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b36cc4-af61-47c6-917d-4f817336daaf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:49.751758 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b36cc4-af61-47c6-917d-4f817336daaf None admin] RBAC: Adding query filter params (role.id=90d1ca7df8de4b03a689afc664d0cc3f, scope.project.id=fa91143910a74c6b896ced5b51f9966a, user.id=fcd5e95467b44175be2478c2c7c89926) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:49.752062 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b36cc4-af61-47c6-917d-4f817336daaf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:49.753498 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b36cc4-af61-47c6-917d-4f817336daaf None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:49.759790 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 328/661] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 01:17:49 2022] GET /identity/v3/role_assignments?user.id=fcd5e95467b44175be2478c2c7c89926&scope.project.id=fa91143910a74c6b896ced5b51f9966a&role.id=90d1ca7df8de4b03a689afc664d0cc3f => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:49.760571 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b36cc4-af61-47c6-917d-4f817336daaf None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:49.783470 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f386d076-2022-4f17-8305-03822ddc0e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:49.784098 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f386d076-2022-4f17-8305-03822ddc0e5f None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:49.784376 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f386d076-2022-4f17-8305-03822ddc0e5f None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:49.784643 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f386d076-2022-4f17-8305-03822ddc0e5f None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:49.785451 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f386d076-2022-4f17-8305-03822ddc0e5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:49.785914 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f386d076-2022-4f17-8305-03822ddc0e5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:49.787451 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f386d076-2022-4f17-8305-03822ddc0e5f None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:49.804565 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 334/662] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 01:17:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:49.804565 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df654b70-0918-4cf4-8336-f3f1b50695e8 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:49.804565 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df654b70-0918-4cf4-8336-f3f1b50695e8 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:49.804565 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df654b70-0918-4cf4-8336-f3f1b50695e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:49.822046 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-df654b70-0918-4cf4-8336-f3f1b50695e8 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:17:49.823298 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-df654b70-0918-4cf4-8336-f3f1b50695e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:17:49.852702 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:49.878888 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b36cc4-af61-47c6-917d-4f817336daaf None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:49.902790 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 335/663] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:17:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 01:17:49.903930 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df654b70-0918-4cf4-8336-f3f1b50695e8 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:49.913993 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:49.921319 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d922f7bb-cec7-4e69-99b0-dad58292de3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:49.921908 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d922f7bb-cec7-4e69-99b0-dad58292de3a None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:49.923433 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d922f7bb-cec7-4e69-99b0-dad58292de3a None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:49.923433 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d922f7bb-cec7-4e69-99b0-dad58292de3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:50.007598 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d922f7bb-cec7-4e69-99b0-dad58292de3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:50.009058 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d922f7bb-cec7-4e69-99b0-dad58292de3a None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:50.018992 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df654b70-0918-4cf4-8336-f3f1b50695e8 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:50.066152 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c7a91c-3e89-422f-9a35-1d52e9de3719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:50.067096 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7a91c-3e89-422f-9a35-1d52e9de3719 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:50.067367 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7a91c-3e89-422f-9a35-1d52e9de3719 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:50.067631 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7a91c-3e89-422f-9a35-1d52e9de3719 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:50.105400 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:50.127790 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 329/664] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 01:17:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 01:17:50.129386 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d922f7bb-cec7-4e69-99b0-dad58292de3a None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:50.152487 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c7a91c-3e89-422f-9a35-1d52e9de3719 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:50.154247 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c7a91c-3e89-422f-9a35-1d52e9de3719 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:50.182720 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:50.244996 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d922f7bb-cec7-4e69-99b0-dad58292de3a None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:50.267536 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 336/665] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 01:17:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 01:17:50.268472 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c7a91c-3e89-422f-9a35-1d52e9de3719 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:50.289365 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e8baa7-b23b-4aa2-b0be-c8349d15c985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:50.290105 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e8baa7-b23b-4aa2-b0be-c8349d15c985 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:50.290464 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e8baa7-b23b-4aa2-b0be-c8349d15c985 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:50.290812 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e8baa7-b23b-4aa2-b0be-c8349d15c985 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:50.298056 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e8baa7-b23b-4aa2-b0be-c8349d15c985 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:50.299589 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e8baa7-b23b-4aa2-b0be-c8349d15c985 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:50.311136 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-61e8baa7-b23b-4aa2-b0be-c8349d15c985 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 01:17:50.311136 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:50.311136 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:50.311136 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:50.311136 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:50.311136 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:50.311136 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:50.311136 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:50.311136 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:50.311136 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:50.311136 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:50.311136 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:50.311136 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 01:17:50.311136 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 01:17:50.311136 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 01:17:50.312217 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 01:17:50.312217 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:50.312217 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:50.312217 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:50.312217 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:50.312217 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:50.312217 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:50.312217 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:50.312217 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:50.312217 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:50.312217 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:50.312217 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:50.312217 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:50.312217 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:50.312217 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:50.312217 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:50.312217 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:50.313315 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 01:17:50.313315 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 01:17:50.313315 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 01:17:50.313315 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 01:17:50.313315 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 01:17:50.313315 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 01:17:50.313315 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 01:17:50.313315 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:17:50.313315 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 330/666] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 01:17:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:50.318152 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e8baa7-b23b-4aa2-b0be-c8349d15c985 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:50.336018 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:50.380889 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c7a91c-3e89-422f-9a35-1d52e9de3719 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:50.412568 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:50.419762 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba451771-0141-4ec9-91c2-10630db56035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:50.420402 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba451771-0141-4ec9-91c2-10630db56035 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:50.420676 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba451771-0141-4ec9-91c2-10630db56035 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:50.420942 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba451771-0141-4ec9-91c2-10630db56035 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:50.425540 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e8baa7-b23b-4aa2-b0be-c8349d15c985 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:50.432077 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba451771-0141-4ec9-91c2-10630db56035 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:50.433846 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba451771-0141-4ec9-91c2-10630db56035 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:50.447931 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-ba451771-0141-4ec9-91c2-10630db56035 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:50.447931 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:50.447931 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:50.447931 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:50.447931 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:50.447931 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:50.447931 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:50.447931 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:50.447931 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:50.447931 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:50.447931 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:50.447931 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:50.447931 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 01:17:50.447931 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 01:17:50.447931 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 01:17:50.447931 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 01:17:50.449072 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:50.449072 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:50.449072 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:50.449072 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:50.449072 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:50.449072 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:50.449072 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:50.449072 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:50.449072 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:50.449072 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:50.449072 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:50.449072 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:50.449072 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:50.449072 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:50.449072 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:50.449072 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:50.449072 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 01:17:50.450013 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 01:17:50.450013 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:50.450013 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:17:50.450013 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 337/667] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:17:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:50.450520 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba451771-0141-4ec9-91c2-10630db56035 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:50.467440 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1539a5-553c-43d3-8e32-209b17e5c76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:50.468147 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1539a5-553c-43d3-8e32-209b17e5c76a None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:50.468529 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1539a5-553c-43d3-8e32-209b17e5c76a None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:50.468856 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1539a5-553c-43d3-8e32-209b17e5c76a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:50.479094 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1539a5-553c-43d3-8e32-209b17e5c76a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:17:50.483787 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-fd1539a5-553c-43d3-8e32-209b17e5c76a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 01:17:50.483787 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:50.483787 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:50.483787 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:50.483787 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:50.483787 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:50.483787 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:50.483787 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:50.483787 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:50.483787 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:50.483787 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:50.483787 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:50.483787 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:17:50.483787 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:17:50.483787 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:17:50.483787 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:17:50.484919 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:17:50.484919 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:17:50.484919 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:17:50.484919 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:17:50.484919 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:50.484919 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:50.484919 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:50.484919 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:50.484919 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:50.484919 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:50.484919 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:50.484919 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:50.484919 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:50.484919 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:50.484919 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:50.484919 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:50.485966 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:50.485966 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:50.485966 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:50.485966 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:50.485966 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:17:50.485966 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:17:50.485966 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:17:50.485966 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:17:50.485966 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:17:50.485966 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:17:50.485966 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 01:17:50.485966 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:17:50.490411 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 331/668] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Aug 12 01:17:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:50.491213 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1539a5-553c-43d3-8e32-209b17e5c76a None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:50.570984 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba451771-0141-4ec9-91c2-10630db56035 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:50.586813 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:50.591492 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1539a5-553c-43d3-8e32-209b17e5c76a None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:50.608914 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e24321-c71b-4723-8431-a1854915321b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:50.609541 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e24321-c71b-4723-8431-a1854915321b None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:50.609810 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e24321-c71b-4723-8431-a1854915321b None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:50.610072 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e24321-c71b-4723-8431-a1854915321b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:50.631040 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5216f845-3bc9-4b34-8d0f-c4fc78dcf89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:50.631675 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216f845-3bc9-4b34-8d0f-c4fc78dcf89a None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:50.631935 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216f845-3bc9-4b34-8d0f-c4fc78dcf89a None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:50.632205 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216f845-3bc9-4b34-8d0f-c4fc78dcf89a None admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:50.632916 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5216f845-3bc9-4b34-8d0f-c4fc78dcf89a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:50.633201 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5216f845-3bc9-4b34-8d0f-c4fc78dcf89a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:50.634734 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5216f845-3bc9-4b34-8d0f-c4fc78dcf89a None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:50.653486 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 332/669] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Aug 12 01:17:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:50.653486 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5216f845-3bc9-4b34-8d0f-c4fc78dcf89a None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:50.667664 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:50.741821 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e24321-c71b-4723-8431-a1854915321b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:50.743302 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e24321-c71b-4723-8431-a1854915321b None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:50.757740 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-25e24321-c71b-4723-8431-a1854915321b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:50.757740 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:50.757740 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:50.757740 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:50.757740 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:50.757740 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:50.757740 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:50.757740 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:50.757740 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:50.757740 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:50.757740 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:50.757740 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:50.757740 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 01:17:50.757740 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 01:17:50.757740 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 01:17:50.757740 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 01:17:50.758763 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:50.758763 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:50.758763 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:50.758763 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:50.758763 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:50.758763 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:50.758763 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:50.758763 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:50.758763 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:50.758763 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:50.758763 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:50.758763 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:50.758763 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:50.758763 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:50.758763 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:50.758763 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:50.758763 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 01:17:50.759631 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 01:17:50.759631 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:50.759631 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:17:50.759631 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 338/670] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:17:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:50.759631 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e24321-c71b-4723-8431-a1854915321b None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:50.771486 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5216f845-3bc9-4b34-8d0f-c4fc78dcf89a None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:50.804810 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3581dd65-7164-4fff-a085-1c427f73af1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:50.805420 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581dd65-7164-4fff-a085-1c427f73af1d None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:50.805698 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581dd65-7164-4fff-a085-1c427f73af1d None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:50.805970 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581dd65-7164-4fff-a085-1c427f73af1d None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:50.806652 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3581dd65-7164-4fff-a085-1c427f73af1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:50.806950 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3581dd65-7164-4fff-a085-1c427f73af1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:50.808307 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3581dd65-7164-4fff-a085-1c427f73af1d None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:50.821517 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 333/671] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 01:17:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:50.822279 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3581dd65-7164-4fff-a085-1c427f73af1d None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:50.873687 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e24321-c71b-4723-8431-a1854915321b None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:50.897666 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:50.908643 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae80531-e2e5-4287-975b-dc47407d4e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:50.909245 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae80531-e2e5-4287-975b-dc47407d4e9f None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:50.909519 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae80531-e2e5-4287-975b-dc47407d4e9f None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:50.909781 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae80531-e2e5-4287-975b-dc47407d4e9f None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:50.910458 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae80531-e2e5-4287-975b-dc47407d4e9f None admin] RBAC: Adding query filter params (name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:50.910888 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae80531-e2e5-4287-975b-dc47407d4e9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:50.912248 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae80531-e2e5-4287-975b-dc47407d4e9f None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:50.920439 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 339/672] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Aug 12 01:17:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:50.925811 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae80531-e2e5-4287-975b-dc47407d4e9f None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:50.932224 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3581dd65-7164-4fff-a085-1c427f73af1d None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:50.955380 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:50.968164 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a56e3d-b69c-49de-9bf3-6e0db1fab889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:50.968766 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a56e3d-b69c-49de-9bf3-6e0db1fab889 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:50.969036 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a56e3d-b69c-49de-9bf3-6e0db1fab889 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:50.969298 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a56e3d-b69c-49de-9bf3-6e0db1fab889 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:50.970013 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a56e3d-b69c-49de-9bf3-6e0db1fab889 None admin] RBAC: Adding query filter params (role.id=90d1ca7df8de4b03a689afc664d0cc3f, scope.project.id=fa91143910a74c6b896ced5b51f9966a, user.id=bd73d9b9b63a499d909fec034bf9a259) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:50.970341 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a56e3d-b69c-49de-9bf3-6e0db1fab889 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:50.971773 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a56e3d-b69c-49de-9bf3-6e0db1fab889 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:50.986173 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 334/673] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 01:17:50 2022] GET /identity/v3/role_assignments?user.id=bd73d9b9b63a499d909fec034bf9a259&scope.project.id=fa91143910a74c6b896ced5b51f9966a&role.id=90d1ca7df8de4b03a689afc664d0cc3f => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:50.986173 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a56e3d-b69c-49de-9bf3-6e0db1fab889 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:51.045464 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae80531-e2e5-4287-975b-dc47407d4e9f None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:51.085500 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4089df-c53e-476d-8317-cd24cbb6c94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:51.086141 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4089df-c53e-476d-8317-cd24cbb6c94e None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:51.086502 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4089df-c53e-476d-8317-cd24cbb6c94e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:51.086834 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4089df-c53e-476d-8317-cd24cbb6c94e None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:51.087814 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4089df-c53e-476d-8317-cd24cbb6c94e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:51.088177 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4089df-c53e-476d-8317-cd24cbb6c94e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:51.089715 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4089df-c53e-476d-8317-cd24cbb6c94e None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:51.102904 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 340/674] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 01:17:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:51.103892 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4089df-c53e-476d-8317-cd24cbb6c94e None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:51.117907 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a56e3d-b69c-49de-9bf3-6e0db1fab889 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:51.164041 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f7ea37-e129-4984-99d7-ff87823b8a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:51.165075 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f7ea37-e129-4984-99d7-ff87823b8a7d None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:51.165540 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f7ea37-e129-4984-99d7-ff87823b8a7d None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:51.166046 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f7ea37-e129-4984-99d7-ff87823b8a7d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:51.168967 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:51.177571 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f7ea37-e129-4984-99d7-ff87823b8a7d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:51.179365 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f7ea37-e129-4984-99d7-ff87823b8a7d None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:51.194420 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-f7f7ea37-e129-4984-99d7-ff87823b8a7d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 01:17:51.194420 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:51.194420 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:51.194420 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:51.194420 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:51.194420 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:51.194420 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:51.194420 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:51.194420 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:51.194420 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:51.194420 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:51.194420 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:51.194420 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 01:17:51.194420 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 01:17:51.194420 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 01:17:51.195313 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 01:17:51.195313 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:51.195313 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:51.195313 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:51.195313 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:51.195313 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:51.195313 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:51.195313 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:51.195313 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:51.195313 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:51.195313 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:51.195313 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:51.195313 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:51.195313 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:51.195313 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:51.195313 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:51.195313 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:51.196191 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 01:17:51.196191 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 01:17:51.196191 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 01:17:51.196191 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 01:17:51.196191 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 01:17:51.196191 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 01:17:51.196191 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 01:17:51.196191 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:17:51.200392 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 335/675] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 01:17:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:51.201270 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f7ea37-e129-4984-99d7-ff87823b8a7d None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:51.222013 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:51.240892 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4089df-c53e-476d-8317-cd24cbb6c94e None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:51.285304 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c810ff5b-a09c-41a0-a40e-c1b316715609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:51.285993 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810ff5b-a09c-41a0-a40e-c1b316715609 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:51.286320 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810ff5b-a09c-41a0-a40e-c1b316715609 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:51.286651 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810ff5b-a09c-41a0-a40e-c1b316715609 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:51.297501 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c810ff5b-a09c-41a0-a40e-c1b316715609 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:51.299128 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c810ff5b-a09c-41a0-a40e-c1b316715609 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:51.314513 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-c810ff5b-a09c-41a0-a40e-c1b316715609 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:51.314513 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:51.314513 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:51.314513 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:51.314513 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:51.314513 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:51.314513 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:51.314513 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:51.314513 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:51.314513 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:51.314513 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:51.314513 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:51.314513 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 01:17:51.314513 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 01:17:51.314513 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 01:17:51.314513 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 01:17:51.315699 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:51.315699 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:51.315699 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:51.315699 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:51.315699 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:51.315699 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:51.315699 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:51.315699 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:51.315699 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:51.315699 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:51.315699 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:51.315699 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:51.315699 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:51.315699 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:51.315699 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:51.315699 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:51.315699 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 01:17:51.316883 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 01:17:51.316883 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:51.316883 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:17:51.322151 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 341/676] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:17:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:51.322151 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c810ff5b-a09c-41a0-a40e-c1b316715609 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:51.335438 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f7ea37-e129-4984-99d7-ff87823b8a7d None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:51.374439 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff3049b-41ea-4c5f-9a30-c68ae3dc1c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:51.375029 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff3049b-41ea-4c5f-9a30-c68ae3dc1c46 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:51.375305 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff3049b-41ea-4c5f-9a30-c68ae3dc1c46 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:51.375576 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff3049b-41ea-4c5f-9a30-c68ae3dc1c46 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:51.385434 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff3049b-41ea-4c5f-9a30-c68ae3dc1c46 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:51.387171 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff3049b-41ea-4c5f-9a30-c68ae3dc1c46 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:51.402885 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-1ff3049b-41ea-4c5f-9a30-c68ae3dc1c46 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 01:17:51.402885 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:51.402885 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:51.402885 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:51.402885 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:51.402885 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:51.402885 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:51.402885 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:51.402885 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:51.402885 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:51.402885 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:51.402885 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:51.402885 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 01:17:51.402885 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 01:17:51.402885 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 01:17:51.403869 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 01:17:51.403869 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:51.403869 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:51.403869 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:51.403869 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:51.403869 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:51.403869 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:51.403869 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:51.403869 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:51.403869 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:51.403869 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:51.403869 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:51.403869 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:51.403869 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:51.403869 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:51.403869 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:51.403869 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:51.404751 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 01:17:51.404751 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 01:17:51.404751 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 01:17:51.404751 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 01:17:51.404751 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 01:17:51.404751 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 01:17:51.404751 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 01:17:51.404751 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:17:51.408970 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 336/677] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 01:17:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:51.409890 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff3049b-41ea-4c5f-9a30-c68ae3dc1c46 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:51.447357 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c810ff5b-a09c-41a0-a40e-c1b316715609 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:51.484929 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:51.489682 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4f9d8c-8c7d-4a3e-a9c6-5e9df2399acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:51.490619 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f9d8c-8c7d-4a3e-a9c6-5e9df2399acf None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:51.490964 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f9d8c-8c7d-4a3e-a9c6-5e9df2399acf None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:51.491300 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f9d8c-8c7d-4a3e-a9c6-5e9df2399acf None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:51.498157 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4f9d8c-8c7d-4a3e-a9c6-5e9df2399acf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:51.498157 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4f9d8c-8c7d-4a3e-a9c6-5e9df2399acf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:51.498157 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4f9d8c-8c7d-4a3e-a9c6-5e9df2399acf None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:51.504033 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:51.509517 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 342/678] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Aug 12 01:17:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:51.510612 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4f9d8c-8c7d-4a3e-a9c6-5e9df2399acf None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:51.625029 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4f9d8c-8c7d-4a3e-a9c6-5e9df2399acf None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:51.667591 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e99ed6-a58d-4bd0-a76e-e30d7bba906f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:51.668215 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e99ed6-a58d-4bd0-a76e-e30d7bba906f None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:51.668491 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e99ed6-a58d-4bd0-a76e-e30d7bba906f None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:51.668760 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e99ed6-a58d-4bd0-a76e-e30d7bba906f None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:51.669158 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff3049b-41ea-4c5f-9a30-c68ae3dc1c46 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:51.669461 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e99ed6-a58d-4bd0-a76e-e30d7bba906f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:51.669763 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e99ed6-a58d-4bd0-a76e-e30d7bba906f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:51.671504 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e99ed6-a58d-4bd0-a76e-e30d7bba906f None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:51.690263 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 343/679] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Aug 12 01:17:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:51.691532 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e99ed6-a58d-4bd0-a76e-e30d7bba906f None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:51.711450 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471ae663-7f56-4736-8fe2-3232f806e7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:51.712403 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ae663-7f56-4736-8fe2-3232f806e7d7 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:51.712874 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ae663-7f56-4736-8fe2-3232f806e7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:51.713286 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ae663-7f56-4736-8fe2-3232f806e7d7 None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:51.714149 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471ae663-7f56-4736-8fe2-3232f806e7d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:51.714641 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471ae663-7f56-4736-8fe2-3232f806e7d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:51.716380 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471ae663-7f56-4736-8fe2-3232f806e7d7 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:51.733967 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 337/680] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 01:17:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:51.735179 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471ae663-7f56-4736-8fe2-3232f806e7d7 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:51.764835 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:51.819642 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e99ed6-a58d-4bd0-a76e-e30d7bba906f None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:51.842939 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471ae663-7f56-4736-8fe2-3232f806e7d7 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:51.861017 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:51.872868 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a99fe7-acd3-4066-8c6f-1fe1ca0f3580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:51.873475 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a99fe7-acd3-4066-8c6f-1fe1ca0f3580 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:51.873751 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a99fe7-acd3-4066-8c6f-1fe1ca0f3580 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:51.874014 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a99fe7-acd3-4066-8c6f-1fe1ca0f3580 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:51.874743 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a99fe7-acd3-4066-8c6f-1fe1ca0f3580 None admin] RBAC: Adding query filter params (role.id=90d1ca7df8de4b03a689afc664d0cc3f, scope.project.id=fa91143910a74c6b896ced5b51f9966a, user.id=a80678458dc9405285b70da707a399c2) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:51.875092 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a99fe7-acd3-4066-8c6f-1fe1ca0f3580 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:51.876465 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a99fe7-acd3-4066-8c6f-1fe1ca0f3580 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:51.894162 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 344/681] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 01:17:51 2022] GET /identity/v3/role_assignments?user.id=a80678458dc9405285b70da707a399c2&scope.project.id=fa91143910a74c6b896ced5b51f9966a&role.id=90d1ca7df8de4b03a689afc664d0cc3f => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:51.894162 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a99fe7-acd3-4066-8c6f-1fe1ca0f3580 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:51.895926 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2f9e46-b8c1-4182-9708-c3a7ed88803a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:51.896390 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f9e46-b8c1-4182-9708-c3a7ed88803a None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:51.896728 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f9e46-b8c1-4182-9708-c3a7ed88803a None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:51.897070 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f9e46-b8c1-4182-9708-c3a7ed88803a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:51.898180 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2f9e46-b8c1-4182-9708-c3a7ed88803a None admin] RBAC: Adding query filter params (role.id=90d1ca7df8de4b03a689afc664d0cc3f, scope.project.id=fa91143910a74c6b896ced5b51f9966a, user.id=7853d40c29af424c8d7913950d89750b) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:51.898565 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2f9e46-b8c1-4182-9708-c3a7ed88803a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:51.901139 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2f9e46-b8c1-4182-9708-c3a7ed88803a None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:51.909057 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 338/682] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 01:17:51 2022] GET /identity/v3/role_assignments?user.id=7853d40c29af424c8d7913950d89750b&scope.project.id=fa91143910a74c6b896ced5b51f9966a&role.id=90d1ca7df8de4b03a689afc664d0cc3f => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:51.911789 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eedb664-f937-4383-9119-f2cc8b76934c None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:51.912116 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eedb664-f937-4383-9119-f2cc8b76934c None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:51.912387 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eedb664-f937-4383-9119-f2cc8b76934c None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:51.914085 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 339/683] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:17:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:17:51.928068 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753dfc5-b93e-41e8-93ab-a78f289d63f9 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:51.928321 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753dfc5-b93e-41e8-93ab-a78f289d63f9 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:51.928596 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753dfc5-b93e-41e8-93ab-a78f289d63f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:51.975447 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-5753dfc5-b93e-41e8-93ab-a78f289d63f9 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:17:51.978890 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-5753dfc5-b93e-41e8-93ab-a78f289d63f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:17:52.080718 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 340/684] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:17:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 01:17:52.098343 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a99fe7-acd3-4066-8c6f-1fe1ca0f3580 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:52.124607 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:52.138011 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f827228-b45e-4247-b0fe-03223ea56117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:52.138609 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f827228-b45e-4247-b0fe-03223ea56117 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:52.138884 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f827228-b45e-4247-b0fe-03223ea56117 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:52.139152 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f827228-b45e-4247-b0fe-03223ea56117 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:52.147548 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f827228-b45e-4247-b0fe-03223ea56117 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:52.149011 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f827228-b45e-4247-b0fe-03223ea56117 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:52.162218 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-2f827228-b45e-4247-b0fe-03223ea56117 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 12 01:17:52.162218 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:52.162218 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:52.162218 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:52.162218 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:52.162218 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:52.162218 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:52.162218 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:52.162218 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:52.162218 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:52.162218 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:52.162218 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:52.162218 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 01:17:52.162218 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 01:17:52.162218 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 01:17:52.162218 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 01:17:52.163255 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:52.163255 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:52.163255 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 01:17:52.163255 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 01:17:52.163255 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 01:17:52.163255 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 01:17:52.163255 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:52.163255 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:52.163255 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:52.163255 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:52.163255 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:52.163255 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:52.163255 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:52.163255 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:52.163255 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:52.163255 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:52.163255 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:52.163255 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:52.164176 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:52.164176 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:52.164176 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 01:17:52.164176 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 01:17:52.164176 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 01:17:52.164176 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 01:17:52.164176 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 01:17:52.164176 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 01:17:52.164176 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 12 01:17:52.164176 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:17:52.164176 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 345/685] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Aug 12 01:17:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:52.170984 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5753dfc5-b93e-41e8-93ab-a78f289d63f9 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:52.286650 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5753dfc5-b93e-41e8-93ab-a78f289d63f9 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:52.296838 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:52.329805 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca0fdc1-e66e-4745-9c36-6149320088d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:52.330440 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca0fdc1-e66e-4745-9c36-6149320088d9 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:52.330710 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca0fdc1-e66e-4745-9c36-6149320088d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:52.330978 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca0fdc1-e66e-4745-9c36-6149320088d9 None admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:52.331698 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca0fdc1-e66e-4745-9c36-6149320088d9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:52.331995 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca0fdc1-e66e-4745-9c36-6149320088d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:52.333972 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca0fdc1-e66e-4745-9c36-6149320088d9 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:52.357982 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 341/686] 10.222.0.26 () {56 vars in 1135 bytes} [Fri Aug 12 01:17:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:52.364258 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f827228-b45e-4247-b0fe-03223ea56117 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:52.383954 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca0fdc1-e66e-4745-9c36-6149320088d9 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:52.521632 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f827228-b45e-4247-b0fe-03223ea56117 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:52.524658 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca0fdc1-e66e-4745-9c36-6149320088d9 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:52.556769 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38096f4-d1db-40e8-98f2-06a354cc5da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:52.557380 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38096f4-d1db-40e8-98f2-06a354cc5da7 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:52.557647 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38096f4-d1db-40e8-98f2-06a354cc5da7 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:52.557910 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38096f4-d1db-40e8-98f2-06a354cc5da7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:52.579564 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d6a950-25f3-47a2-923e-50fbde17cc5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:52.580578 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6a950-25f3-47a2-923e-50fbde17cc5f None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:52.581055 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6a950-25f3-47a2-923e-50fbde17cc5f None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:52.581536 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6a950-25f3-47a2-923e-50fbde17cc5f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:52.592287 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d6a950-25f3-47a2-923e-50fbde17cc5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:17:52.597198 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-c1d6a950-25f3-47a2-923e-50fbde17cc5f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 01:17:52.597198 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:52.597198 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:52.597198 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:52.597198 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:52.597198 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:52.597198 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:52.597198 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:52.597198 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:52.597198 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:52.597198 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:52.597198 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:52.597198 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:17:52.597198 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:17:52.597198 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:17:52.597198 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:17:52.598205 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:17:52.598205 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:17:52.598205 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:17:52.598205 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:17:52.598205 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:52.598205 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:52.598205 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:52.598205 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:52.598205 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:52.598205 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:52.598205 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:52.598205 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:52.598205 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:52.598205 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:52.598205 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:52.598205 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:52.599048 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:52.599048 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:52.599048 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:52.599048 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:52.599048 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:17:52.599048 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:17:52.599048 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:17:52.599048 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:17:52.599048 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:17:52.599048 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:17:52.599048 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 01:17:52.599048 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:17:52.601878 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 342/687] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Aug 12 01:17:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:52.611119 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d6a950-25f3-47a2-923e-50fbde17cc5f None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:52.612882 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:52.630983 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38096f4-d1db-40e8-98f2-06a354cc5da7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:52.632816 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38096f4-d1db-40e8-98f2-06a354cc5da7 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:52.669891 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:52.736262 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 346/688] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 01:17:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 01:17:52.742968 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38096f4-d1db-40e8-98f2-06a354cc5da7 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:52.820968 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d6a950-25f3-47a2-923e-50fbde17cc5f None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:52.862511 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:52.880313 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38096f4-d1db-40e8-98f2-06a354cc5da7 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:52.902558 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4cbbe0-aba5-4d5f-ae5a-f2295db9d87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:52.903182 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4cbbe0-aba5-4d5f-ae5a-f2295db9d87d None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:52.903461 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4cbbe0-aba5-4d5f-ae5a-f2295db9d87d None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:52.903729 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4cbbe0-aba5-4d5f-ae5a-f2295db9d87d None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:52.904396 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4cbbe0-aba5-4d5f-ae5a-f2295db9d87d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:52.904735 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4cbbe0-aba5-4d5f-ae5a-f2295db9d87d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:52.906042 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4cbbe0-aba5-4d5f-ae5a-f2295db9d87d None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:52.918098 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b595b9-0bdf-4555-8560-9ddf61642e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:52.919040 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b595b9-0bdf-4555-8560-9ddf61642e43 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:52.919511 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b595b9-0bdf-4555-8560-9ddf61642e43 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:52.920008 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b595b9-0bdf-4555-8560-9ddf61642e43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:52.925590 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 343/689] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 01:17:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:52.930897 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4cbbe0-aba5-4d5f-ae5a-f2295db9d87d None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:52.931467 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b595b9-0bdf-4555-8560-9ddf61642e43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:52.933121 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b595b9-0bdf-4555-8560-9ddf61642e43 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:52.948870 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-31b595b9-0bdf-4555-8560-9ddf61642e43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:52.948870 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:52.948870 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:52.948870 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:52.948870 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:52.948870 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:52.948870 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:52.948870 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:52.948870 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:52.948870 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:52.948870 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:52.948870 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:52.948870 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 01:17:52.948870 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 01:17:52.948870 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 01:17:52.948870 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 01:17:52.949849 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:52.949849 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:52.949849 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:52.949849 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:52.949849 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:52.949849 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:52.949849 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:52.949849 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:52.949849 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:52.949849 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:52.949849 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:52.949849 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:52.949849 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:52.949849 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:52.949849 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:52.949849 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:52.949849 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 01:17:52.950745 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 01:17:52.950745 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:52.950745 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:17:52.952836 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 347/690] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:17:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 01:17:52.961815 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b595b9-0bdf-4555-8560-9ddf61642e43 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:53.032417 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:53.050329 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4cbbe0-aba5-4d5f-ae5a-f2295db9d87d None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:53.090221 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b595b9-0bdf-4555-8560-9ddf61642e43 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:53.131830 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27942011-8363-4a91-831e-7ae722e01864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:53.132440 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27942011-8363-4a91-831e-7ae722e01864 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:53.132717 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27942011-8363-4a91-831e-7ae722e01864 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:53.132988 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27942011-8363-4a91-831e-7ae722e01864 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:53.133633 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27942011-8363-4a91-831e-7ae722e01864 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:53.133933 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27942011-8363-4a91-831e-7ae722e01864 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:53.135333 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27942011-8363-4a91-831e-7ae722e01864 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:53.141050 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7f0edd-020a-4d56-b211-2d783a5ce3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:53.141685 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f0edd-020a-4d56-b211-2d783a5ce3d5 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:53.141958 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f0edd-020a-4d56-b211-2d783a5ce3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:53.142257 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f0edd-020a-4d56-b211-2d783a5ce3d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:53.150478 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:53.161001 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 348/691] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 01:17:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:53.163552 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaaa6b2-dea6-42e0-b68f-eba9f3bae2ce None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:53.163830 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaaa6b2-dea6-42e0-b68f-eba9f3bae2ce None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:53.164097 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaaa6b2-dea6-42e0-b68f-eba9f3bae2ce None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:53.165431 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 349/692] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:17:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:17:53.166555 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7f0edd-020a-4d56-b211-2d783a5ce3d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:53.168071 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7f0edd-020a-4d56-b211-2d783a5ce3d5 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:53.169190 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaaa6b2-dea6-42e0-b68f-eba9f3bae2ce None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:53.186157 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-2a7f0edd-020a-4d56-b211-2d783a5ce3d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:53.186157 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:53.186157 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:53.186157 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:53.186157 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:53.186157 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:53.186157 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:53.186157 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:53.186157 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:53.186157 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:53.186157 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:53.186157 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:53.186157 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 01:17:53.186157 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 01:17:53.186157 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 01:17:53.186157 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 01:17:53.187546 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:53.187546 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:53.187546 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:53.187546 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:53.187546 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:53.187546 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:53.187546 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:53.187546 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:53.187546 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:53.187546 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:53.187546 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:53.187546 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:53.187546 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:53.187546 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:53.187546 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:53.187546 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:53.187546 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 01:17:53.188420 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 01:17:53.188420 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:53.188420 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:17:53.188420 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 344/693] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:17:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 01:17:53.189070 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b45bf4a-fea1-446a-9a89-029abba9ac36 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:53.189070 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b45bf4a-fea1-446a-9a89-029abba9ac36 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:53.189228 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b45bf4a-fea1-446a-9a89-029abba9ac36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:53.212812 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-9b45bf4a-fea1-446a-9a89-029abba9ac36 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:17:53.214045 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-9b45bf4a-fea1-446a-9a89-029abba9ac36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:17:53.287813 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaaa6b2-dea6-42e0-b68f-eba9f3bae2ce None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:53.302401 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 345/694] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:17:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 01:17:53.302401 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b45bf4a-fea1-446a-9a89-029abba9ac36 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:53.370863 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd0d3a5-801c-4be0-8f74-4bfb2e509363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:53.371516 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd0d3a5-801c-4be0-8f74-4bfb2e509363 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:53.371791 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd0d3a5-801c-4be0-8f74-4bfb2e509363 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:53.372057 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd0d3a5-801c-4be0-8f74-4bfb2e509363 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:53.387186 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd0d3a5-801c-4be0-8f74-4bfb2e509363 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:53.388642 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd0d3a5-801c-4be0-8f74-4bfb2e509363 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:53.390354 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:53.412133 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-1fd0d3a5-801c-4be0-8f74-4bfb2e509363 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 01:17:53.412133 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:53.412133 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:53.412133 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:53.412133 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:53.412133 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:53.412133 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:53.412133 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:53.412133 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:53.412133 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:53.412133 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:53.412133 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:53.412133 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 01:17:53.412133 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 01:17:53.412133 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 01:17:53.413136 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 01:17:53.413136 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:53.413136 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:53.413136 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:53.413136 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:53.413136 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:53.413136 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:53.413136 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:53.413136 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:53.413136 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:53.413136 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:53.413136 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:53.413136 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:53.413136 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:53.413136 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:53.413136 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:53.413136 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:53.414000 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 01:17:53.414000 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 01:17:53.414000 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 01:17:53.414000 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 01:17:53.414000 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 01:17:53.414000 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 01:17:53.414000 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 01:17:53.414000 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:17:53.419982 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 350/695] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 01:17:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:53.421008 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd0d3a5-801c-4be0-8f74-4bfb2e509363 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:53.439959 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b45bf4a-fea1-446a-9a89-029abba9ac36 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:53.504564 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbb1888-5463-4fb1-9b51-c6c974c2ce35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:53.505411 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb1888-5463-4fb1-9b51-c6c974c2ce35 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:53.505822 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb1888-5463-4fb1-9b51-c6c974c2ce35 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:53.506257 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb1888-5463-4fb1-9b51-c6c974c2ce35 None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:53.507568 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbb1888-5463-4fb1-9b51-c6c974c2ce35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:53.508002 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbb1888-5463-4fb1-9b51-c6c974c2ce35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:53.509556 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbb1888-5463-4fb1-9b51-c6c974c2ce35 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:53.522190 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 346/696] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 01:17:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:53.527828 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbb1888-5463-4fb1-9b51-c6c974c2ce35 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:53.539237 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:53.613226 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd0d3a5-801c-4be0-8f74-4bfb2e509363 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:53.657954 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3553644-d463-47d0-a3d7-4cb241d2bcae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:53.658602 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3553644-d463-47d0-a3d7-4cb241d2bcae None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:53.658877 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3553644-d463-47d0-a3d7-4cb241d2bcae None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:53.659147 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3553644-d463-47d0-a3d7-4cb241d2bcae None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:53.659841 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3553644-d463-47d0-a3d7-4cb241d2bcae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:53.660142 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3553644-d463-47d0-a3d7-4cb241d2bcae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:53.661707 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3553644-d463-47d0-a3d7-4cb241d2bcae None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:53.665422 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbb1888-5463-4fb1-9b51-c6c974c2ce35 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:53.674861 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 351/697] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Aug 12 01:17:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:17:53.675689 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3553644-d463-47d0-a3d7-4cb241d2bcae None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:53.705260 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:53.712637 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd456e3-95a3-49b0-b751-0ef6fc9a31ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:53.713623 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd456e3-95a3-49b0-b751-0ef6fc9a31ac None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:53.714324 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd456e3-95a3-49b0-b751-0ef6fc9a31ac None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:53.714780 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd456e3-95a3-49b0-b751-0ef6fc9a31ac None admin] PATH_INFO: `/v3/users/nova` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:53.725511 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd456e3-95a3-49b0-b751-0ef6fc9a31ac None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:53.727098 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd456e3-95a3-49b0-b751-0ef6fc9a31ac None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:53.742599 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-8bd456e3-95a3-49b0-b751-0ef6fc9a31ac None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 12 01:17:53.742599 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:53.742599 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:53.742599 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:53.742599 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:53.742599 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:53.742599 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:53.742599 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:53.742599 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:53.742599 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:53.742599 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:53.742599 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:53.742599 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 01:17:53.742599 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 01:17:53.742599 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 01:17:53.742599 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 01:17:53.743758 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:53.743758 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:53.743758 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 01:17:53.743758 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 01:17:53.743758 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 01:17:53.743758 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 01:17:53.743758 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:53.743758 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:53.743758 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:53.743758 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:53.743758 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:53.743758 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:53.743758 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:53.743758 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:53.743758 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:53.743758 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:53.743758 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:53.743758 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:53.744911 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:53.744911 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:53.744911 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 01:17:53.744911 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 01:17:53.744911 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 01:17:53.744911 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 01:17:53.744911 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 01:17:53.744911 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 01:17:53.744911 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 12 01:17:53.744911 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:17:53.752315 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 347/698] 10.222.0.26 () {56 vars in 1093 bytes} [Fri Aug 12 01:17:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 01:17:53.752315 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd456e3-95a3-49b0-b751-0ef6fc9a31ac None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:53.799790 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3553644-d463-47d0-a3d7-4cb241d2bcae None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:53.818846 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:53.839750 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec083b5-ba36-4304-8eb1-bbd5eec40880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:53.840857 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec083b5-ba36-4304-8eb1-bbd5eec40880 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:53.841418 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec083b5-ba36-4304-8eb1-bbd5eec40880 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:53.841886 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec083b5-ba36-4304-8eb1-bbd5eec40880 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:53.853688 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec083b5-ba36-4304-8eb1-bbd5eec40880 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:53.855623 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec083b5-ba36-4304-8eb1-bbd5eec40880 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:53.859904 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd456e3-95a3-49b0-b751-0ef6fc9a31ac None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:53.872254 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-0ec083b5-ba36-4304-8eb1-bbd5eec40880 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:53.872254 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:53.872254 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:53.872254 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:53.872254 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:53.872254 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:53.872254 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:53.872254 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:53.872254 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:53.872254 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:53.872254 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:53.872254 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:53.872254 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 01:17:53.872254 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 01:17:53.872254 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 01:17:53.872254 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 01:17:53.873213 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:53.873213 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:53.873213 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:53.873213 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:53.873213 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:53.873213 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:53.873213 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:53.873213 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:53.873213 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:53.873213 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:53.873213 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:53.873213 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:53.873213 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:53.873213 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:53.873213 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:53.873213 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:53.873213 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 01:17:53.874574 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 01:17:53.874574 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:53.874574 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:17:53.876438 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 352/699] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:17:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:53.877588 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec083b5-ba36-4304-8eb1-bbd5eec40880 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:53.895007 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106beee1-35da-4cd5-a623-d3fdc55f737f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:53.895435 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106beee1-35da-4cd5-a623-d3fdc55f737f None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:53.895714 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106beee1-35da-4cd5-a623-d3fdc55f737f None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:53.895981 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106beee1-35da-4cd5-a623-d3fdc55f737f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:53.896710 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106beee1-35da-4cd5-a623-d3fdc55f737f None admin] RBAC: Adding query filter params (role.id=90d1ca7df8de4b03a689afc664d0cc3f, scope.project.id=fa91143910a74c6b896ced5b51f9966a, user.id=32c1ba237f864b5d9699cb817e42e647) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:53.897030 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106beee1-35da-4cd5-a623-d3fdc55f737f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:53.898451 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106beee1-35da-4cd5-a623-d3fdc55f737f None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:53.910154 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 348/700] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 01:17:53 2022] GET /identity/v3/role_assignments?user.id=32c1ba237f864b5d9699cb817e42e647&scope.project.id=fa91143910a74c6b896ced5b51f9966a&role.id=90d1ca7df8de4b03a689afc664d0cc3f => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:53.910154 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106beee1-35da-4cd5-a623-d3fdc55f737f None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:54.020557 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec083b5-ba36-4304-8eb1-bbd5eec40880 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:54.052399 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:54.082099 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3918d6-4c96-43e4-bf5c-1b728a8cc87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:54.083371 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3918d6-4c96-43e4-bf5c-1b728a8cc87c None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:54.085215 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3918d6-4c96-43e4-bf5c-1b728a8cc87c None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:54.085485 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3918d6-4c96-43e4-bf5c-1b728a8cc87c None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:54.087039 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3918d6-4c96-43e4-bf5c-1b728a8cc87c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:54.087039 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3918d6-4c96-43e4-bf5c-1b728a8cc87c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:54.090282 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3918d6-4c96-43e4-bf5c-1b728a8cc87c None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:54.107885 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 353/701] 10.222.0.26 () {56 vars in 1133 bytes} [Fri Aug 12 01:17:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:54.114568 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3918d6-4c96-43e4-bf5c-1b728a8cc87c None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:54.128842 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106beee1-35da-4cd5-a623-d3fdc55f737f None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:54.151390 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:54.172562 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7308792b-fa20-4d44-9b7c-68ebcff44449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:54.173247 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7308792b-fa20-4d44-9b7c-68ebcff44449 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:54.173610 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7308792b-fa20-4d44-9b7c-68ebcff44449 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:54.173966 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7308792b-fa20-4d44-9b7c-68ebcff44449 None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:54.174746 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7308792b-fa20-4d44-9b7c-68ebcff44449 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:54.175132 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7308792b-fa20-4d44-9b7c-68ebcff44449 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:54.176932 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7308792b-fa20-4d44-9b7c-68ebcff44449 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:54.191895 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 349/702] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 01:17:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:54.197300 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7308792b-fa20-4d44-9b7c-68ebcff44449 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:54.244993 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3918d6-4c96-43e4-bf5c-1b728a8cc87c None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:54.287423 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593f00f1-9028-49b4-9046-35745a9f58ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:54.288036 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f00f1-9028-49b4-9046-35745a9f58ce None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:54.288305 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f00f1-9028-49b4-9046-35745a9f58ce None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:54.288565 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f00f1-9028-49b4-9046-35745a9f58ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:54.323987 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7308792b-fa20-4d44-9b7c-68ebcff44449 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:54.338826 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:54.362014 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf81c0c2-240c-4df9-9fc7-a8842767b5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:54.362803 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81c0c2-240c-4df9-9fc7-a8842767b5f1 None admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:54.363379 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81c0c2-240c-4df9-9fc7-a8842767b5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:54.364135 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81c0c2-240c-4df9-9fc7-a8842767b5f1 None admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:54.364786 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf81c0c2-240c-4df9-9fc7-a8842767b5f1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:54.366753 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf81c0c2-240c-4df9-9fc7-a8842767b5f1 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:54.372699 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593f00f1-9028-49b4-9046-35745a9f58ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:54.374195 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593f00f1-9028-49b4-9046-35745a9f58ce None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:54.391571 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 350/703] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Aug 12 01:17:54 2022] POST /identity/v3/users => generated 254 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 01:17:54.392723 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5019a8da-cea3-4968-abc5-3605a5771b5a None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:54.393088 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5019a8da-cea3-4968-abc5-3605a5771b5a None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:54.393369 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5019a8da-cea3-4968-abc5-3605a5771b5a None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:54.394758 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 351/704] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:17:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:17:54.395962 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a50de-bb3e-48a0-a9d2-c8387d7cbf7f None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:54.396240 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a50de-bb3e-48a0-a9d2-c8387d7cbf7f None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:54.396508 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a50de-bb3e-48a0-a9d2-c8387d7cbf7f None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:54.397921 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 352/705] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:17:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:17:54.403491 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6198333e-5985-4217-aafa-a91ec17479d8 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:54.403773 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6198333e-5985-4217-aafa-a91ec17479d8 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:54.404047 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6198333e-5985-4217-aafa-a91ec17479d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:54.426234 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:54.428289 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-6198333e-5985-4217-aafa-a91ec17479d8 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:17:54.429581 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-6198333e-5985-4217-aafa-a91ec17479d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:17:54.509329 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 354/706] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 01:17:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 12 01:17:54.511101 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa61f60-9d24-44ad-8a0d-6494fd00b0e4 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:54.511608 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa61f60-9d24-44ad-8a0d-6494fd00b0e4 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:54.511944 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa61f60-9d24-44ad-8a0d-6494fd00b0e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:54.535038 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-0aa61f60-9d24-44ad-8a0d-6494fd00b0e4 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:17:54.535038 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-0aa61f60-9d24-44ad-8a0d-6494fd00b0e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:17:54.535303 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 353/707] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:17:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 01:17:54.535303 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6198333e-5985-4217-aafa-a91ec17479d8 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:54.628064 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 355/708] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:17:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 01:17:54.661937 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:54.667600 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6198333e-5985-4217-aafa-a91ec17479d8 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:54.704229 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6319f2-9a18-4d1b-b55b-7052b742cda5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:54.704861 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6319f2-9a18-4d1b-b55b-7052b742cda5 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:54.705134 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6319f2-9a18-4d1b-b55b-7052b742cda5 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:54.705398 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6319f2-9a18-4d1b-b55b-7052b742cda5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:54.716205 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6319f2-9a18-4d1b-b55b-7052b742cda5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:54.717686 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6319f2-9a18-4d1b-b55b-7052b742cda5 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:54.732401 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-fd6319f2-9a18-4d1b-b55b-7052b742cda5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:54.732401 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:54.732401 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:54.732401 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:54.732401 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:54.732401 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:54.732401 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:54.732401 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:54.732401 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:54.732401 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:54.732401 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:54.732401 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:54.732401 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 01:17:54.732401 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 01:17:54.732401 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 01:17:54.732401 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 01:17:54.733356 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:54.733356 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:54.733356 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:54.733356 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:54.733356 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:54.733356 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:54.733356 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:54.733356 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:54.733356 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:54.733356 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:54.733356 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:54.733356 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:54.733356 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:54.733356 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:54.733356 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:54.733356 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:54.733356 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 01:17:54.734270 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 01:17:54.734270 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:54.734270 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:17:54.734270 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 354/709] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:17:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:54.739639 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa61f60-9d24-44ad-8a0d-6494fd00b0e4 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:54.798654 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:54.828995 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6319f2-9a18-4d1b-b55b-7052b742cda5 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:54.852690 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa61f60-9d24-44ad-8a0d-6494fd00b0e4 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:54.911285 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e758d8b-6edc-4c3e-939a-bb84ce65f092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:54.912262 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e758d8b-6edc-4c3e-939a-bb84ce65f092 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:54.912738 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e758d8b-6edc-4c3e-939a-bb84ce65f092 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:54.913199 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e758d8b-6edc-4c3e-939a-bb84ce65f092 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:54.914040 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e758d8b-6edc-4c3e-939a-bb84ce65f092 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:54.914591 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e758d8b-6edc-4c3e-939a-bb84ce65f092 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:54.917702 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e758d8b-6edc-4c3e-939a-bb84ce65f092 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:54.939593 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 356/710] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 01:17:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:54.940802 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e758d8b-6edc-4c3e-939a-bb84ce65f092 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:54.984154 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6319f2-9a18-4d1b-b55b-7052b742cda5 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:55.018637 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1288e7-c9c4-4f72-b1fc-eb8d9c332073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:55.019628 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1288e7-c9c4-4f72-b1fc-eb8d9c332073 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:55.020252 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1288e7-c9c4-4f72-b1fc-eb8d9c332073 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:55.020742 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1288e7-c9c4-4f72-b1fc-eb8d9c332073 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:55.021523 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1288e7-c9c4-4f72-b1fc-eb8d9c332073 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:55.023139 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1288e7-c9c4-4f72-b1fc-eb8d9c332073 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:55.034658 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-bf1288e7-c9c4-4f72-b1fc-eb8d9c332073 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 12 01:17:55.034658 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:55.034658 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 01:17:55.034658 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 01:17:55.034658 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 01:17:55.034658 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 01:17:55.034658 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 01:17:55.034658 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 01:17:55.034658 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 12 01:17:55.034658 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:17:55.034658 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 01:17:55.034658 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:17:55.034658 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:55.034658 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:55.034658 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:55.034658 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:55.034658 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:55.035789 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:55.035789 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:55.035789 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:55.035789 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:55.035789 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:55.035789 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:55.035789 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 01:17:55.035789 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 01:17:55.035789 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 01:17:55.035789 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 01:17:55.035789 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:55.035789 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:55.035789 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:55.035789 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:55.035789 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:55.035789 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:55.036635 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:55.036635 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:55.036635 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:55.036635 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:55.036635 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:55.036635 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:55.036635 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:55.036635 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:55.036635 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:55.036635 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:55.036635 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 01:17:55.036635 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 01:17:55.036635 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 12 01:17:55.036635 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:17:55.044355 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 355/711] 10.222.0.26 () {56 vars in 1129 bytes} [Fri Aug 12 01:17:54 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 01:17:55.045448 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1288e7-c9c4-4f72-b1fc-eb8d9c332073 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:55.050469 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e758d8b-6edc-4c3e-939a-bb84ce65f092 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:55.065194 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:55.070080 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:55.090273 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be6f14e-b607-4878-8230-95123778de3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:55.090916 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be6f14e-b607-4878-8230-95123778de3c None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:55.091193 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be6f14e-b607-4878-8230-95123778de3c None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:55.091463 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be6f14e-b607-4878-8230-95123778de3c None admin] PATH_INFO: `/v3/services/network` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:55.092050 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be6f14e-b607-4878-8230-95123778de3c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:55.093621 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be6f14e-b607-4878-8230-95123778de3c None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:55.105562 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-3be6f14e-b607-4878-8230-95123778de3c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 12 01:17:55.105562 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:55.105562 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 01:17:55.105562 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 01:17:55.105562 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 01:17:55.105562 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 01:17:55.105562 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 01:17:55.105562 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 01:17:55.105562 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 12 01:17:55.105562 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:17:55.105562 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 01:17:55.105562 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:17:55.105562 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:55.105562 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:55.105562 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:55.105562 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:55.105562 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:55.106604 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:55.106604 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:55.106604 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:55.106604 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:55.106604 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:55.106604 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:55.106604 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 01:17:55.106604 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 01:17:55.106604 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 01:17:55.106604 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 01:17:55.106604 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:55.106604 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:55.106604 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:55.106604 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:55.106604 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:55.106604 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:55.107815 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:55.107815 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:55.107815 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:55.107815 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:55.107815 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:55.107815 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:55.107815 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:55.107815 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:55.107815 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:55.107815 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:55.107815 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 01:17:55.107815 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 01:17:55.107815 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 12 01:17:55.107815 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:17:55.107815 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 357/712] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 01:17:54 2022] GET /identity/v3/services/network => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:55.108625 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be6f14e-b607-4878-8230-95123778de3c None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:55.155233 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1288e7-c9c4-4f72-b1fc-eb8d9c332073 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:55.191669 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0becd4-e203-48d9-bb1e-86397835f82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:55.192420 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0becd4-e203-48d9-bb1e-86397835f82e None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:55.193015 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0becd4-e203-48d9-bb1e-86397835f82e None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:55.193108 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0becd4-e203-48d9-bb1e-86397835f82e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:55.200180 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0becd4-e203-48d9-bb1e-86397835f82e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:55.201812 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0becd4-e203-48d9-bb1e-86397835f82e None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:55.213466 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-3a0becd4-e203-48d9-bb1e-86397835f82e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 01:17:55.213466 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:55.213466 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:55.213466 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:55.213466 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:55.213466 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:55.213466 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:55.213466 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:55.213466 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:55.213466 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:55.213466 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:55.213466 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:55.213466 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 01:17:55.213466 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 01:17:55.213466 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 01:17:55.214699 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 01:17:55.214699 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:55.214699 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:55.214699 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:55.214699 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:55.214699 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:55.214699 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:55.214699 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:55.214699 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:55.214699 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:55.214699 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:55.214699 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:55.214699 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:55.214699 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:55.214699 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:55.214699 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:55.214699 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:55.215642 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 01:17:55.215642 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 01:17:55.215642 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 01:17:55.215642 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 01:17:55.215642 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 01:17:55.215642 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 01:17:55.215642 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 01:17:55.215642 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:17:55.215642 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 356/713] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 01:17:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:55.216597 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0becd4-e203-48d9-bb1e-86397835f82e None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:55.231499 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be6f14e-b607-4878-8230-95123778de3c None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:55.279708 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d700db-af85-4be0-993e-63e15ae07a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:55.280314 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d700db-af85-4be0-993e-63e15ae07a78 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:55.280583 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d700db-af85-4be0-993e-63e15ae07a78 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:55.280845 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d700db-af85-4be0-993e-63e15ae07a78 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:55.281599 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d700db-af85-4be0-993e-63e15ae07a78 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:55.281918 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d700db-af85-4be0-993e-63e15ae07a78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:55.283369 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d700db-af85-4be0-993e-63e15ae07a78 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:55.288557 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 358/714] 10.222.0.26 () {56 vars in 1124 bytes} [Fri Aug 12 01:17:55 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:55.289425 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d700db-af85-4be0-993e-63e15ae07a78 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:55.309164 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:55.334153 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0becd4-e203-48d9-bb1e-86397835f82e None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:55.342470 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:55.369177 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db97a515-5522-4b43-8b28-6bd9144a32e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:55.369646 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db97a515-5522-4b43-8b28-6bd9144a32e6 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:55.369925 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db97a515-5522-4b43-8b28-6bd9144a32e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:55.370225 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db97a515-5522-4b43-8b28-6bd9144a32e6 None admin] PATH_INFO: `/v3/services` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:55.370864 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db97a515-5522-4b43-8b28-6bd9144a32e6 None admin] RBAC: Adding query filter params (name=network) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:55.371167 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db97a515-5522-4b43-8b28-6bd9144a32e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:55.372538 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db97a515-5522-4b43-8b28-6bd9144a32e6 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:55.377458 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 357/715] 10.222.0.26 () {56 vars in 1112 bytes} [Fri Aug 12 01:17:55 2022] GET /identity/v3/services?name=network => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:55.378326 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db97a515-5522-4b43-8b28-6bd9144a32e6 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:55.396457 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d700db-af85-4be0-993e-63e15ae07a78 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:55.432214 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f2d996-02fb-42c7-a244-54af8fef1b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:55.433149 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f2d996-02fb-42c7-a244-54af8fef1b27 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:55.433613 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f2d996-02fb-42c7-a244-54af8fef1b27 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:55.434069 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f2d996-02fb-42c7-a244-54af8fef1b27 None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:55.435113 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f2d996-02fb-42c7-a244-54af8fef1b27 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:55.435603 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f2d996-02fb-42c7-a244-54af8fef1b27 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:55.437357 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f2d996-02fb-42c7-a244-54af8fef1b27 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:55.455370 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 359/716] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Aug 12 01:17:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:55.456629 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f2d996-02fb-42c7-a244-54af8fef1b27 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:55.482494 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db97a515-5522-4b43-8b28-6bd9144a32e6 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:55.518277 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f247069d-5d4f-4902-bc4b-2c16a141e77b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:55.519046 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247069d-5d4f-4902-bc4b-2c16a141e77b None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:55.519757 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247069d-5d4f-4902-bc4b-2c16a141e77b None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:55.519962 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247069d-5d4f-4902-bc4b-2c16a141e77b None admin] PATH_INFO: `/v3/services` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:55.520818 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f247069d-5d4f-4902-bc4b-2c16a141e77b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:55.521217 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f247069d-5d4f-4902-bc4b-2c16a141e77b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:55.522718 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f247069d-5d4f-4902-bc4b-2c16a141e77b None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:55.534277 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 358/717] 10.222.0.26 () {56 vars in 1124 bytes} [Fri Aug 12 01:17:55 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:55.535476 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f247069d-5d4f-4902-bc4b-2c16a141e77b None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:55.539496 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:55.598596 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f2d996-02fb-42c7-a244-54af8fef1b27 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:55.618513 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:55.674830 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29557916-be61-453c-b32c-2f2b269f70dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:55.675478 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29557916-be61-453c-b32c-2f2b269f70dd None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:55.675715 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29557916-be61-453c-b32c-2f2b269f70dd None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:55.676040 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29557916-be61-453c-b32c-2f2b269f70dd None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:55.677214 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29557916-be61-453c-b32c-2f2b269f70dd None admin] RBAC: Adding query filter params (type=network) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:55.677514 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29557916-be61-453c-b32c-2f2b269f70dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:55.678969 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29557916-be61-453c-b32c-2f2b269f70dd None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:55.685781 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 360/718] 10.222.0.26 () {56 vars in 1112 bytes} [Fri Aug 12 01:17:55 2022] GET /identity/v3/services?type=network => generated 124 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:55.725663 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f247069d-5d4f-4902-bc4b-2c16a141e77b None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:55.769001 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5925c2af-a6a1-4a1a-acae-4d6becf11efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:55.769665 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925c2af-a6a1-4a1a-acae-4d6becf11efb None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:55.769944 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925c2af-a6a1-4a1a-acae-4d6becf11efb None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:55.770247 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925c2af-a6a1-4a1a-acae-4d6becf11efb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:55.771003 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5925c2af-a6a1-4a1a-acae-4d6becf11efb None admin] RBAC: Adding query filter params (role.id=fb48693810be495fb4b1893a79429b78, scope.project.id=fa91143910a74c6b896ced5b51f9966a, user.id=fcd5e95467b44175be2478c2c7c89926) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:55.771308 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5925c2af-a6a1-4a1a-acae-4d6becf11efb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:55.772774 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5925c2af-a6a1-4a1a-acae-4d6becf11efb None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:55.779810 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 359/719] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 01:17:55 2022] GET /identity/v3/role_assignments?user.id=fcd5e95467b44175be2478c2c7c89926&scope.project.id=fa91143910a74c6b896ced5b51f9966a&role.id=fb48693810be495fb4b1893a79429b78 => generated 259 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:56.115863 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f72824-38cb-4840-988c-22e15643edaa None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:56.116143 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f72824-38cb-4840-988c-22e15643edaa None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:56.116407 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f72824-38cb-4840-988c-22e15643edaa None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:56.117991 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 361/720] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:17:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:17:56.136113 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b32a3-1aa3-4acd-a970-4b36516a70ad None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:56.136613 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b32a3-1aa3-4acd-a970-4b36516a70ad None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:56.136888 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b32a3-1aa3-4acd-a970-4b36516a70ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:56.163421 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-0c9b32a3-1aa3-4acd-a970-4b36516a70ad None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:17:56.164785 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-0c9b32a3-1aa3-4acd-a970-4b36516a70ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:17:56.246341 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:56.251795 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 360/721] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:17:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 01:17:56.719790 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f72824-38cb-4840-988c-22e15643edaa None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:56.830659 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f72824-38cb-4840-988c-22e15643edaa None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:56.865909 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52441a58-0cee-4fae-9dc9-692477682da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:56.866574 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52441a58-0cee-4fae-9dc9-692477682da0 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:56.867010 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52441a58-0cee-4fae-9dc9-692477682da0 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:56.867274 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52441a58-0cee-4fae-9dc9-692477682da0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:56.868427 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dfe4f6-7443-4e69-903f-ae05e6ad9241 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:56.868903 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dfe4f6-7443-4e69-903f-ae05e6ad9241 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:56.869363 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dfe4f6-7443-4e69-903f-ae05e6ad9241 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:56.871157 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 361/722] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:17:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:17:56.876382 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3f10c-3758-4583-8be8-fe33d3208df0 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:56.876906 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3f10c-3758-4583-8be8-fe33d3208df0 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:56.877375 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3f10c-3758-4583-8be8-fe33d3208df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:56.878053 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52441a58-0cee-4fae-9dc9-692477682da0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:17:56.888219 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-52441a58-0cee-4fae-9dc9-692477682da0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 01:17:56.888219 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:56.888219 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:56.888219 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:56.888219 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:56.888219 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:56.888219 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:56.888219 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:56.888219 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:56.888219 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:56.888219 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:56.888219 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:56.888219 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:17:56.888219 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:17:56.888219 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:17:56.888219 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:17:56.889162 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:17:56.889162 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:17:56.889162 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:17:56.889162 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:17:56.889162 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:56.889162 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:56.889162 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:56.889162 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:56.889162 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:56.889162 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:56.889162 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:56.889162 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:56.889162 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:56.889162 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:56.889162 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:56.889162 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:56.889995 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:56.889995 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:56.889995 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:56.889995 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:56.889995 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:17:56.889995 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:17:56.889995 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:17:56.889995 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:17:56.889995 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:17:56.889995 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:17:56.889995 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 01:17:56.889995 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:17:56.889995 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 362/723] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Aug 12 01:17:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:56.897473 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52441a58-0cee-4fae-9dc9-692477682da0 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:56.920295 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-bce3f10c-3758-4583-8be8-fe33d3208df0 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:17:56.921478 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-bce3f10c-3758-4583-8be8-fe33d3208df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:17:56.969278 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:57.036942 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 362/724] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:17:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 12 01:17:57.037145 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52441a58-0cee-4fae-9dc9-692477682da0 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:57.085552 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a05e43-5443-4866-ab3f-99d1166cc594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:57.086086 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a05e43-5443-4866-ab3f-99d1166cc594 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:57.086379 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a05e43-5443-4866-ab3f-99d1166cc594 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:57.086645 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a05e43-5443-4866-ab3f-99d1166cc594 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:57.087312 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a05e43-5443-4866-ab3f-99d1166cc594 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:57.087611 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a05e43-5443-4866-ab3f-99d1166cc594 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:57.088976 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a05e43-5443-4866-ab3f-99d1166cc594 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:57.102659 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 363/725] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 01:17:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:57.103628 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce3f10c-3758-4583-8be8-fe33d3208df0 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:57.224135 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce3f10c-3758-4583-8be8-fe33d3208df0 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:57.254475 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:57.263023 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b36b6-fb3c-4647-b5a0-b3e97c2219b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:57.263702 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b36b6-fb3c-4647-b5a0-b3e97c2219b9 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:57.263978 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b36b6-fb3c-4647-b5a0-b3e97c2219b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:57.264245 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b36b6-fb3c-4647-b5a0-b3e97c2219b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:57.275332 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480b36b6-fb3c-4647-b5a0-b3e97c2219b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:57.276829 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480b36b6-fb3c-4647-b5a0-b3e97c2219b9 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:57.292000 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-480b36b6-fb3c-4647-b5a0-b3e97c2219b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:57.292000 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:57.292000 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:57.292000 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:57.292000 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:57.292000 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:57.292000 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:57.292000 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:57.292000 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:57.292000 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:57.292000 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:57.292000 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:57.292000 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 01:17:57.292000 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 01:17:57.292000 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 01:17:57.292000 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 01:17:57.293016 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:57.293016 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:57.293016 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:57.293016 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:57.293016 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:57.293016 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:57.293016 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:57.293016 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:57.293016 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:57.293016 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:57.293016 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:57.293016 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:57.293016 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:57.293016 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:57.293016 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:57.293016 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:57.293016 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 01:17:57.293899 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 01:17:57.293899 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:57.293899 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:17:57.293899 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 363/726] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:17:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:57.300304 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a05e43-5443-4866-ab3f-99d1166cc594 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:57.388718 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b36b6-fb3c-4647-b5a0-b3e97c2219b9 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:57.423074 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:57.433233 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a05e43-5443-4866-ab3f-99d1166cc594 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:57.509369 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b36b6-fb3c-4647-b5a0-b3e97c2219b9 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:57.545616 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcbcfca-606d-4eed-813b-958435e7ab38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:57.546308 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcbcfca-606d-4eed-813b-958435e7ab38 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:57.546589 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcbcfca-606d-4eed-813b-958435e7ab38 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:57.546864 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcbcfca-606d-4eed-813b-958435e7ab38 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:57.554857 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326e986d-3579-432e-be5d-8595dc6c6219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:57.555806 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e986d-3579-432e-be5d-8595dc6c6219 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:57.556283 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e986d-3579-432e-be5d-8595dc6c6219 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:57.556765 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e986d-3579-432e-be5d-8595dc6c6219 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:57.557625 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326e986d-3579-432e-be5d-8595dc6c6219 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:57.558010 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcbcfca-606d-4eed-813b-958435e7ab38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:17:57.558374 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326e986d-3579-432e-be5d-8595dc6c6219 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:57.559952 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326e986d-3579-432e-be5d-8595dc6c6219 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:57.564509 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-8bcbcfca-606d-4eed-813b-958435e7ab38 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 01:17:57.564509 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:57.564509 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:57.564509 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:57.564509 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:57.564509 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:57.564509 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:57.564509 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:57.564509 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:57.564509 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:57.564509 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:57.564509 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:57.564509 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:17:57.564509 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:17:57.564509 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:17:57.564509 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:17:57.565456 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:17:57.565456 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:17:57.565456 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:17:57.565456 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:17:57.565456 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:57.565456 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:57.565456 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:57.565456 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:57.565456 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:57.565456 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:57.565456 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:57.565456 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:57.565456 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:57.565456 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:57.565456 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:57.565456 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:57.566304 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:57.566304 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:57.566304 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:57.566304 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:57.566304 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:17:57.566304 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:17:57.566304 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:17:57.566304 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:17:57.566304 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:17:57.566304 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:17:57.566304 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 01:17:57.566304 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:17:57.566304 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 364/727] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Aug 12 01:17:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 01:17:57.574189 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcbcfca-606d-4eed-813b-958435e7ab38 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:57.587373 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 364/728] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 01:17:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:57.592980 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326e986d-3579-432e-be5d-8595dc6c6219 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:57.618483 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:57.680206 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcbcfca-606d-4eed-813b-958435e7ab38 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:57.715152 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226175d1-289f-4e39-9aea-64ed626a9d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:57.715887 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226175d1-289f-4e39-9aea-64ed626a9d35 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:57.716170 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226175d1-289f-4e39-9aea-64ed626a9d35 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:57.716451 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226175d1-289f-4e39-9aea-64ed626a9d35 None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:57.717127 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226175d1-289f-4e39-9aea-64ed626a9d35 None admin] RBAC: Adding query filter params (name=service) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:57.717435 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226175d1-289f-4e39-9aea-64ed626a9d35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:57.718903 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226175d1-289f-4e39-9aea-64ed626a9d35 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:57.728293 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 365/729] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Aug 12 01:17:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:57.733635 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226175d1-289f-4e39-9aea-64ed626a9d35 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:57.786589 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326e986d-3579-432e-be5d-8595dc6c6219 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:57.822791 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913ae110-729d-49c0-addd-75e2ff352182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:57.823528 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913ae110-729d-49c0-addd-75e2ff352182 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:57.823878 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913ae110-729d-49c0-addd-75e2ff352182 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:57.824215 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913ae110-729d-49c0-addd-75e2ff352182 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:57.834826 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913ae110-729d-49c0-addd-75e2ff352182 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:57.836391 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913ae110-729d-49c0-addd-75e2ff352182 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:57.846305 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226175d1-289f-4e39-9aea-64ed626a9d35 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:57.848922 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-913ae110-729d-49c0-addd-75e2ff352182 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 12 01:17:57.848922 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:57.848922 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:57.848922 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:57.848922 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:57.848922 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:57.848922 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:57.848922 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:57.848922 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:57.848922 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:57.848922 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:57.848922 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:57.848922 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 01:17:57.848922 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 01:17:57.848922 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 01:17:57.848922 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 01:17:57.849805 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:57.849805 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:57.849805 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 01:17:57.849805 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 01:17:57.849805 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 01:17:57.849805 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 01:17:57.849805 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:57.849805 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:57.849805 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:57.849805 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:57.849805 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:57.849805 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:57.849805 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:57.849805 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:57.849805 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:57.849805 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:57.849805 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:57.849805 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:57.850757 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:57.850757 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:57.850757 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 01:17:57.850757 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 01:17:57.850757 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 01:17:57.850757 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 01:17:57.850757 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 01:17:57.850757 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 01:17:57.850757 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 12 01:17:57.850757 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:17:57.854605 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 365/730] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Aug 12 01:17:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 01:17:57.855976 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff7943d-e6fe-49da-8839-ba75799d1e73 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:57.856337 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff7943d-e6fe-49da-8839-ba75799d1e73 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:57.856524 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:57.856671 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff7943d-e6fe-49da-8839-ba75799d1e73 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:57.862553 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 366/731] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:17:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:17:57.862553 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff7943d-e6fe-49da-8839-ba75799d1e73 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:57.878604 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:57.892099 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750ae88f-8b80-490f-8cca-97b22eed73b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:57.892738 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ae88f-8b80-490f-8cca-97b22eed73b3 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:57.893011 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ae88f-8b80-490f-8cca-97b22eed73b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:57.893720 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ae88f-8b80-490f-8cca-97b22eed73b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:57.907417 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750ae88f-8b80-490f-8cca-97b22eed73b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:57.909025 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750ae88f-8b80-490f-8cca-97b22eed73b3 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:57.926310 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-750ae88f-8b80-490f-8cca-97b22eed73b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:57.926310 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:57.926310 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:57.926310 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:57.926310 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:57.926310 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:57.926310 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:57.926310 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:57.926310 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:57.926310 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:57.926310 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:57.926310 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:57.926310 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 01:17:57.926310 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 01:17:57.926310 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 01:17:57.926310 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 01:17:57.927315 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:57.927315 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:57.927315 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:57.927315 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:57.927315 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:57.927315 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:57.927315 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:57.927315 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:57.927315 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:57.927315 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:57.927315 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:57.927315 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:57.927315 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:57.927315 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:57.927315 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:57.927315 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:57.927315 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 01:17:57.928204 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 01:17:57.928204 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:57.928204 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:17:57.930616 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 366/732] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:17:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:57.932135 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e268536-1407-4eff-bc59-7615395177a9 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:57.932615 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e268536-1407-4eff-bc59-7615395177a9 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:57.933092 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e268536-1407-4eff-bc59-7615395177a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:57.957948 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-3e268536-1407-4eff-bc59-7615395177a9 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:17:57.959715 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-3e268536-1407-4eff-bc59-7615395177a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:17:57.992578 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff7943d-e6fe-49da-8839-ba75799d1e73 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:58.028894 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e136b81-7815-4e97-8328-16b8f0e5811d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:58.029507 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e136b81-7815-4e97-8328-16b8f0e5811d None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:58.029787 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e136b81-7815-4e97-8328-16b8f0e5811d None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:58.030060 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e136b81-7815-4e97-8328-16b8f0e5811d None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:58.030823 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e136b81-7815-4e97-8328-16b8f0e5811d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:58.031130 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e136b81-7815-4e97-8328-16b8f0e5811d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:58.032562 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e136b81-7815-4e97-8328-16b8f0e5811d None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:58.040247 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 367/733] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:17:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 01:17:58.041927 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e268536-1407-4eff-bc59-7615395177a9 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:58.051284 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 367/734] 10.222.0.26 () {56 vars in 1135 bytes} [Fri Aug 12 01:17:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:58.057576 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e136b81-7815-4e97-8328-16b8f0e5811d None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:58.132800 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:58.169812 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e136b81-7815-4e97-8328-16b8f0e5811d None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:58.174000 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:58.194318 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e268536-1407-4eff-bc59-7615395177a9 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:58.203571 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f59000a-5144-4c9b-ab01-4e3d7cd0978a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:58.204191 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f59000a-5144-4c9b-ab01-4e3d7cd0978a None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:58.204462 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f59000a-5144-4c9b-ab01-4e3d7cd0978a None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:58.204732 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f59000a-5144-4c9b-ab01-4e3d7cd0978a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:58.234135 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda497f9-d169-453e-a013-14219c657d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:58.234714 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda497f9-d169-453e-a013-14219c657d44 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:58.234988 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda497f9-d169-453e-a013-14219c657d44 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:58.235392 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda497f9-d169-453e-a013-14219c657d44 None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:58.236045 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda497f9-d169-453e-a013-14219c657d44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:58.236267 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda497f9-d169-453e-a013-14219c657d44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:58.237620 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda497f9-d169-453e-a013-14219c657d44 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:58.250058 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 368/735] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 01:17:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:58.251325 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e57e29b-e9d6-49c7-a5e5-a3ec5ce7cf00 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:58.251603 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e57e29b-e9d6-49c7-a5e5-a3ec5ce7cf00 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:58.251868 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e57e29b-e9d6-49c7-a5e5-a3ec5ce7cf00 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:58.253224 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 369/736] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:17:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:17:58.257473 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde42da-ad4e-4679-992e-145a578ef00b None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:58.257473 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde42da-ad4e-4679-992e-145a578ef00b None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:58.257473 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde42da-ad4e-4679-992e-145a578ef00b None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:58.257473 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 370/737] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:17:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:17:58.257473 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dde42da-ad4e-4679-992e-145a578ef00b None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:58.287021 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f59000a-5144-4c9b-ab01-4e3d7cd0978a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:58.288988 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f59000a-5144-4c9b-ab01-4e3d7cd0978a None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:58.359492 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dde42da-ad4e-4679-992e-145a578ef00b None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:58.360116 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:58.392810 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3cc977-92da-4007-93c3-566f6806fc2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:58.393431 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3cc977-92da-4007-93c3-566f6806fc2b None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:58.393707 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3cc977-92da-4007-93c3-566f6806fc2b None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:58.393974 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3cc977-92da-4007-93c3-566f6806fc2b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:58.394442 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 368/738] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 01:17:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 12 01:17:58.395844 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addebcc6-1606-4dd6-937e-ca2953b78b90 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:58.396139 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addebcc6-1606-4dd6-937e-ca2953b78b90 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:58.396406 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addebcc6-1606-4dd6-937e-ca2953b78b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:58.402136 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3cc977-92da-4007-93c3-566f6806fc2b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:58.403563 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3cc977-92da-4007-93c3-566f6806fc2b None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:58.414076 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-addebcc6-1606-4dd6-937e-ca2953b78b90 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:17:58.414454 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-ce3cc977-92da-4007-93c3-566f6806fc2b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 12 01:17:58.414454 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:58.414454 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:58.414454 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:58.414454 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:58.414454 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:58.414454 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:58.414454 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:58.414454 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:58.414454 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:58.414454 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:58.414454 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:58.414454 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 01:17:58.414454 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 01:17:58.414454 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 01:17:58.414454 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 01:17:58.415337 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:58.415337 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:58.415337 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 01:17:58.415337 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 01:17:58.415337 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 01:17:58.415337 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 01:17:58.415337 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:58.415337 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:58.415337 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:58.415337 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:58.415337 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:58.415337 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:58.415337 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:58.415337 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:58.415337 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:58.415337 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:58.415337 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:58.415337 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:58.416627 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:58.416627 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:58.416627 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 01:17:58.416627 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 01:17:58.416627 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 01:17:58.416627 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 01:17:58.416627 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 01:17:58.416627 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 01:17:58.416627 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 12 01:17:58.416627 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:17:58.417175 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-addebcc6-1606-4dd6-937e-ca2953b78b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:17:58.417246 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 371/739] 10.222.0.26 () {56 vars in 1117 bytes} [Fri Aug 12 01:17:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:58.417246 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb22fd30-a993-4e21-989a-6cfba40ff145 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:58.417246 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb22fd30-a993-4e21-989a-6cfba40ff145 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:58.417621 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb22fd30-a993-4e21-989a-6cfba40ff145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:58.424368 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:58.435460 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-cb22fd30-a993-4e21-989a-6cfba40ff145 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:17:58.436630 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-cb22fd30-a993-4e21-989a-6cfba40ff145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:17:58.492047 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 369/740] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:17:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 01:17:58.492867 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addebcc6-1606-4dd6-937e-ca2953b78b90 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:58.506489 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 372/741] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:17:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 12 01:17:58.506489 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb22fd30-a993-4e21-989a-6cfba40ff145 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:58.618579 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb22fd30-a993-4e21-989a-6cfba40ff145 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:58.618825 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:58.624440 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addebcc6-1606-4dd6-937e-ca2953b78b90 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:58.663375 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd4a4a1-80a3-4fee-8b22-512988be76b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:58.663897 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fcb0dc-64d6-4ab8-afdb-b7e07f125c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:58.664412 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd4a4a1-80a3-4fee-8b22-512988be76b7 None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:58.664572 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fcb0dc-64d6-4ab8-afdb-b7e07f125c63 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:58.664848 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fcb0dc-64d6-4ab8-afdb-b7e07f125c63 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:58.665116 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fcb0dc-64d6-4ab8-afdb-b7e07f125c63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:58.665220 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd4a4a1-80a3-4fee-8b22-512988be76b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:58.665603 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd4a4a1-80a3-4fee-8b22-512988be76b7 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:58.666738 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd4a4a1-80a3-4fee-8b22-512988be76b7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:58.667310 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:58.668377 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd4a4a1-80a3-4fee-8b22-512988be76b7 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:58.679163 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fcb0dc-64d6-4ab8-afdb-b7e07f125c63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:58.680463 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fcb0dc-64d6-4ab8-afdb-b7e07f125c63 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:58.689515 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 370/742] 10.222.0.26 () {60 vars in 1141 bytes} [Fri Aug 12 01:17:58 2022] POST /identity/v3/services => generated 251 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:17:58.690845 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd4a4a1-80a3-4fee-8b22-512988be76b7 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:58.698603 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-60fcb0dc-64d6-4ab8-afdb-b7e07f125c63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:58.698603 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:58.698603 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:58.698603 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:58.698603 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:58.698603 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:58.698603 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:58.698603 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:58.698603 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:58.698603 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:58.698603 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:58.698603 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:58.698603 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 01:17:58.698603 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 01:17:58.698603 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 01:17:58.698603 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 01:17:58.699656 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:58.699656 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:58.699656 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:58.699656 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:58.699656 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:58.699656 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:58.699656 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:58.699656 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:58.699656 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:58.699656 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:58.699656 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:58.699656 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:58.699656 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:58.699656 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:58.699656 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:58.699656 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:58.699656 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 01:17:58.700544 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 01:17:58.700544 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:58.700544 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:17:58.700544 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 373/743] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:17:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:58.707331 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fcb0dc-64d6-4ab8-afdb-b7e07f125c63 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:58.816205 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd4a4a1-80a3-4fee-8b22-512988be76b7 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:58.853096 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fcb0dc-64d6-4ab8-afdb-b7e07f125c63 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:58.854906 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ca4592-f404-48e0-94e0-c993c5745c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:58.856282 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ca4592-f404-48e0-94e0-c993c5745c11 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:58.856282 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ca4592-f404-48e0-94e0-c993c5745c11 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:58.856282 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ca4592-f404-48e0-94e0-c993c5745c11 None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:58.856800 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ca4592-f404-48e0-94e0-c993c5745c11 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:58.857101 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ca4592-f404-48e0-94e0-c993c5745c11 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:58.858600 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ca4592-f404-48e0-94e0-c993c5745c11 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:58.878271 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 371/744] 10.222.0.26 () {56 vars in 1149 bytes} [Fri Aug 12 01:17:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:58.879160 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ca4592-f404-48e0-94e0-c993c5745c11 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:58.890092 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bddc2fb-0b09-4064-83a5-db6d2d4d6ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:58.890848 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bddc2fb-0b09-4064-83a5-db6d2d4d6ab5 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:58.891230 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bddc2fb-0b09-4064-83a5-db6d2d4d6ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:58.891519 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bddc2fb-0b09-4064-83a5-db6d2d4d6ab5 None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:58.892151 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bddc2fb-0b09-4064-83a5-db6d2d4d6ab5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:58.893278 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bddc2fb-0b09-4064-83a5-db6d2d4d6ab5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:58.893825 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bddc2fb-0b09-4064-83a5-db6d2d4d6ab5 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:58.895858 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:58.908059 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 374/745] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 01:17:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:58.908916 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bddc2fb-0b09-4064-83a5-db6d2d4d6ab5 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:58.960670 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:58.993925 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ca4592-f404-48e0-94e0-c993c5745c11 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:59.015815 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bddc2fb-0b09-4064-83a5-db6d2d4d6ab5 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:59.030717 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a55e7a9-1b26-43db-9fc5-7a7b471b76ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:59.031402 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a55e7a9-1b26-43db-9fc5-7a7b471b76ef None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:59.031768 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a55e7a9-1b26-43db-9fc5-7a7b471b76ef None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:59.032110 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a55e7a9-1b26-43db-9fc5-7a7b471b76ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:59.043360 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a55e7a9-1b26-43db-9fc5-7a7b471b76ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:17:59.048797 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-1a55e7a9-1b26-43db-9fc5-7a7b471b76ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 01:17:59.048797 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:59.048797 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:59.048797 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:59.048797 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:59.048797 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:59.048797 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:59.048797 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:59.048797 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:59.048797 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:59.048797 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:59.048797 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:59.048797 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:17:59.048797 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:17:59.048797 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:17:59.048797 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:17:59.049900 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:17:59.049900 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:17:59.049900 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:17:59.049900 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:17:59.049900 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:59.049900 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:59.049900 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:59.049900 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:59.049900 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:59.049900 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:59.049900 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:59.049900 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:59.049900 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:59.049900 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:59.049900 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:59.049900 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:59.050844 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:59.050844 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:59.050844 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:59.050844 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:59.050844 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:17:59.050844 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:17:59.050844 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:17:59.050844 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:17:59.050844 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:17:59.050844 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:17:59.050844 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 01:17:59.050844 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:17:59.050844 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 372/746] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Aug 12 01:17:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:59.050844 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a55e7a9-1b26-43db-9fc5-7a7b471b76ef None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:59.056915 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f435cae-6932-457a-80bf-09b794e40381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:59.057541 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f435cae-6932-457a-80bf-09b794e40381 None admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:59.057814 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f435cae-6932-457a-80bf-09b794e40381 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:59.058082 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f435cae-6932-457a-80bf-09b794e40381 None admin] PATH_INFO: `/v3/services` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:59.058765 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f435cae-6932-457a-80bf-09b794e40381 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:59.060128 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f435cae-6932-457a-80bf-09b794e40381 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:59.077671 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 375/747] 10.222.0.26 () {60 vars in 1141 bytes} [Fri Aug 12 01:17:58 2022] POST /identity/v3/services => generated 240 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:17:59.078310 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f435cae-6932-457a-80bf-09b794e40381 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:59.141892 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:59.179974 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a55e7a9-1b26-43db-9fc5-7a7b471b76ef None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:59.211897 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f435cae-6932-457a-80bf-09b794e40381 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:59.213862 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:59.223144 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e366af7-08a2-411e-89b1-f04cfa17baac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:59.224311 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e366af7-08a2-411e-89b1-f04cfa17baac None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:59.224772 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e366af7-08a2-411e-89b1-f04cfa17baac None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:59.225216 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e366af7-08a2-411e-89b1-f04cfa17baac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:59.253117 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5437c695-5b53-4dfe-b455-700a768c02fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:59.253794 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437c695-5b53-4dfe-b455-700a768c02fe None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:59.254105 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437c695-5b53-4dfe-b455-700a768c02fe None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:59.254421 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437c695-5b53-4dfe-b455-700a768c02fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:59.261800 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5437c695-5b53-4dfe-b455-700a768c02fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:59.263664 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5437c695-5b53-4dfe-b455-700a768c02fe None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:59.276197 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-5437c695-5b53-4dfe-b455-700a768c02fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 01:17:59.276197 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:59.276197 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:59.276197 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:59.276197 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:59.276197 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:59.276197 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:59.276197 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:59.276197 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:59.276197 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:59.276197 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:59.276197 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:59.276197 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 01:17:59.276197 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 01:17:59.276197 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 01:17:59.277206 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 01:17:59.277206 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:59.277206 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:59.277206 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:59.277206 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:59.277206 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:59.277206 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:59.277206 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:59.277206 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:59.277206 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:59.277206 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:59.277206 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:59.277206 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:59.277206 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:59.277206 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:59.277206 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:59.277206 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:59.278502 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 01:17:59.278502 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 01:17:59.278502 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 01:17:59.278502 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 01:17:59.278502 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 01:17:59.278502 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 01:17:59.278502 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 01:17:59.278502 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:17:59.278502 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 376/748] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 01:17:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:59.278502 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5437c695-5b53-4dfe-b455-700a768c02fe None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:59.309613 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e366af7-08a2-411e-89b1-f04cfa17baac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:59.311455 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e366af7-08a2-411e-89b1-f04cfa17baac None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:59.392430 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5437c695-5b53-4dfe-b455-700a768c02fe None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:59.396835 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:59.432682 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e510087-4ff2-47ea-82be-f453794f23d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:59.433290 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e510087-4ff2-47ea-82be-f453794f23d3 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:59.433561 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e510087-4ff2-47ea-82be-f453794f23d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:59.433826 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e510087-4ff2-47ea-82be-f453794f23d3 None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:59.434522 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e510087-4ff2-47ea-82be-f453794f23d3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:59.434820 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e510087-4ff2-47ea-82be-f453794f23d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:59.436238 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e510087-4ff2-47ea-82be-f453794f23d3 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:59.439994 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 373/749] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 01:17:59 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 01:17:59.441132 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e366af7-08a2-411e-89b1-f04cfa17baac None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:59.446148 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 377/750] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 01:17:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:59.450900 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e510087-4ff2-47ea-82be-f453794f23d3 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:59.482689 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:59.564478 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e366af7-08a2-411e-89b1-f04cfa17baac None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:59.579550 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e510087-4ff2-47ea-82be-f453794f23d3 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:59.612407 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50276b26-3af4-45dd-a81e-90215aa3c1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:59.613287 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50276b26-3af4-45dd-a81e-90215aa3c1aa None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:59.613746 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50276b26-3af4-45dd-a81e-90215aa3c1aa None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:59.614140 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50276b26-3af4-45dd-a81e-90215aa3c1aa None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:59.615122 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50276b26-3af4-45dd-a81e-90215aa3c1aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:59.615625 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50276b26-3af4-45dd-a81e-90215aa3c1aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:59.616192 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3b73f2-3bc8-4a0b-b837-899f08d03dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:59.616975 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b73f2-3bc8-4a0b-b837-899f08d03dc1 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:59.617330 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50276b26-3af4-45dd-a81e-90215aa3c1aa None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:59.617574 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b73f2-3bc8-4a0b-b837-899f08d03dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:59.618037 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b73f2-3bc8-4a0b-b837-899f08d03dc1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:59.629621 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3b73f2-3bc8-4a0b-b837-899f08d03dc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:59.631370 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3b73f2-3bc8-4a0b-b837-899f08d03dc1 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:59.632092 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 374/751] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Aug 12 01:17:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:59.633204 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50276b26-3af4-45dd-a81e-90215aa3c1aa None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:59.647059 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-9c3b73f2-3bc8-4a0b-b837-899f08d03dc1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:59.647059 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:59.647059 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:59.647059 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:59.647059 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:59.647059 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:59.647059 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:59.647059 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:59.647059 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:59.647059 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:59.647059 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:59.647059 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:59.647059 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 01:17:59.647059 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 01:17:59.647059 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 01:17:59.647059 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 01:17:59.648006 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:59.648006 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:59.648006 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:59.648006 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:59.648006 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:59.648006 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:59.648006 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:59.648006 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:59.648006 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:59.648006 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:59.648006 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:59.648006 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:59.648006 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:59.648006 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:59.648006 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:59.648006 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:59.648006 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 01:17:59.648913 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 01:17:59.648913 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:59.648913 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:17:59.651043 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 378/752] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:17:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:59.652109 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3b73f2-3bc8-4a0b-b837-899f08d03dc1 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:59.673268 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:59.747260 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:59.750966 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50276b26-3af4-45dd-a81e-90215aa3c1aa None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:59.774745 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3b73f2-3bc8-4a0b-b837-899f08d03dc1 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:17:59.797827 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d42dc15-4fe2-464a-9aee-d3086e7e71cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:59.798511 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d42dc15-4fe2-464a-9aee-d3086e7e71cb None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:59.798789 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d42dc15-4fe2-464a-9aee-d3086e7e71cb None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:59.799383 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d42dc15-4fe2-464a-9aee-d3086e7e71cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:59.811678 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b37aa9-089c-45a2-871b-8bbb929e9db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:17:59.812569 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b37aa9-089c-45a2-871b-8bbb929e9db0 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:17:59.813064 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b37aa9-089c-45a2-871b-8bbb929e9db0 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:17:59.813502 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d42dc15-4fe2-464a-9aee-d3086e7e71cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:59.813758 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b37aa9-089c-45a2-871b-8bbb929e9db0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:17:59.814700 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b37aa9-089c-45a2-871b-8bbb929e9db0 None admin] RBAC: Adding query filter params (role.id=fb48693810be495fb4b1893a79429b78, scope.project.id=fa91143910a74c6b896ced5b51f9966a, user.id=32c1ba237f864b5d9699cb817e42e647) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:17:59.814997 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d42dc15-4fe2-464a-9aee-d3086e7e71cb None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:59.815416 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b37aa9-089c-45a2-871b-8bbb929e9db0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:17:59.817071 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b37aa9-089c-45a2-871b-8bbb929e9db0 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:17:59.823475 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 379/753] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 01:17:59 2022] GET /identity/v3/role_assignments?user.id=32c1ba237f864b5d9699cb817e42e647&scope.project.id=fa91143910a74c6b896ced5b51f9966a&role.id=fb48693810be495fb4b1893a79429b78 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:17:59.824551 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b37aa9-089c-45a2-871b-8bbb929e9db0 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:59.832333 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-3d42dc15-4fe2-464a-9aee-d3086e7e71cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:59.832333 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:17:59.832333 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:17:59.832333 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:17:59.832333 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:17:59.832333 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:17:59.832333 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:17:59.832333 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:17:59.832333 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:17:59.832333 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:17:59.832333 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:17:59.832333 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:17:59.832333 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 01:17:59.832333 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 01:17:59.832333 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 01:17:59.832333 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 01:17:59.833756 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:17:59.833756 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:17:59.833756 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:17:59.833756 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:17:59.833756 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:17:59.833756 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:17:59.833756 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:17:59.833756 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:17:59.833756 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:17:59.833756 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:17:59.833756 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:17:59.833756 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:17:59.833756 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:17:59.833756 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:17:59.833756 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:17:59.833756 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:17:59.833756 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 01:17:59.835043 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 01:17:59.835043 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:17:59.835043 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:17:59.838244 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 375/754] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:17:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:17:59.840610 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d42dc15-4fe2-464a-9aee-d3086e7e71cb None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:17:59.948046 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:17:59.970673 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d42dc15-4fe2-464a-9aee-d3086e7e71cb None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:00.012053 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b220d2b-6f86-42f2-8069-82eeecf90ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:00.012924 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b220d2b-6f86-42f2-8069-82eeecf90ad1 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:00.013579 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b220d2b-6f86-42f2-8069-82eeecf90ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:00.013996 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b220d2b-6f86-42f2-8069-82eeecf90ad1 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:00.015241 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b220d2b-6f86-42f2-8069-82eeecf90ad1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:00.015722 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b220d2b-6f86-42f2-8069-82eeecf90ad1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:00.017415 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b220d2b-6f86-42f2-8069-82eeecf90ad1 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:00.038151 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 376/755] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 01:17:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:00.039906 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b220d2b-6f86-42f2-8069-82eeecf90ad1 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:00.043376 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b37aa9-089c-45a2-871b-8bbb929e9db0 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:00.095665 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f1c107-e7c4-470d-a39d-270f2daf3477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:00.096346 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1c107-e7c4-470d-a39d-270f2daf3477 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:00.096796 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1c107-e7c4-470d-a39d-270f2daf3477 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:00.097072 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1c107-e7c4-470d-a39d-270f2daf3477 None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:00.098491 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f1c107-e7c4-470d-a39d-270f2daf3477 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:00.098491 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f1c107-e7c4-470d-a39d-270f2daf3477 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:00.099906 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f1c107-e7c4-470d-a39d-270f2daf3477 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:00.111318 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:00.116034 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 380/756] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 01:17:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:00.121202 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f1c107-e7c4-470d-a39d-270f2daf3477 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:00.166937 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b220d2b-6f86-42f2-8069-82eeecf90ad1 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:00.205602 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7899fb3-bb47-4767-8e58-f07f121e7790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:00.206499 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7899fb3-bb47-4767-8e58-f07f121e7790 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:00.207002 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7899fb3-bb47-4767-8e58-f07f121e7790 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:00.207569 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7899fb3-bb47-4767-8e58-f07f121e7790 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:00.216227 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7899fb3-bb47-4767-8e58-f07f121e7790 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:00.218249 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7899fb3-bb47-4767-8e58-f07f121e7790 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:00.234936 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-b7899fb3-bb47-4767-8e58-f07f121e7790 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 12 01:18:00.234936 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:00.234936 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:00.234936 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:00.234936 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:00.234936 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:00.234936 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:00.234936 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:00.234936 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:00.234936 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:00.234936 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:00.234936 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:00.234936 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 01:18:00.234936 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 01:18:00.234936 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 01:18:00.234936 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 01:18:00.236205 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:00.236205 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:00.236205 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 01:18:00.236205 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 01:18:00.236205 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 01:18:00.236205 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 01:18:00.236205 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:00.236205 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:00.236205 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:00.236205 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:00.236205 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:00.236205 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:00.236205 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:00.236205 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:00.236205 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:00.236205 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:00.236205 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:00.236205 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:00.241963 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:00.241963 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:00.241963 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 01:18:00.241963 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 01:18:00.241963 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 01:18:00.241963 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 01:18:00.241963 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 01:18:00.241963 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 01:18:00.241963 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 12 01:18:00.241963 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:18:00.241963 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 377/757] 10.222.0.26 () {56 vars in 1093 bytes} [Fri Aug 12 01:18:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 01:18:00.255328 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7899fb3-bb47-4767-8e58-f07f121e7790 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:00.272052 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:00.283443 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f1c107-e7c4-470d-a39d-270f2daf3477 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:00.323835 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f917877a-3a21-45fe-aff0-c018710227f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:00.324821 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917877a-3a21-45fe-aff0-c018710227f0 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:00.325456 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917877a-3a21-45fe-aff0-c018710227f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:00.325923 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917877a-3a21-45fe-aff0-c018710227f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:00.340907 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f917877a-3a21-45fe-aff0-c018710227f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:00.342725 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f917877a-3a21-45fe-aff0-c018710227f0 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:00.364061 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-f917877a-3a21-45fe-aff0-c018710227f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 01:18:00.364061 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:00.364061 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:00.364061 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:00.364061 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:00.364061 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:00.364061 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:00.364061 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:00.364061 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:00.364061 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:00.364061 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:00.364061 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:00.364061 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 01:18:00.364061 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 01:18:00.364061 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 01:18:00.365214 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 01:18:00.365214 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:00.365214 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:00.365214 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:00.365214 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:00.365214 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:00.365214 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:00.365214 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:00.365214 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:00.365214 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:00.365214 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:00.365214 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:00.365214 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:00.365214 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:00.365214 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:00.365214 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:00.365214 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:00.366333 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 01:18:00.366333 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 01:18:00.366333 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 01:18:00.366333 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 01:18:00.366333 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 01:18:00.366333 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 01:18:00.366333 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 01:18:00.366333 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:18:00.368416 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 381/758] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 01:18:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 01:18:00.382756 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f917877a-3a21-45fe-aff0-c018710227f0 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:00.412344 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7899fb3-bb47-4767-8e58-f07f121e7790 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:00.447832 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390dc3e0-45b1-4454-9c1e-e4b34bac169b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:00.448441 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390dc3e0-45b1-4454-9c1e-e4b34bac169b None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:00.448713 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390dc3e0-45b1-4454-9c1e-e4b34bac169b None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:00.448979 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390dc3e0-45b1-4454-9c1e-e4b34bac169b None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:00.449703 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390dc3e0-45b1-4454-9c1e-e4b34bac169b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:00.450000 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390dc3e0-45b1-4454-9c1e-e4b34bac169b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:00.451480 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390dc3e0-45b1-4454-9c1e-e4b34bac169b None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:00.469634 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 378/759] 10.222.0.26 () {56 vars in 1133 bytes} [Fri Aug 12 01:18:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:00.476245 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390dc3e0-45b1-4454-9c1e-e4b34bac169b None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:00.509872 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:00.588960 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f917877a-3a21-45fe-aff0-c018710227f0 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:00.591884 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:00.656651 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390dc3e0-45b1-4454-9c1e-e4b34bac169b None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:00.671384 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465d0914-7d1e-4191-81a1-72f98db312d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:00.672009 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d0914-7d1e-4191-81a1-72f98db312d6 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:00.672278 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d0914-7d1e-4191-81a1-72f98db312d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:00.672541 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d0914-7d1e-4191-81a1-72f98db312d6 None admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:00.673229 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465d0914-7d1e-4191-81a1-72f98db312d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:00.673528 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465d0914-7d1e-4191-81a1-72f98db312d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:00.674970 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465d0914-7d1e-4191-81a1-72f98db312d6 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:00.692219 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac64459-409d-43fc-a861-077b5da4a711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:00.692869 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac64459-409d-43fc-a861-077b5da4a711 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:00.693147 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac64459-409d-43fc-a861-077b5da4a711 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:00.693420 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac64459-409d-43fc-a861-077b5da4a711 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:00.703829 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac64459-409d-43fc-a861-077b5da4a711 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:00.705268 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac64459-409d-43fc-a861-077b5da4a711 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:00.708656 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 382/760] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Aug 12 01:18:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:00.715884 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465d0914-7d1e-4191-81a1-72f98db312d6 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:00.725340 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-5ac64459-409d-43fc-a861-077b5da4a711 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:18:00.725340 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:00.725340 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:00.725340 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:00.725340 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:00.725340 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:00.725340 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:00.725340 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:00.725340 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:00.725340 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:00.725340 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:00.725340 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:00.725340 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 01:18:00.725340 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 01:18:00.725340 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 01:18:00.725340 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 01:18:00.726340 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:00.726340 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:00.726340 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:00.726340 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:00.726340 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:00.726340 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:00.726340 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:00.726340 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:00.726340 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:00.726340 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:00.726340 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:00.726340 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:00.726340 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:00.726340 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:00.726340 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:00.726340 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:00.726340 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 01:18:00.727645 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 01:18:00.727645 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:18:00.727645 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:18:00.727645 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 379/761] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:18:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:18:00.735005 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac64459-409d-43fc-a861-077b5da4a711 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:00.861476 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac64459-409d-43fc-a861-077b5da4a711 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:00.880286 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:00.908698 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465d0914-7d1e-4191-81a1-72f98db312d6 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:00.909187 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4679ebe-beb2-4fab-9492-34bcc5b048e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:00.910411 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4679ebe-beb2-4fab-9492-34bcc5b048e6 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:00.911077 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4679ebe-beb2-4fab-9492-34bcc5b048e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:00.911572 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4679ebe-beb2-4fab-9492-34bcc5b048e6 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:00.912421 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4679ebe-beb2-4fab-9492-34bcc5b048e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:00.912987 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4679ebe-beb2-4fab-9492-34bcc5b048e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:00.914596 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4679ebe-beb2-4fab-9492-34bcc5b048e6 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:00.933219 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 380/762] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 01:18:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:00.934018 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:00.936415 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38238557-68cb-42c6-93b9-853c5e69b596 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:00.936903 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38238557-68cb-42c6-93b9-853c5e69b596 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:00.937335 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38238557-68cb-42c6-93b9-853c5e69b596 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:00.943424 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 381/763] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:18:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:18:00.945298 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38238557-68cb-42c6-93b9-853c5e69b596 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:00.947206 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1844d80a-bf57-4069-ae7a-607ea2108776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:00.947811 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1844d80a-bf57-4069-ae7a-607ea2108776 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:00.948081 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1844d80a-bf57-4069-ae7a-607ea2108776 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:00.948345 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1844d80a-bf57-4069-ae7a-607ea2108776 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:00.949067 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1844d80a-bf57-4069-ae7a-607ea2108776 None admin] RBAC: Adding query filter params (role.id=90d1ca7df8de4b03a689afc664d0cc3f, scope.project.id=fa91143910a74c6b896ced5b51f9966a, user.id=f3643631cf2d4a9592d465bdeba99669) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:00.949368 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1844d80a-bf57-4069-ae7a-607ea2108776 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:00.950973 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1844d80a-bf57-4069-ae7a-607ea2108776 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:00.958035 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 383/764] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 01:18:00 2022] GET /identity/v3/role_assignments?user.id=f3643631cf2d4a9592d465bdeba99669&scope.project.id=fa91143910a74c6b896ced5b51f9966a&role.id=90d1ca7df8de4b03a689afc664d0cc3f => generated 259 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:18:00.962546 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3931d807-0c91-4cd5-b96a-01ae01993c25 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:00.963078 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3931d807-0c91-4cd5-b96a-01ae01993c25 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:00.963634 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3931d807-0c91-4cd5-b96a-01ae01993c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:00.999296 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-3931d807-0c91-4cd5-b96a-01ae01993c25 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:18:01.001975 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-3931d807-0c91-4cd5-b96a-01ae01993c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:18:01.171708 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 384/765] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:18:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 01:18:01.171708 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03465cb4-9c03-4ee1-95b9-751c8cd08762 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:01.171708 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03465cb4-9c03-4ee1-95b9-751c8cd08762 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:01.171708 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03465cb4-9c03-4ee1-95b9-751c8cd08762 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:01.171708 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 385/766] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:18:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:18:01.178165 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938de829-f71d-4bef-9654-f05500dc65f8 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:01.178165 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938de829-f71d-4bef-9654-f05500dc65f8 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:01.178165 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938de829-f71d-4bef-9654-f05500dc65f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:01.193432 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38238557-68cb-42c6-93b9-853c5e69b596 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:01.199083 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-938de829-f71d-4bef-9654-f05500dc65f8 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:18:01.199802 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-938de829-f71d-4bef-9654-f05500dc65f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:18:01.307956 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 386/767] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:18:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 01:18:01.363506 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d867f09-7f98-484a-8c4e-d565986dc3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:01.364159 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d867f09-7f98-484a-8c4e-d565986dc3d0 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:01.364437 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d867f09-7f98-484a-8c4e-d565986dc3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:01.364708 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d867f09-7f98-484a-8c4e-d565986dc3d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:01.372141 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d867f09-7f98-484a-8c4e-d565986dc3d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:01.373595 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d867f09-7f98-484a-8c4e-d565986dc3d0 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:01.385333 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-9d867f09-7f98-484a-8c4e-d565986dc3d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 01:18:01.385333 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:01.385333 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:01.385333 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:01.385333 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:01.385333 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:01.385333 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:01.385333 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:01.385333 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:01.385333 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:01.385333 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:01.385333 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:01.385333 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 01:18:01.385333 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 01:18:01.385333 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 01:18:01.386282 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 01:18:01.386282 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:01.386282 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:01.386282 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:01.386282 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:01.386282 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:01.386282 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:01.386282 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:01.386282 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:01.386282 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:01.386282 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:01.386282 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:01.386282 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:01.386282 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:01.386282 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:01.386282 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:01.386282 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:01.387586 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 01:18:01.387586 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 01:18:01.387586 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 01:18:01.387586 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 01:18:01.387586 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 01:18:01.387586 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 01:18:01.387586 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 01:18:01.387586 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:18:01.387586 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 382/768] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 01:18:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 442 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:18:01.395452 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938de829-f71d-4bef-9654-f05500dc65f8 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:01.494465 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:01.619917 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938de829-f71d-4bef-9654-f05500dc65f8 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:01.629808 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d867f09-7f98-484a-8c4e-d565986dc3d0 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:01.681403 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:01.691736 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0df10f-ec9b-4f86-862e-d758c78d5a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:01.692971 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0df10f-ec9b-4f86-862e-d758c78d5a22 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:01.693272 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0df10f-ec9b-4f86-862e-d758c78d5a22 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:01.693532 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0df10f-ec9b-4f86-862e-d758c78d5a22 None admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:01.694270 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0df10f-ec9b-4f86-862e-d758c78d5a22 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:01.694606 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0df10f-ec9b-4f86-862e-d758c78d5a22 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:01.696042 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0df10f-ec9b-4f86-862e-d758c78d5a22 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:01.712782 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 387/769] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Aug 12 01:18:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:01.713823 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0df10f-ec9b-4f86-862e-d758c78d5a22 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:01.768402 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d867f09-7f98-484a-8c4e-d565986dc3d0 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:01.807143 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4484c8de-77f8-474f-a6c5-a85186232b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:01.807829 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4484c8de-77f8-474f-a6c5-a85186232b06 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:01.808543 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4484c8de-77f8-474f-a6c5-a85186232b06 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:01.808858 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4484c8de-77f8-474f-a6c5-a85186232b06 None admin] PATH_INFO: `/v3/services/network` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:01.809447 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4484c8de-77f8-474f-a6c5-a85186232b06 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:01.811102 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4484c8de-77f8-474f-a6c5-a85186232b06 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:01.823120 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-4484c8de-77f8-474f-a6c5-a85186232b06 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 12 01:18:01.823120 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:01.823120 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 01:18:01.823120 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 01:18:01.823120 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 01:18:01.823120 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 01:18:01.823120 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 01:18:01.823120 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 01:18:01.823120 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 12 01:18:01.823120 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:18:01.823120 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 01:18:01.823120 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:18:01.823120 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:01.823120 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:01.823120 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:01.823120 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:01.823120 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:01.824135 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:01.824135 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:01.824135 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:01.824135 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:01.824135 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:01.824135 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:01.824135 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 01:18:01.824135 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 01:18:01.824135 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 01:18:01.824135 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 01:18:01.824135 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:01.824135 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:01.824135 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:01.824135 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:01.824135 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:01.824135 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:01.824943 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:01.824943 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:01.824943 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:01.824943 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:01.824943 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:01.824943 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:01.824943 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:01.824943 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:01.824943 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:01.824943 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:01.824943 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 01:18:01.824943 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 01:18:01.824943 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 12 01:18:01.824943 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:18:01.824943 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 383/770] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 01:18:01 2022] GET /identity/v3/services/network => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:18:01.825719 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4484c8de-77f8-474f-a6c5-a85186232b06 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:01.836147 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0df10f-ec9b-4f86-862e-d758c78d5a22 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:01.838706 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:01.871496 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da1db63-bb4e-41c3-8060-563c820d241d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:01.872196 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da1db63-bb4e-41c3-8060-563c820d241d None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:01.872563 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da1db63-bb4e-41c3-8060-563c820d241d None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:01.872945 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da1db63-bb4e-41c3-8060-563c820d241d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:01.873623 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da1db63-bb4e-41c3-8060-563c820d241d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:01.875117 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da1db63-bb4e-41c3-8060-563c820d241d None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:01.884024 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-9da1db63-bb4e-41c3-8060-563c820d241d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 12 01:18:01.884024 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:01.884024 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 01:18:01.884024 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 01:18:01.884024 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 01:18:01.884024 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 01:18:01.884024 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 01:18:01.884024 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 01:18:01.884024 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 12 01:18:01.884024 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:18:01.884024 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 01:18:01.884024 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:18:01.884024 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:01.884024 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:01.884024 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:01.884024 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:01.884024 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:01.885202 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:01.885202 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:01.885202 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:01.885202 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:01.885202 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:01.885202 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:01.885202 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 01:18:01.885202 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 01:18:01.885202 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 01:18:01.885202 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 01:18:01.885202 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:01.885202 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:01.885202 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:01.885202 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:01.885202 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:01.885202 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:01.886264 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:01.886264 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:01.886264 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:01.886264 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:01.886264 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:01.886264 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:01.886264 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:01.886264 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:01.886264 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:01.886264 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:01.886264 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 01:18:01.886264 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 01:18:01.886264 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 12 01:18:01.886264 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:18:01.892749 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 388/771] 10.222.0.26 () {56 vars in 1129 bytes} [Fri Aug 12 01:18:01 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:18:01.893641 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da1db63-bb4e-41c3-8060-563c820d241d None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:01.940112 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:01.945430 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4484c8de-77f8-474f-a6c5-a85186232b06 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:01.982688 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d676293-cd04-47e5-b7de-111fe6c4cc8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:01.983732 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d676293-cd04-47e5-b7de-111fe6c4cc8c None admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:01.984214 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d676293-cd04-47e5-b7de-111fe6c4cc8c None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:01.984620 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d676293-cd04-47e5-b7de-111fe6c4cc8c None admin] PATH_INFO: `/v3/projects/fa91143910a74c6b896ced5b51f9966a/users/fcd5e95467b44175be2478c2c7c89926/roles/fb48693810be495fb4b1893a79429b78` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:01.986783 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d676293-cd04-47e5-b7de-111fe6c4cc8c None admin] RBAC: Authorizing `identity:create_grant(project_id=fa91143910a74c6b896ced5b51f9966a, user_id=fcd5e95467b44175be2478c2c7c89926, role_id=fb48693810be495fb4b1893a79429b78)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:01.988482 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d676293-cd04-47e5-b7de-111fe6c4cc8c None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:01.999428 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da1db63-bb4e-41c3-8060-563c820d241d None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:02.010612 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 384/772] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Aug 12 01:18:01 2022] PUT /identity/v3/projects/fa91143910a74c6b896ced5b51f9966a/users/fcd5e95467b44175be2478c2c7c89926/roles/fb48693810be495fb4b1893a79429b78 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:18:02.012455 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d676293-cd04-47e5-b7de-111fe6c4cc8c None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:02.038001 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afaa311-cc19-4076-bdfd-6601e7ff4b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:02.038648 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afaa311-cc19-4076-bdfd-6601e7ff4b6a None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:02.038929 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afaa311-cc19-4076-bdfd-6601e7ff4b6a None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:02.039197 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afaa311-cc19-4076-bdfd-6601e7ff4b6a None admin] PATH_INFO: `/v3/services` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:02.039889 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afaa311-cc19-4076-bdfd-6601e7ff4b6a None admin] RBAC: Adding query filter params (name=network) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:02.040182 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afaa311-cc19-4076-bdfd-6601e7ff4b6a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:02.041948 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afaa311-cc19-4076-bdfd-6601e7ff4b6a None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:02.047686 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 389/773] 10.222.0.26 () {56 vars in 1112 bytes} [Fri Aug 12 01:18:01 2022] GET /identity/v3/services?name=network => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:02.065005 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043969bc-4d2c-4eb2-8dae-14345977f639 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:02.065378 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043969bc-4d2c-4eb2-8dae-14345977f639 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:02.065727 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043969bc-4d2c-4eb2-8dae-14345977f639 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:02.067578 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 390/774] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:18:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 01:18:02.068453 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043969bc-4d2c-4eb2-8dae-14345977f639 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:02.103683 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:02.142810 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d676293-cd04-47e5-b7de-111fe6c4cc8c None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:02.183179 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f156e90-e5a2-4b94-bb78-3523911704bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:02.183913 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f156e90-e5a2-4b94-bb78-3523911704bf None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:02.184378 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f156e90-e5a2-4b94-bb78-3523911704bf None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:02.184670 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043969bc-4d2c-4eb2-8dae-14345977f639 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:02.184774 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f156e90-e5a2-4b94-bb78-3523911704bf None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:02.185432 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f156e90-e5a2-4b94-bb78-3523911704bf None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:02.185739 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f156e90-e5a2-4b94-bb78-3523911704bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:02.187348 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f156e90-e5a2-4b94-bb78-3523911704bf None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:02.194884 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 385/775] 10.222.0.26 () {56 vars in 1124 bytes} [Fri Aug 12 01:18:02 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:02.196480 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e162f-d1bc-40ef-af2c-533e75571e23 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:02.196757 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e162f-d1bc-40ef-af2c-533e75571e23 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:02.197028 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e162f-d1bc-40ef-af2c-533e75571e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:02.216642 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-1e2e162f-d1bc-40ef-af2c-533e75571e23 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:18:02.217834 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-1e2e162f-d1bc-40ef-af2c-533e75571e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:18:02.233144 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbe6f66-90ee-4ef0-82f1-607bb0f4ad03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:02.233769 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe6f66-90ee-4ef0-82f1-607bb0f4ad03 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:02.234042 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe6f66-90ee-4ef0-82f1-607bb0f4ad03 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:02.234359 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe6f66-90ee-4ef0-82f1-607bb0f4ad03 None admin] PATH_INFO: `/v3/services` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:02.235361 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbe6f66-90ee-4ef0-82f1-607bb0f4ad03 None admin] RBAC: Adding query filter params (type=network) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:02.235669 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbe6f66-90ee-4ef0-82f1-607bb0f4ad03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:02.237335 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbe6f66-90ee-4ef0-82f1-607bb0f4ad03 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:02.242302 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:02.244028 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 391/776] 10.222.0.26 () {56 vars in 1112 bytes} [Fri Aug 12 01:18:02 2022] GET /identity/v3/services?type=network => generated 350 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:02.244854 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbe6f66-90ee-4ef0-82f1-607bb0f4ad03 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:02.301682 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 386/777] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:18:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 01:18:02.302780 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2e162f-d1bc-40ef-af2c-533e75571e23 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:02.351352 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:02.357992 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbe6f66-90ee-4ef0-82f1-607bb0f4ad03 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:02.424208 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1335ad-e04d-4b17-be41-c4ba506174cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:02.424736 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1335ad-e04d-4b17-be41-c4ba506174cf None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:02.425007 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1335ad-e04d-4b17-be41-c4ba506174cf None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:02.425272 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1335ad-e04d-4b17-be41-c4ba506174cf None admin] PATH_INFO: `/v3/services` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:02.425957 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1335ad-e04d-4b17-be41-c4ba506174cf None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:02.426308 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1335ad-e04d-4b17-be41-c4ba506174cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:02.429566 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2e162f-d1bc-40ef-af2c-533e75571e23 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:02.437628 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1335ad-e04d-4b17-be41-c4ba506174cf None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:02.446150 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 392/778] 10.222.0.26 () {56 vars in 1124 bytes} [Fri Aug 12 01:18:02 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:02.452100 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1335ad-e04d-4b17-be41-c4ba506174cf None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:02.490156 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3aa194-3f87-435a-a657-4db8bea93f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:02.490156 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3aa194-3f87-435a-a657-4db8bea93f6e None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:02.490156 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3aa194-3f87-435a-a657-4db8bea93f6e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:02.490156 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3aa194-3f87-435a-a657-4db8bea93f6e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:02.490564 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3aa194-3f87-435a-a657-4db8bea93f6e None admin] RBAC: Adding query filter params (interface=public, service_id=d669c3cf64e64a158e41e75d024a9bdd, region_id=RegionOne) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:02.495288 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3aa194-3f87-435a-a657-4db8bea93f6e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:02.499664 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3aa194-3f87-435a-a657-4db8bea93f6e None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:02.517351 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 387/779] 10.222.0.26 () {56 vars in 1251 bytes} [Fri Aug 12 01:18:02 2022] GET /identity/v3/endpoints?service_id=d669c3cf64e64a158e41e75d024a9bdd&interface=public®ion_id=RegionOne => generated 194 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:02.522106 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3aa194-3f87-435a-a657-4db8bea93f6e None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:02.554716 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:02.642320 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3aa194-3f87-435a-a657-4db8bea93f6e None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:02.666802 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1335ad-e04d-4b17-be41-c4ba506174cf None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:02.687729 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d8040b-44da-4a32-b48d-be132ea3ab5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:02.688759 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d8040b-44da-4a32-b48d-be132ea3ab5a None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:02.689327 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d8040b-44da-4a32-b48d-be132ea3ab5a None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:02.689888 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d8040b-44da-4a32-b48d-be132ea3ab5a None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:02.690731 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d8040b-44da-4a32-b48d-be132ea3ab5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:02.692507 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d8040b-44da-4a32-b48d-be132ea3ab5a None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:02.698605 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 388/780] 10.222.0.26 () {56 vars in 1087 bytes} [Fri Aug 12 01:18:02 2022] GET /identity/v3/services => generated 772 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:02.699901 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d8040b-44da-4a32-b48d-be132ea3ab5a None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:02.720450 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7090a6e6-dacc-4fab-b251-41f6b7d8005e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:02.721456 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7090a6e6-dacc-4fab-b251-41f6b7d8005e None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:02.723054 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7090a6e6-dacc-4fab-b251-41f6b7d8005e None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:02.723569 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7090a6e6-dacc-4fab-b251-41f6b7d8005e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:02.724708 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7090a6e6-dacc-4fab-b251-41f6b7d8005e None admin] RBAC: Adding query filter params (interface=public, service_id=f6bb7695cade4075a0d1d31c3d395f23, region_id=RegionOne) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:02.726353 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7090a6e6-dacc-4fab-b251-41f6b7d8005e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:02.728800 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7090a6e6-dacc-4fab-b251-41f6b7d8005e None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:02.746397 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 393/781] 10.222.0.26 () {56 vars in 1251 bytes} [Fri Aug 12 01:18:02 2022] GET /identity/v3/endpoints?service_id=f6bb7695cade4075a0d1d31c3d395f23&interface=public®ion_id=RegionOne => generated 194 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:02.753686 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7090a6e6-dacc-4fab-b251-41f6b7d8005e None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:02.806501 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:02.861494 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:02.885113 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d8040b-44da-4a32-b48d-be132ea3ab5a None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:02.930327 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af87a106-dece-45cb-ac5d-cebd52d38e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:02.930327 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af87a106-dece-45cb-ac5d-cebd52d38e03 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:02.930327 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af87a106-dece-45cb-ac5d-cebd52d38e03 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:02.930327 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af87a106-dece-45cb-ac5d-cebd52d38e03 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:02.935850 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7090a6e6-dacc-4fab-b251-41f6b7d8005e None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:02.940981 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af87a106-dece-45cb-ac5d-cebd52d38e03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:18:02.948722 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-af87a106-dece-45cb-ac5d-cebd52d38e03 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 01:18:02.948722 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:02.948722 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:02.948722 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:02.948722 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:02.948722 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:02.948722 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:02.948722 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:02.948722 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:02.948722 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:02.948722 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:02.948722 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:02.948722 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:18:02.948722 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:18:02.948722 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:18:02.948722 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:18:02.950000 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:18:02.950000 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:18:02.950000 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:18:02.950000 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:18:02.950000 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:02.950000 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:02.950000 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:02.950000 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:02.950000 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:02.950000 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:02.950000 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:02.950000 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:02.950000 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:02.950000 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:02.950000 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:02.950000 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:02.951085 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:02.951085 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:02.951085 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:02.951085 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:02.951085 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:18:02.951085 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:18:02.951085 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:18:02.951085 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:18:02.951085 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:18:02.951085 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:18:02.951085 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 01:18:02.951085 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:18:02.951085 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 389/782] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Aug 12 01:18:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:18:02.961657 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af87a106-dece-45cb-ac5d-cebd52d38e03 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:03.008404 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596c2d0d-ff95-42ac-a08a-58c3b5c56f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:03.009282 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c2d0d-ff95-42ac-a08a-58c3b5c56f2e None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:03.009706 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c2d0d-ff95-42ac-a08a-58c3b5c56f2e None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:03.010137 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c2d0d-ff95-42ac-a08a-58c3b5c56f2e None admin] PATH_INFO: `/v3/services` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:03.010912 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596c2d0d-ff95-42ac-a08a-58c3b5c56f2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:03.012420 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596c2d0d-ff95-42ac-a08a-58c3b5c56f2e None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:03.027514 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 394/783] 10.222.0.26 () {56 vars in 1087 bytes} [Fri Aug 12 01:18:02 2022] GET /identity/v3/services => generated 772 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:18:03.103482 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af87a106-dece-45cb-ac5d-cebd52d38e03 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:03.140790 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479908b0-45fa-4dc9-8ff3-345c830443fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:03.141708 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479908b0-45fa-4dc9-8ff3-345c830443fd None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:03.142265 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479908b0-45fa-4dc9-8ff3-345c830443fd None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:03.142697 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479908b0-45fa-4dc9-8ff3-345c830443fd None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:03.143523 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479908b0-45fa-4dc9-8ff3-345c830443fd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:03.144085 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479908b0-45fa-4dc9-8ff3-345c830443fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:03.145818 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479908b0-45fa-4dc9-8ff3-345c830443fd None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:03.160405 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 390/784] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 01:18:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:18:03.162218 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596c2d0d-ff95-42ac-a08a-58c3b5c56f2e None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:03.214202 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46699dfd-0607-476b-b658-ab693d68aee4 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:03.214397 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46699dfd-0607-476b-b658-ab693d68aee4 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:03.214668 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46699dfd-0607-476b-b658-ab693d68aee4 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:03.216242 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 391/785] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:18:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:18:03.221320 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7261db-a835-478d-864c-0f7f05d757b5 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:03.221600 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7261db-a835-478d-864c-0f7f05d757b5 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:03.221859 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7261db-a835-478d-864c-0f7f05d757b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:03.233499 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:03.251872 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-6d7261db-a835-478d-864c-0f7f05d757b5 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:18:03.253387 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-6d7261db-a835-478d-864c-0f7f05d757b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:18:03.272789 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:03.287479 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596c2d0d-ff95-42ac-a08a-58c3b5c56f2e None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:03.329737 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ee6e8-803e-4504-8fac-ddae0ef6c303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:03.330412 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ee6e8-803e-4504-8fac-ddae0ef6c303 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:03.330692 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ee6e8-803e-4504-8fac-ddae0ef6c303 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:03.330965 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ee6e8-803e-4504-8fac-ddae0ef6c303 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:03.343315 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4ee6e8-803e-4504-8fac-ddae0ef6c303 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:03.344878 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4ee6e8-803e-4504-8fac-ddae0ef6c303 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:03.347355 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 392/786] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:18:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 01:18:03.359820 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-2f4ee6e8-803e-4504-8fac-ddae0ef6c303 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:18:03.359820 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:03.359820 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:03.359820 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:03.359820 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:03.359820 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:03.359820 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:03.359820 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:03.359820 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:03.359820 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:03.359820 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:03.359820 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:03.359820 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 01:18:03.359820 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 01:18:03.359820 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 01:18:03.359820 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 01:18:03.361250 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:03.361250 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:03.361250 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:03.361250 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:03.361250 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:03.361250 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:03.361250 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:03.361250 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:03.361250 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:03.361250 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:03.361250 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:03.361250 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:03.361250 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:03.361250 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:03.361250 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:03.361250 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:03.361250 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 01:18:03.362331 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 01:18:03.362331 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:18:03.362331 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:18:03.365659 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 395/787] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:18:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:18:03.367019 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7261db-a835-478d-864c-0f7f05d757b5 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:03.516454 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7261db-a835-478d-864c-0f7f05d757b5 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:03.558800 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:03.561236 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb26227-3e21-4d34-a958-d8e91f7a167e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:03.561869 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb26227-3e21-4d34-a958-d8e91f7a167e None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:03.562248 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb26227-3e21-4d34-a958-d8e91f7a167e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:03.562519 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb26227-3e21-4d34-a958-d8e91f7a167e None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:03.563167 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb26227-3e21-4d34-a958-d8e91f7a167e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:03.565045 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb26227-3e21-4d34-a958-d8e91f7a167e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:03.565045 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb26227-3e21-4d34-a958-d8e91f7a167e None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:03.579749 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 393/788] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 01:18:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:03.585466 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ee6e8-803e-4504-8fac-ddae0ef6c303 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:03.697368 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ee6e8-803e-4504-8fac-ddae0ef6c303 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:03.731648 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0214442-3b7b-4a9d-97ed-05cd2f7b5e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:03.732514 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0214442-3b7b-4a9d-97ed-05cd2f7b5e78 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:03.732973 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0214442-3b7b-4a9d-97ed-05cd2f7b5e78 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:03.733389 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0214442-3b7b-4a9d-97ed-05cd2f7b5e78 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:03.741404 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0214442-3b7b-4a9d-97ed-05cd2f7b5e78 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:03.743046 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0214442-3b7b-4a9d-97ed-05cd2f7b5e78 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:03.745800 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:03.763739 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-f0214442-3b7b-4a9d-97ed-05cd2f7b5e78 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 12 01:18:03.763739 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:03.763739 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:03.763739 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:03.763739 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:03.763739 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:03.763739 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:03.763739 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:03.763739 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:03.763739 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:03.763739 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:03.763739 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:03.763739 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 01:18:03.763739 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 01:18:03.763739 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 01:18:03.763739 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 01:18:03.764721 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:03.764721 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:03.764721 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 01:18:03.764721 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 01:18:03.764721 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 01:18:03.764721 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 01:18:03.764721 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:03.764721 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:03.764721 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:03.764721 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:03.764721 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:03.764721 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:03.764721 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:03.764721 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:03.764721 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:03.764721 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:03.764721 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:03.764721 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:03.765652 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:03.765652 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:03.765652 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 01:18:03.765652 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 01:18:03.765652 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 01:18:03.765652 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 01:18:03.765652 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 01:18:03.765652 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 01:18:03.765652 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 12 01:18:03.765652 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:18:03.765652 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 396/789] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Aug 12 01:18:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:18:03.773509 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb26227-3e21-4d34-a958-d8e91f7a167e None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:03.786410 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0214442-3b7b-4a9d-97ed-05cd2f7b5e78 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:03.907259 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb26227-3e21-4d34-a958-d8e91f7a167e None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:03.942926 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600944d3-8c6f-4cdd-99ac-4f04f17b08f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:03.943688 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600944d3-8c6f-4cdd-99ac-4f04f17b08f6 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:03.943970 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600944d3-8c6f-4cdd-99ac-4f04f17b08f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:03.944242 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600944d3-8c6f-4cdd-99ac-4f04f17b08f6 None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:03.944975 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600944d3-8c6f-4cdd-99ac-4f04f17b08f6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:03.945278 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600944d3-8c6f-4cdd-99ac-4f04f17b08f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:03.946747 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600944d3-8c6f-4cdd-99ac-4f04f17b08f6 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:03.970444 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 394/790] 10.222.0.26 () {56 vars in 1135 bytes} [Fri Aug 12 01:18:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:03.971880 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600944d3-8c6f-4cdd-99ac-4f04f17b08f6 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:04.030548 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:04.080194 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0214442-3b7b-4a9d-97ed-05cd2f7b5e78 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:04.081482 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600944d3-8c6f-4cdd-99ac-4f04f17b08f6 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:04.124789 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15be571-bb06-4afd-9d27-96fb44b964fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:04.126908 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15be571-bb06-4afd-9d27-96fb44b964fe None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:04.128328 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15be571-bb06-4afd-9d27-96fb44b964fe None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:04.128644 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15be571-bb06-4afd-9d27-96fb44b964fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:04.151109 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15be571-bb06-4afd-9d27-96fb44b964fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:04.154493 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15be571-bb06-4afd-9d27-96fb44b964fe None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:04.164709 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f771ab-e466-4ac6-a5be-f29ef9003334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:04.165416 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f771ab-e466-4ac6-a5be-f29ef9003334 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:04.166053 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f771ab-e466-4ac6-a5be-f29ef9003334 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:04.166352 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f771ab-e466-4ac6-a5be-f29ef9003334 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:04.180689 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-d15be571-bb06-4afd-9d27-96fb44b964fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:18:04.180689 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:04.180689 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:04.180689 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:04.180689 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:04.180689 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:04.180689 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:04.180689 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:04.180689 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:04.180689 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:04.180689 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:04.180689 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:04.180689 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 01:18:04.180689 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 01:18:04.180689 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 01:18:04.180689 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 01:18:04.181662 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:04.181662 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:04.181662 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:04.181662 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:04.181662 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:04.181662 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:04.181662 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:04.181662 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:04.181662 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:04.181662 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:04.181662 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:04.181662 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:04.181662 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:04.181662 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:04.181662 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:04.181662 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:04.181662 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 01:18:04.182603 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 01:18:04.182603 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:18:04.182603 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:18:04.182603 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 395/791] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:18:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 01:18:04.187129 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f771ab-e466-4ac6-a5be-f29ef9003334 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:18:04.191053 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15be571-bb06-4afd-9d27-96fb44b964fe None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:04.194188 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-d8f771ab-e466-4ac6-a5be-f29ef9003334 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 01:18:04.194188 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:04.194188 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:04.194188 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:04.194188 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:04.194188 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:04.194188 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:04.194188 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:04.194188 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:04.194188 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:04.194188 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:04.194188 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:04.194188 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:18:04.194188 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:18:04.194188 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:18:04.194188 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:18:04.195105 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:18:04.195105 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:18:04.195105 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:18:04.195105 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:18:04.195105 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:04.195105 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:04.195105 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:04.195105 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:04.195105 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:04.195105 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:04.195105 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:04.195105 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:04.195105 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:04.195105 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:04.195105 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:04.195105 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:04.195937 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:04.195937 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:04.195937 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:04.195937 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:04.195937 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:18:04.195937 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:18:04.195937 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:18:04.195937 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:18:04.195937 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:18:04.195937 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:18:04.195937 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 01:18:04.195937 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:18:04.195937 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 397/792] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Aug 12 01:18:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 409 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 01:18:04.202756 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f771ab-e466-4ac6-a5be-f29ef9003334 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:04.307501 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:04.361688 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f771ab-e466-4ac6-a5be-f29ef9003334 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:04.362603 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15be571-bb06-4afd-9d27-96fb44b964fe None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:04.364723 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:04.410393 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6160dac-e117-404e-91df-c76c81c77ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:04.411003 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6160dac-e117-404e-91df-c76c81c77ae8 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:04.411277 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6160dac-e117-404e-91df-c76c81c77ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:04.411549 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6160dac-e117-404e-91df-c76c81c77ae8 None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:04.411721 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235bac14-803e-4338-bb77-fbb70b78cd72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:04.412210 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6160dac-e117-404e-91df-c76c81c77ae8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:04.412432 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235bac14-803e-4338-bb77-fbb70b78cd72 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:04.412581 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6160dac-e117-404e-91df-c76c81c77ae8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:04.414146 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235bac14-803e-4338-bb77-fbb70b78cd72 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:04.414146 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235bac14-803e-4338-bb77-fbb70b78cd72 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:04.414146 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235bac14-803e-4338-bb77-fbb70b78cd72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:04.414569 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6160dac-e117-404e-91df-c76c81c77ae8 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:04.414704 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235bac14-803e-4338-bb77-fbb70b78cd72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:04.416068 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235bac14-803e-4338-bb77-fbb70b78cd72 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:04.427624 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 398/793] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Aug 12 01:18:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:04.428970 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bae922-e022-4e12-9606-8dcb70e4d5a3 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:04.429254 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bae922-e022-4e12-9606-8dcb70e4d5a3 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:04.429522 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bae922-e022-4e12-9606-8dcb70e4d5a3 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:04.431031 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 399/795] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:18:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:18:04.431728 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bae922-e022-4e12-9606-8dcb70e4d5a3 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:04.433385 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 396/795] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 01:18:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:04.435804 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235bac14-803e-4338-bb77-fbb70b78cd72 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:04.544236 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bae922-e022-4e12-9606-8dcb70e4d5a3 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:04.551664 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235bac14-803e-4338-bb77-fbb70b78cd72 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:04.568479 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:04.581480 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6067a38f-a84a-41fb-8e39-b1b3a510b3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:04.582394 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067a38f-a84a-41fb-8e39-b1b3a510b3d0 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:04.582815 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067a38f-a84a-41fb-8e39-b1b3a510b3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:04.583246 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067a38f-a84a-41fb-8e39-b1b3a510b3d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:04.588052 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff5382f-8ae6-4899-a0ae-e13e2c989fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:04.588690 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5382f-8ae6-4899-a0ae-e13e2c989fb7 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:04.588968 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5382f-8ae6-4899-a0ae-e13e2c989fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:04.589234 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5382f-8ae6-4899-a0ae-e13e2c989fb7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:04.595365 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6067a38f-a84a-41fb-8e39-b1b3a510b3d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:04.596295 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff5382f-8ae6-4899-a0ae-e13e2c989fb7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:04.597259 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6067a38f-a84a-41fb-8e39-b1b3a510b3d0 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:04.598274 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff5382f-8ae6-4899-a0ae-e13e2c989fb7 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:04.610219 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-4ff5382f-8ae6-4899-a0ae-e13e2c989fb7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 01:18:04.610219 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:04.610219 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:04.610219 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:04.610219 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:04.610219 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:04.610219 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:04.610219 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:04.610219 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:04.610219 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:04.610219 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:04.610219 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:04.610219 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 01:18:04.610219 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 01:18:04.610219 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 01:18:04.611342 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 01:18:04.611342 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:04.611342 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:04.611342 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:04.611342 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:04.611342 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:04.611342 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:04.611342 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:04.611342 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:04.611342 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:04.611342 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:04.611342 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:04.611342 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:04.611342 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:04.611342 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:04.611342 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:04.611342 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:04.612434 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 01:18:04.612434 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 01:18:04.612434 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 01:18:04.612434 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 01:18:04.612434 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 01:18:04.612434 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 01:18:04.612434 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 01:18:04.612434 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:18:04.615288 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-6067a38f-a84a-41fb-8e39-b1b3a510b3d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:18:04.615288 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:04.615288 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:04.615288 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:04.615288 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:04.615288 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:04.615288 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:04.615288 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:04.615288 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:04.615288 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:04.615288 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:04.615288 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:04.615288 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 01:18:04.615288 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 01:18:04.615288 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 01:18:04.615288 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 01:18:04.616193 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:04.616193 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:04.616193 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:04.616193 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:04.616193 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:04.616193 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:04.616193 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:04.616193 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:04.616193 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:04.616193 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:04.616193 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:04.616193 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:04.616193 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:04.616193 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:04.616193 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:04.616193 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:04.616193 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 01:18:04.617059 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 01:18:04.617059 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:18:04.617059 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:18:04.617225 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 397/796] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 01:18:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:18:04.617586 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3367ed3c-9e5a-4c58-8dd2-145ee7f52946 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:04.617869 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3367ed3c-9e5a-4c58-8dd2-145ee7f52946 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:04.618583 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3367ed3c-9e5a-4c58-8dd2-145ee7f52946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:04.619620 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 400/797] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:18:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:18:04.625069 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6067a38f-a84a-41fb-8e39-b1b3a510b3d0 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:04.637724 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-3367ed3c-9e5a-4c58-8dd2-145ee7f52946 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:18:04.638950 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-3367ed3c-9e5a-4c58-8dd2-145ee7f52946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:18:04.656702 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:04.718231 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 398/798] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:18:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 01:18:04.719172 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3367ed3c-9e5a-4c58-8dd2-145ee7f52946 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:04.731542 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6067a38f-a84a-41fb-8e39-b1b3a510b3d0 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:04.770926 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc057d5-7069-4b39-98cf-9d2acd7f8a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:04.771787 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc057d5-7069-4b39-98cf-9d2acd7f8a47 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:04.772239 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc057d5-7069-4b39-98cf-9d2acd7f8a47 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:04.772649 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc057d5-7069-4b39-98cf-9d2acd7f8a47 None admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:04.773485 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc057d5-7069-4b39-98cf-9d2acd7f8a47 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:04.773927 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc057d5-7069-4b39-98cf-9d2acd7f8a47 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:04.775556 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc057d5-7069-4b39-98cf-9d2acd7f8a47 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:04.789471 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 401/799] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Aug 12 01:18:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:04.799154 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc057d5-7069-4b39-98cf-9d2acd7f8a47 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:04.835025 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:04.927376 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3367ed3c-9e5a-4c58-8dd2-145ee7f52946 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:04.949068 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc057d5-7069-4b39-98cf-9d2acd7f8a47 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:04.985640 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445f6cae-c04e-44e8-8b29-ecdfd2cde3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:04.987118 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445f6cae-c04e-44e8-8b29-ecdfd2cde3c4 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:04.987907 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445f6cae-c04e-44e8-8b29-ecdfd2cde3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:04.988616 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445f6cae-c04e-44e8-8b29-ecdfd2cde3c4 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:04.989624 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445f6cae-c04e-44e8-8b29-ecdfd2cde3c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:04.990561 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445f6cae-c04e-44e8-8b29-ecdfd2cde3c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:04.992614 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445f6cae-c04e-44e8-8b29-ecdfd2cde3c4 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:04.995108 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2652f15-2d5e-4a91-90c8-030fca29fc2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:04.996289 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2652f15-2d5e-4a91-90c8-030fca29fc2d None admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:04.996561 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2652f15-2d5e-4a91-90c8-030fca29fc2d None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:04.996827 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2652f15-2d5e-4a91-90c8-030fca29fc2d None admin] PATH_INFO: `/v3/projects/fa91143910a74c6b896ced5b51f9966a/users/32c1ba237f864b5d9699cb817e42e647/roles/fb48693810be495fb4b1893a79429b78` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:04.998718 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2652f15-2d5e-4a91-90c8-030fca29fc2d None admin] RBAC: Authorizing `identity:create_grant(project_id=fa91143910a74c6b896ced5b51f9966a, user_id=32c1ba237f864b5d9699cb817e42e647, role_id=fb48693810be495fb4b1893a79429b78)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:05.000111 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2652f15-2d5e-4a91-90c8-030fca29fc2d None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:05.007321 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 399/800] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 01:18:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:05.008905 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ecd55-0b58-4b38-9176-7687143e3953 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:05.009413 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ecd55-0b58-4b38-9176-7687143e3953 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:05.009884 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ecd55-0b58-4b38-9176-7687143e3953 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:05.011620 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 400/801] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:18:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:18:05.014092 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7ecd55-0b58-4b38-9176-7687143e3953 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:05.026255 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 402/802] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Aug 12 01:18:04 2022] PUT /identity/v3/projects/fa91143910a74c6b896ced5b51f9966a/users/32c1ba237f864b5d9699cb817e42e647/roles/fb48693810be495fb4b1893a79429b78 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:18:05.028011 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84bdb4-1140-4ff1-9f38-f7454d83c633 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:05.028503 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84bdb4-1140-4ff1-9f38-f7454d83c633 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:05.028968 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84bdb4-1140-4ff1-9f38-f7454d83c633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:05.039335 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:05.053930 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-bb84bdb4-1140-4ff1-9f38-f7454d83c633 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:18:05.055514 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-bb84bdb4-1140-4ff1-9f38-f7454d83c633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:18:05.135198 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 403/803] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:18:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 01:18:05.135953 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb84bdb4-1140-4ff1-9f38-f7454d83c633 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:05.153570 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7ecd55-0b58-4b38-9176-7687143e3953 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:05.181607 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:05.210250 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc47e3f-212e-4f82-87e0-8700595f1906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:05.210895 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc47e3f-212e-4f82-87e0-8700595f1906 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:05.211166 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc47e3f-212e-4f82-87e0-8700595f1906 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:05.211435 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc47e3f-212e-4f82-87e0-8700595f1906 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:05.221556 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc47e3f-212e-4f82-87e0-8700595f1906 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:05.223745 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc47e3f-212e-4f82-87e0-8700595f1906 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:05.236417 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-bbc47e3f-212e-4f82-87e0-8700595f1906 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 12 01:18:05.236417 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:05.236417 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:05.236417 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:05.236417 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:05.236417 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:05.236417 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:05.236417 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:05.236417 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:05.236417 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:05.236417 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:05.236417 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:05.236417 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 01:18:05.236417 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 01:18:05.236417 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 01:18:05.236417 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 01:18:05.237360 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:05.237360 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:05.237360 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 01:18:05.237360 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 01:18:05.237360 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 01:18:05.237360 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 01:18:05.237360 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:05.237360 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:05.237360 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:05.237360 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:05.237360 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:05.237360 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:05.237360 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:05.237360 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:05.237360 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:05.237360 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:05.237360 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:05.237360 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:05.238381 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:05.238381 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:05.238381 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 01:18:05.238381 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 01:18:05.238381 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 01:18:05.238381 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 01:18:05.238381 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 01:18:05.238381 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 01:18:05.238381 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 12 01:18:05.238381 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:18:05.238381 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 401/804] 10.222.0.26 () {56 vars in 1117 bytes} [Fri Aug 12 01:18:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:18:05.239103 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d771b61-5f8c-4069-b8f0-bf809a8bc1fd None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:05.239291 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d771b61-5f8c-4069-b8f0-bf809a8bc1fd None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:05.239552 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d771b61-5f8c-4069-b8f0-bf809a8bc1fd None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:05.241010 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 402/805] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:18:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:18:05.245647 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d771b61-5f8c-4069-b8f0-bf809a8bc1fd None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:05.278995 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb84bdb4-1140-4ff1-9f38-f7454d83c633 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:05.324914 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0560fd4-3302-4e8e-aae8-d7de8674c02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:05.325795 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0560fd4-3302-4e8e-aae8-d7de8674c02e None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:05.326076 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0560fd4-3302-4e8e-aae8-d7de8674c02e None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:05.326372 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0560fd4-3302-4e8e-aae8-d7de8674c02e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:05.327479 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:05.344702 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0560fd4-3302-4e8e-aae8-d7de8674c02e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:18:05.349700 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-b0560fd4-3302-4e8e-aae8-d7de8674c02e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 01:18:05.349700 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:05.349700 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:05.349700 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:05.349700 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:05.349700 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:05.349700 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:05.349700 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:05.349700 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:05.349700 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:05.349700 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:05.349700 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:05.349700 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:18:05.349700 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:18:05.349700 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:18:05.349700 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:18:05.350660 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:18:05.350660 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:18:05.350660 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:18:05.350660 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:18:05.350660 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:05.350660 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:05.350660 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:05.350660 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:05.350660 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:05.350660 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:05.350660 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:05.350660 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:05.350660 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:05.350660 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:05.350660 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:05.350660 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:05.351482 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:05.351482 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:05.351482 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:05.351482 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:05.351482 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:18:05.351482 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:18:05.351482 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:18:05.351482 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:18:05.351482 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:18:05.351482 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:18:05.351482 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 01:18:05.351482 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:18:05.351482 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 404/806] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Aug 12 01:18:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:18:05.352153 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a3017-68ba-492d-b75c-aa6612c783d1 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:05.353003 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a3017-68ba-492d-b75c-aa6612c783d1 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:05.353003 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a3017-68ba-492d-b75c-aa6612c783d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:05.368534 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d771b61-5f8c-4069-b8f0-bf809a8bc1fd None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:05.371869 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-133a3017-68ba-492d-b75c-aa6612c783d1 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:18:05.372828 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-133a3017-68ba-492d-b75c-aa6612c783d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:18:05.417631 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7f0b3b-c9cc-40ec-9f3f-8355a80759e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:05.418816 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f0b3b-c9cc-40ec-9f3f-8355a80759e7 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:05.419094 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f0b3b-c9cc-40ec-9f3f-8355a80759e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:05.419361 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f0b3b-c9cc-40ec-9f3f-8355a80759e7 None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:05.421363 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7f0b3b-c9cc-40ec-9f3f-8355a80759e7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:05.421669 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7f0b3b-c9cc-40ec-9f3f-8355a80759e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:05.423146 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7f0b3b-c9cc-40ec-9f3f-8355a80759e7 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:05.441372 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 403/807] 10.222.0.26 () {56 vars in 1149 bytes} [Fri Aug 12 01:18:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:05.442666 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7f0b3b-c9cc-40ec-9f3f-8355a80759e7 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:05.447153 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 405/808] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:18:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 01:18:05.453121 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a3017-68ba-492d-b75c-aa6612c783d1 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:05.474081 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:05.555533 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7f0b3b-c9cc-40ec-9f3f-8355a80759e7 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:05.582847 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a3017-68ba-492d-b75c-aa6612c783d1 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:05.584776 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:05.591344 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5927780f-77c1-4a42-9a1f-cc3ce5ae2a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:05.592007 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5927780f-77c1-4a42-9a1f-cc3ce5ae2a0f None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:05.592478 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5927780f-77c1-4a42-9a1f-cc3ce5ae2a0f None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:05.593272 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5927780f-77c1-4a42-9a1f-cc3ce5ae2a0f None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:05.594439 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5927780f-77c1-4a42-9a1f-cc3ce5ae2a0f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:05.594988 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5927780f-77c1-4a42-9a1f-cc3ce5ae2a0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:05.596709 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5927780f-77c1-4a42-9a1f-cc3ce5ae2a0f None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:05.606931 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 404/809] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 01:18:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:05.607811 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5927780f-77c1-4a42-9a1f-cc3ce5ae2a0f None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:05.629024 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecbb492-80ba-486b-94d5-449c3e2f87af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:05.630567 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecbb492-80ba-486b-94d5-449c3e2f87af None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:05.631049 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecbb492-80ba-486b-94d5-449c3e2f87af None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:05.631678 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecbb492-80ba-486b-94d5-449c3e2f87af None admin] PATH_INFO: `/v3/services/network` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:05.632572 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecbb492-80ba-486b-94d5-449c3e2f87af None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:05.635068 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecbb492-80ba-486b-94d5-449c3e2f87af None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:05.646969 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-0ecbb492-80ba-486b-94d5-449c3e2f87af None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 12 01:18:05.646969 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:05.646969 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 01:18:05.646969 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 01:18:05.646969 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 01:18:05.646969 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 01:18:05.646969 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 01:18:05.646969 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 01:18:05.646969 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 12 01:18:05.646969 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:18:05.646969 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 01:18:05.646969 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:18:05.646969 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:05.646969 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:05.646969 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:05.646969 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:05.646969 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:05.647962 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:05.647962 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:05.647962 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:05.647962 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:05.647962 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:05.647962 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:05.647962 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 01:18:05.647962 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 01:18:05.647962 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 01:18:05.647962 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 01:18:05.647962 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:05.647962 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:05.647962 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:05.647962 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:05.647962 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:05.647962 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:05.648814 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:05.648814 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:05.648814 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:05.648814 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:05.648814 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:05.648814 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:05.648814 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:05.648814 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:05.648814 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:05.648814 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:05.648814 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 01:18:05.648814 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 01:18:05.648814 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 12 01:18:05.648814 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:18:05.656557 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 406/810] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 01:18:05 2022] GET /identity/v3/services/network => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:18:05.656557 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecbb492-80ba-486b-94d5-449c3e2f87af None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:05.733240 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:05.735965 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5927780f-77c1-4a42-9a1f-cc3ce5ae2a0f None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:05.756900 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecbb492-80ba-486b-94d5-449c3e2f87af None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:05.770580 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ceb24-b40c-47ca-bbd6-b840c8ae76bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:05.771210 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ceb24-b40c-47ca-bbd6-b840c8ae76bc None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:05.771487 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ceb24-b40c-47ca-bbd6-b840c8ae76bc None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:05.771760 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ceb24-b40c-47ca-bbd6-b840c8ae76bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:05.782717 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68ceb24-b40c-47ca-bbd6-b840c8ae76bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:05.784187 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68ceb24-b40c-47ca-bbd6-b840c8ae76bc None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:05.793196 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29dc9e4-2123-427f-9633-4e3f3324e7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:05.794089 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29dc9e4-2123-427f-9633-4e3f3324e7b7 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:05.794652 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29dc9e4-2123-427f-9633-4e3f3324e7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:05.795093 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29dc9e4-2123-427f-9633-4e3f3324e7b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:05.798294 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-b68ceb24-b40c-47ca-bbd6-b840c8ae76bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:18:05.798294 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:05.798294 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:05.798294 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:05.798294 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:05.798294 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:05.798294 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:05.798294 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:05.798294 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:05.798294 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:05.798294 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:05.798294 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:05.798294 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 01:18:05.798294 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 01:18:05.798294 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 01:18:05.798294 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 01:18:05.799215 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:05.799215 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:05.799215 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:05.799215 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:05.799215 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:05.799215 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:05.799215 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:05.799215 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:05.799215 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:05.799215 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:05.799215 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:05.799215 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:05.799215 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:05.799215 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:05.799215 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:05.799215 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:05.799215 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 01:18:05.800127 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 01:18:05.800127 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:18:05.800127 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:18:05.800127 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 405/811] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:18:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:18:05.800383 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ceb24-b40c-47ca-bbd6-b840c8ae76bc None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:05.808659 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29dc9e4-2123-427f-9633-4e3f3324e7b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:05.810299 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29dc9e4-2123-427f-9633-4e3f3324e7b7 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:05.824632 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-e29dc9e4-2123-427f-9633-4e3f3324e7b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:18:05.824632 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:05.824632 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:05.824632 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:05.824632 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:05.824632 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:05.824632 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:05.824632 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:05.824632 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:05.824632 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:05.824632 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:05.824632 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:05.824632 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 01:18:05.824632 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 01:18:05.824632 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 01:18:05.824632 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 01:18:05.825799 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:05.825799 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:05.825799 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:05.825799 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:05.825799 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:05.825799 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:05.825799 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:05.825799 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:05.825799 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:05.825799 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:05.825799 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:05.825799 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:05.825799 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:05.825799 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:05.825799 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:05.825799 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:05.825799 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 01:18:05.826930 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 01:18:05.826930 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:18:05.826930 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:18:05.830600 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 407/812] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:18:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:18:05.831563 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29dc9e4-2123-427f-9633-4e3f3324e7b7 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:05.853933 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:05.912577 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ceb24-b40c-47ca-bbd6-b840c8ae76bc None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:05.937441 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29dc9e4-2123-427f-9633-4e3f3324e7b7 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:05.948169 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b31b708-4606-4c0f-9bf4-bf65f44fece0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:05.948823 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31b708-4606-4c0f-9bf4-bf65f44fece0 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:05.949063 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31b708-4606-4c0f-9bf4-bf65f44fece0 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:05.949330 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31b708-4606-4c0f-9bf4-bf65f44fece0 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:05.949995 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b31b708-4606-4c0f-9bf4-bf65f44fece0 None admin] RBAC: Adding query filter params (name=network) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:05.950294 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b31b708-4606-4c0f-9bf4-bf65f44fece0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:05.951643 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b31b708-4606-4c0f-9bf4-bf65f44fece0 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:05.957179 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 406/813] 10.222.0.26 () {56 vars in 1112 bytes} [Fri Aug 12 01:18:05 2022] GET /identity/v3/services?name=network => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:05.958260 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b31b708-4606-4c0f-9bf4-bf65f44fece0 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:05.972196 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:05.979371 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e2bd9c-333a-42a0-8912-ed5855e929bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:05.980291 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2bd9c-333a-42a0-8912-ed5855e929bc None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:05.980564 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2bd9c-333a-42a0-8912-ed5855e929bc None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:05.980841 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2bd9c-333a-42a0-8912-ed5855e929bc None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:05.981417 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e2bd9c-333a-42a0-8912-ed5855e929bc None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:05.983207 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e2bd9c-333a-42a0-8912-ed5855e929bc None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:05.992755 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-44e2bd9c-333a-42a0-8912-ed5855e929bc None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 12 01:18:05.992755 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:05.992755 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 01:18:05.992755 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 01:18:05.992755 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 01:18:05.992755 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 01:18:05.992755 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 01:18:05.992755 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 01:18:05.992755 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 12 01:18:05.992755 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:18:05.992755 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 01:18:05.992755 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:18:05.992755 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:05.992755 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:05.992755 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:05.992755 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:05.992755 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:05.993971 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:05.993971 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:05.993971 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:05.993971 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:05.993971 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:05.993971 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:05.993971 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 01:18:05.993971 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 01:18:05.993971 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 01:18:05.993971 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 01:18:05.993971 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:05.993971 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:05.993971 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:05.993971 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:05.993971 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:05.993971 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:05.995019 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:05.995019 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:05.995019 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:05.995019 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:05.995019 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:05.995019 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:05.995019 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:05.995019 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:05.995019 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:05.995019 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:05.995019 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 01:18:05.995019 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 01:18:05.995019 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 12 01:18:05.995019 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:18:05.998827 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 408/814] 10.222.0.26 () {56 vars in 1129 bytes} [Fri Aug 12 01:18:05 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:18:05.999669 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e2bd9c-333a-42a0-8912-ed5855e929bc None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:06.071065 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b31b708-4606-4c0f-9bf4-bf65f44fece0 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:06.080478 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:06.106746 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70785191-9a25-4676-a5b6-c3d9c0525328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:06.107352 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70785191-9a25-4676-a5b6-c3d9c0525328 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:06.107518 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e2bd9c-333a-42a0-8912-ed5855e929bc None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:06.107619 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70785191-9a25-4676-a5b6-c3d9c0525328 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:06.107871 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70785191-9a25-4676-a5b6-c3d9c0525328 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:06.108499 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70785191-9a25-4676-a5b6-c3d9c0525328 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:06.108798 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70785191-9a25-4676-a5b6-c3d9c0525328 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:06.110614 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70785191-9a25-4676-a5b6-c3d9c0525328 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:06.122291 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 407/815] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 01:18:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:06.123099 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70785191-9a25-4676-a5b6-c3d9c0525328 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:06.148065 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a954c6-3955-4215-b669-ce9861962eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:06.148680 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a954c6-3955-4215-b669-ce9861962eb1 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:06.148959 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a954c6-3955-4215-b669-ce9861962eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:06.149236 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a954c6-3955-4215-b669-ce9861962eb1 None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:06.149878 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a954c6-3955-4215-b669-ce9861962eb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:06.150210 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a954c6-3955-4215-b669-ce9861962eb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:06.151586 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a954c6-3955-4215-b669-ce9861962eb1 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:06.164158 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 409/816] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 01:18:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:06.164965 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a954c6-3955-4215-b669-ce9861962eb1 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:06.228170 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:06.241494 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70785191-9a25-4676-a5b6-c3d9c0525328 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:06.274063 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a954c6-3955-4215-b669-ce9861962eb1 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:06.281911 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4cf529-ad1f-4ea1-83b3-cda42e272626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:06.282387 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4cf529-ad1f-4ea1-83b3-cda42e272626 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:06.282667 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4cf529-ad1f-4ea1-83b3-cda42e272626 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:06.282940 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4cf529-ad1f-4ea1-83b3-cda42e272626 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:06.283573 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4cf529-ad1f-4ea1-83b3-cda42e272626 None admin] RBAC: Adding query filter params (type=network) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:06.284101 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4cf529-ad1f-4ea1-83b3-cda42e272626 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:06.285397 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4cf529-ad1f-4ea1-83b3-cda42e272626 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:06.295064 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 408/817] 10.222.0.26 () {56 vars in 1112 bytes} [Fri Aug 12 01:18:06 2022] GET /identity/v3/services?type=network => generated 350 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:06.295064 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4cf529-ad1f-4ea1-83b3-cda42e272626 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:06.315491 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75403589-e92a-4f20-9212-362d4ba35959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:06.316639 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75403589-e92a-4f20-9212-362d4ba35959 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:06.316917 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75403589-e92a-4f20-9212-362d4ba35959 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:06.317188 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75403589-e92a-4f20-9212-362d4ba35959 None admin] PATH_INFO: `/v3/services` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:06.317820 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75403589-e92a-4f20-9212-362d4ba35959 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:06.318156 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75403589-e92a-4f20-9212-362d4ba35959 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:06.319524 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75403589-e92a-4f20-9212-362d4ba35959 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:06.328853 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 410/818] 10.222.0.26 () {56 vars in 1124 bytes} [Fri Aug 12 01:18:06 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:06.328853 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75403589-e92a-4f20-9212-362d4ba35959 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:06.332420 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:06.406250 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4cf529-ad1f-4ea1-83b3-cda42e272626 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:06.429770 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75403589-e92a-4f20-9212-362d4ba35959 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:06.442704 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9675f968-a006-4f40-bea5-029b30097ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:06.443334 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9675f968-a006-4f40-bea5-029b30097ee2 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:06.443612 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9675f968-a006-4f40-bea5-029b30097ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:06.443882 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9675f968-a006-4f40-bea5-029b30097ee2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:06.449200 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:06.451385 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9675f968-a006-4f40-bea5-029b30097ee2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:06.452935 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9675f968-a006-4f40-bea5-029b30097ee2 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:06.465642 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-9675f968-a006-4f40-bea5-029b30097ee2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 01:18:06.465642 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:06.465642 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:06.465642 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:06.465642 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:06.465642 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:06.465642 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:06.465642 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:06.465642 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:06.465642 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:06.465642 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:06.465642 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:06.465642 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 01:18:06.465642 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 01:18:06.465642 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 01:18:06.466615 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 01:18:06.466615 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:06.466615 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:06.466615 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:06.466615 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:06.466615 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:06.466615 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:06.466615 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:06.466615 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:06.466615 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:06.466615 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:06.466615 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:06.466615 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:06.466615 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:06.466615 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:06.466615 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:06.466615 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:06.467484 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 01:18:06.467484 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 01:18:06.467484 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 01:18:06.467484 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 01:18:06.467484 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 01:18:06.467484 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 01:18:06.467484 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 01:18:06.467484 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:18:06.467484 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 409/819] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 01:18:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:18:06.467949 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9675f968-a006-4f40-bea5-029b30097ee2 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:06.473024 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245d6d49-845b-4cd5-926b-e2a9f86eae44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:06.473673 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d6d49-845b-4cd5-926b-e2a9f86eae44 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:06.473952 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d6d49-845b-4cd5-926b-e2a9f86eae44 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:06.474249 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d6d49-845b-4cd5-926b-e2a9f86eae44 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:06.483504 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245d6d49-845b-4cd5-926b-e2a9f86eae44 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:06.486163 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245d6d49-845b-4cd5-926b-e2a9f86eae44 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:06.500540 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-245d6d49-845b-4cd5-926b-e2a9f86eae44 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 12 01:18:06.500540 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:06.500540 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:06.500540 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:06.500540 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:06.500540 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:06.500540 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:06.500540 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:06.500540 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:06.500540 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:06.500540 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:06.500540 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:06.500540 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 01:18:06.500540 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 01:18:06.500540 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 01:18:06.500540 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 01:18:06.501509 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:06.501509 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:06.501509 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 01:18:06.501509 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 01:18:06.501509 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 01:18:06.501509 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 01:18:06.501509 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:06.501509 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:06.501509 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:06.501509 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:06.501509 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:06.501509 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:06.501509 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:06.501509 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:06.501509 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:06.501509 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:06.501509 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:06.501509 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:06.502457 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:06.502457 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:06.502457 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 01:18:06.502457 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 01:18:06.502457 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 01:18:06.502457 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 01:18:06.502457 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 01:18:06.502457 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 01:18:06.502457 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 12 01:18:06.502457 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:18:06.502986 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 411/820] 10.222.0.26 () {56 vars in 1093 bytes} [Fri Aug 12 01:18:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:18:06.503607 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245d6d49-845b-4cd5-926b-e2a9f86eae44 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:06.572827 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:06.583766 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9675f968-a006-4f40-bea5-029b30097ee2 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:06.613154 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245d6d49-845b-4cd5-926b-e2a9f86eae44 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:06.619696 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978c9a63-099a-478d-81ff-3c3b4a4c07f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:06.620424 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c9a63-099a-478d-81ff-3c3b4a4c07f1 None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:06.620704 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c9a63-099a-478d-81ff-3c3b4a4c07f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:06.620977 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c9a63-099a-478d-81ff-3c3b4a4c07f1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:06.621637 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978c9a63-099a-478d-81ff-3c3b4a4c07f1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:06.623139 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978c9a63-099a-478d-81ff-3c3b4a4c07f1 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:06.649033 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 410/821] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:18:06 2022] POST /identity/v3/endpoints => generated 337 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:18:06.649896 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978c9a63-099a-478d-81ff-3c3b4a4c07f1 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:06.670157 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5776bc-513b-4ec5-baab-53a8dc9af33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:06.671144 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5776bc-513b-4ec5-baab-53a8dc9af33b None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:06.671800 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5776bc-513b-4ec5-baab-53a8dc9af33b None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:06.672263 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5776bc-513b-4ec5-baab-53a8dc9af33b None admin] PATH_INFO: `/v3/services` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:06.673232 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5776bc-513b-4ec5-baab-53a8dc9af33b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:06.673722 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5776bc-513b-4ec5-baab-53a8dc9af33b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:06.676021 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5776bc-513b-4ec5-baab-53a8dc9af33b None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:06.687483 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 412/822] 10.222.0.26 () {56 vars in 1124 bytes} [Fri Aug 12 01:18:06 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:06.688787 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5776bc-513b-4ec5-baab-53a8dc9af33b None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:06.734441 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:06.769593 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978c9a63-099a-478d-81ff-3c3b4a4c07f1 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:06.815277 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c8e742-18d0-46b6-90c3-ff146b2cb412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:06.815942 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8e742-18d0-46b6-90c3-ff146b2cb412 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:06.816222 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8e742-18d0-46b6-90c3-ff146b2cb412 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:06.816755 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8e742-18d0-46b6-90c3-ff146b2cb412 None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:06.817558 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c8e742-18d0-46b6-90c3-ff146b2cb412 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:06.817854 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c8e742-18d0-46b6-90c3-ff146b2cb412 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:06.818736 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5776bc-513b-4ec5-baab-53a8dc9af33b None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:06.819334 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c8e742-18d0-46b6-90c3-ff146b2cb412 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:06.842071 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 411/823] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Aug 12 01:18:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:06.842945 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c8e742-18d0-46b6-90c3-ff146b2cb412 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:06.855267 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:06.864653 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d41e4-562e-4977-8bc2-809fb3ca5973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:06.865810 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d41e4-562e-4977-8bc2-809fb3ca5973 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:06.866538 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d41e4-562e-4977-8bc2-809fb3ca5973 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:06.867010 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d41e4-562e-4977-8bc2-809fb3ca5973 None admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:06.868213 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5d41e4-562e-4977-8bc2-809fb3ca5973 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:06.868732 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5d41e4-562e-4977-8bc2-809fb3ca5973 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:06.870338 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5d41e4-562e-4977-8bc2-809fb3ca5973 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:06.892919 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 413/824] 10.222.0.26 () {56 vars in 1133 bytes} [Fri Aug 12 01:18:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:06.897335 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d41e4-562e-4977-8bc2-809fb3ca5973 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:06.963720 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c8e742-18d0-46b6-90c3-ff146b2cb412 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:06.997290 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d61de2-6d3d-4c59-9f28-fd6d0a151a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:06.997910 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d61de2-6d3d-4c59-9f28-fd6d0a151a78 None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:06.998212 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d61de2-6d3d-4c59-9f28-fd6d0a151a78 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:06.998479 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d61de2-6d3d-4c59-9f28-fd6d0a151a78 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:06.999138 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d61de2-6d3d-4c59-9f28-fd6d0a151a78 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:07.000500 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d61de2-6d3d-4c59-9f28-fd6d0a151a78 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:07.001273 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:07.007978 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d41e4-562e-4977-8bc2-809fb3ca5973 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:07.022019 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 412/825] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:18:06 2022] POST /identity/v3/endpoints => generated 346 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:18:07.022896 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d61de2-6d3d-4c59-9f28-fd6d0a151a78 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:07.064224 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be7e86c-7835-4d2d-81ba-2dc796eb59f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:07.064896 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7e86c-7835-4d2d-81ba-2dc796eb59f7 None admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:07.065166 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7e86c-7835-4d2d-81ba-2dc796eb59f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:07.065428 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7e86c-7835-4d2d-81ba-2dc796eb59f7 None admin] PATH_INFO: `/v3/projects/fa91143910a74c6b896ced5b51f9966a/users/f3643631cf2d4a9592d465bdeba99669/roles/90d1ca7df8de4b03a689afc664d0cc3f` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:07.083605 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be7e86c-7835-4d2d-81ba-2dc796eb59f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=fa91143910a74c6b896ced5b51f9966a, user_id=f3643631cf2d4a9592d465bdeba99669, role_id=90d1ca7df8de4b03a689afc664d0cc3f)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:07.085219 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be7e86c-7835-4d2d-81ba-2dc796eb59f7 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:07.093978 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:07.110255 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 414/826] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Aug 12 01:18:06 2022] PUT /identity/v3/projects/fa91143910a74c6b896ced5b51f9966a/users/f3643631cf2d4a9592d465bdeba99669/roles/90d1ca7df8de4b03a689afc664d0cc3f => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:18:07.113202 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c11e9-274b-49fa-b4b4-946e3bd654d3 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:07.114451 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c11e9-274b-49fa-b4b4-946e3bd654d3 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:07.114940 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c11e9-274b-49fa-b4b4-946e3bd654d3 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:07.118015 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 415/827] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:18:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:18:07.124143 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97947e83-82b6-4e91-8adf-896af69e2c61 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:07.124830 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97947e83-82b6-4e91-8adf-896af69e2c61 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:07.125883 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97947e83-82b6-4e91-8adf-896af69e2c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:07.150782 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d61de2-6d3d-4c59-9f28-fd6d0a151a78 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:07.153788 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-97947e83-82b6-4e91-8adf-896af69e2c61 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:18:07.156626 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-97947e83-82b6-4e91-8adf-896af69e2c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:18:07.196009 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fc9faf-0ff9-4f13-8e2e-9858ecc0db6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:07.196786 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc9faf-0ff9-4f13-8e2e-9858ecc0db6a None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:07.197166 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc9faf-0ff9-4f13-8e2e-9858ecc0db6a None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:07.198459 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc9faf-0ff9-4f13-8e2e-9858ecc0db6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:07.253118 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 416/828] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:18:07 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 01:18:07.279948 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fc9faf-0ff9-4f13-8e2e-9858ecc0db6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:07.281407 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fc9faf-0ff9-4f13-8e2e-9858ecc0db6a None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:07.348915 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:07.391912 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 413/829] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 01:18:07 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 01:18:07.398334 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97947e83-82b6-4e91-8adf-896af69e2c61 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:07.470431 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:07.508184 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97947e83-82b6-4e91-8adf-896af69e2c61 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:07.534598 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fc9faf-0ff9-4f13-8e2e-9858ecc0db6a None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:07.544833 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b0ca97-8013-465f-961f-4c8f60f08746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:07.545506 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b0ca97-8013-465f-961f-4c8f60f08746 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:07.545788 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b0ca97-8013-465f-961f-4c8f60f08746 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:07.546061 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b0ca97-8013-465f-961f-4c8f60f08746 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:07.556802 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b0ca97-8013-465f-961f-4c8f60f08746 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:07.558280 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b0ca97-8013-465f-961f-4c8f60f08746 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:07.576681 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-55b0ca97-8013-465f-961f-4c8f60f08746 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:18:07.576681 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:07.576681 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:07.576681 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:07.576681 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:07.576681 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:07.576681 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:07.576681 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:07.576681 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:07.576681 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:07.576681 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:07.576681 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:07.576681 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 01:18:07.576681 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 01:18:07.576681 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 01:18:07.576681 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 01:18:07.577653 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:07.577653 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:07.577653 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:07.577653 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:07.577653 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:07.577653 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:07.577653 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:07.577653 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:07.577653 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:07.577653 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:07.577653 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:07.577653 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:07.577653 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:07.577653 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:07.577653 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:07.577653 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:07.577653 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 01:18:07.578563 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 01:18:07.578563 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:18:07.578563 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:18:07.578563 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 417/830] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:18:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:18:07.584709 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b0ca97-8013-465f-961f-4c8f60f08746 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:07.657850 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fc9faf-0ff9-4f13-8e2e-9858ecc0db6a None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:07.709030 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b0ca97-8013-465f-961f-4c8f60f08746 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:07.717041 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013f212f-45ce-40e2-816c-5f8c1168d2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:07.718446 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f212f-45ce-40e2-816c-5f8c1168d2e2 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:07.718935 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f212f-45ce-40e2-816c-5f8c1168d2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:07.719438 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f212f-45ce-40e2-816c-5f8c1168d2e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:07.733753 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013f212f-45ce-40e2-816c-5f8c1168d2e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:18:07.739348 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:07.741978 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-013f212f-45ce-40e2-816c-5f8c1168d2e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 01:18:07.741978 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:07.741978 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:07.741978 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:07.741978 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:07.741978 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:07.741978 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:07.741978 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:07.741978 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:07.741978 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:07.741978 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:07.741978 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:07.741978 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:18:07.741978 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:18:07.741978 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:18:07.741978 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:18:07.742922 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:18:07.742922 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:18:07.742922 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:18:07.742922 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:18:07.742922 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:07.742922 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:07.742922 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:07.742922 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:07.742922 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:07.742922 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:07.742922 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:07.742922 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:07.742922 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:07.742922 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:07.742922 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:07.742922 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:07.743814 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:07.743814 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:07.743814 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:07.743814 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:07.743814 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:18:07.743814 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:18:07.743814 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:18:07.743814 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:18:07.743814 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:18:07.743814 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:18:07.743814 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 01:18:07.743814 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:18:07.746522 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 414/831] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Aug 12 01:18:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 01:18:07.755326 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013f212f-45ce-40e2-816c-5f8c1168d2e2 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:07.760335 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f151b269-841a-4da0-9ec3-51c5fe90aad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:07.760954 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f151b269-841a-4da0-9ec3-51c5fe90aad2 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:07.761235 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f151b269-841a-4da0-9ec3-51c5fe90aad2 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:07.761507 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f151b269-841a-4da0-9ec3-51c5fe90aad2 None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:07.762194 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f151b269-841a-4da0-9ec3-51c5fe90aad2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:07.763228 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f151b269-841a-4da0-9ec3-51c5fe90aad2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:07.763877 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f151b269-841a-4da0-9ec3-51c5fe90aad2 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:07.776912 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 418/832] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 01:18:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:18:07.790136 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f151b269-841a-4da0-9ec3-51c5fe90aad2 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:07.792782 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:07.886672 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013f212f-45ce-40e2-816c-5f8c1168d2e2 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:07.910543 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f151b269-841a-4da0-9ec3-51c5fe90aad2 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:07.924239 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb92dc-c721-4e55-85d7-89535082bcea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:07.925672 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb92dc-c721-4e55-85d7-89535082bcea None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:07.926176 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb92dc-c721-4e55-85d7-89535082bcea None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:07.926616 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb92dc-c721-4e55-85d7-89535082bcea None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:07.927448 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bb92dc-c721-4e55-85d7-89535082bcea None admin] RBAC: Adding query filter params (name=admin) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:07.927920 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bb92dc-c721-4e55-85d7-89535082bcea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:07.929525 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bb92dc-c721-4e55-85d7-89535082bcea None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:07.938274 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 415/833] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 01:18:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:18:07.943869 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb92dc-c721-4e55-85d7-89535082bcea None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:07.956142 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170e86fb-0dd0-419f-b312-5c6cffbdc151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:07.957632 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e86fb-0dd0-419f-b312-5c6cffbdc151 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:07.958131 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e86fb-0dd0-419f-b312-5c6cffbdc151 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:07.958997 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e86fb-0dd0-419f-b312-5c6cffbdc151 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:07.968225 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170e86fb-0dd0-419f-b312-5c6cffbdc151 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:07.970423 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170e86fb-0dd0-419f-b312-5c6cffbdc151 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:07.986430 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-170e86fb-0dd0-419f-b312-5c6cffbdc151 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 01:18:07.986430 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:07.986430 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:07.986430 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:07.986430 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:07.986430 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:07.986430 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:07.986430 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:07.986430 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:07.986430 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:07.986430 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:07.986430 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:07.986430 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 01:18:07.986430 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 01:18:07.986430 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 01:18:07.987433 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 01:18:07.987433 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:07.987433 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:07.987433 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:07.987433 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:07.987433 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:07.987433 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:07.987433 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:07.987433 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:07.987433 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:07.987433 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:07.987433 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:07.987433 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:07.987433 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:07.987433 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:07.987433 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:07.987433 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:07.988307 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 01:18:07.988307 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 01:18:07.988307 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 01:18:07.988307 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 01:18:07.988307 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 01:18:07.988307 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 01:18:07.988307 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 01:18:07.988307 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:18:07.995867 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 419/834] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 01:18:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:18:07.996421 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170e86fb-0dd0-419f-b312-5c6cffbdc151 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:08.055678 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:08.068708 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:08.075555 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb92dc-c721-4e55-85d7-89535082bcea None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:08.114204 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2570225-f912-4248-95ac-dc3ad3af3715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:08.114850 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2570225-f912-4248-95ac-dc3ad3af3715 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:08.115103 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2570225-f912-4248-95ac-dc3ad3af3715 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:08.115428 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2570225-f912-4248-95ac-dc3ad3af3715 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:08.130280 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2570225-f912-4248-95ac-dc3ad3af3715 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:08.132363 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2570225-f912-4248-95ac-dc3ad3af3715 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:08.138427 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170e86fb-0dd0-419f-b312-5c6cffbdc151 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:08.150829 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-d2570225-f912-4248-95ac-dc3ad3af3715 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:18:08.150829 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:08.150829 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:08.150829 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:08.150829 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:08.150829 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:08.150829 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:08.150829 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:08.150829 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:08.150829 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:08.150829 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:08.150829 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:08.150829 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 01:18:08.150829 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 01:18:08.150829 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 01:18:08.150829 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 01:18:08.151844 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:08.151844 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:08.151844 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:08.151844 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:08.151844 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:08.151844 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:08.151844 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:08.151844 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:08.151844 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:08.151844 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:08.151844 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:08.151844 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:08.151844 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:08.151844 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:08.151844 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:08.151844 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:08.151844 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 01:18:08.152767 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 01:18:08.152767 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:18:08.152767 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:18:08.152767 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 416/835] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:18:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 01:18:08.158015 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2570225-f912-4248-95ac-dc3ad3af3715 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:08.181393 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914f2628-309c-4704-a27a-45e9c58fe09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:08.182029 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f2628-309c-4704-a27a-45e9c58fe09b None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:08.182411 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f2628-309c-4704-a27a-45e9c58fe09b None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:08.182768 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f2628-309c-4704-a27a-45e9c58fe09b None admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:08.183600 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914f2628-309c-4704-a27a-45e9c58fe09b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:08.183980 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914f2628-309c-4704-a27a-45e9c58fe09b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:08.185638 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914f2628-309c-4704-a27a-45e9c58fe09b None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:08.200142 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 420/836] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Aug 12 01:18:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:18:08.205589 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914f2628-309c-4704-a27a-45e9c58fe09b None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:08.282442 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2570225-f912-4248-95ac-dc3ad3af3715 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:08.322090 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d49c8f-4a7a-47a6-9231-6bc6951770fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:08.323269 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d49c8f-4a7a-47a6-9231-6bc6951770fa None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:08.324045 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d49c8f-4a7a-47a6-9231-6bc6951770fa None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:08.324581 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d49c8f-4a7a-47a6-9231-6bc6951770fa None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:08.325423 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d49c8f-4a7a-47a6-9231-6bc6951770fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:08.325917 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d49c8f-4a7a-47a6-9231-6bc6951770fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:08.328196 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d49c8f-4a7a-47a6-9231-6bc6951770fa None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:08.338503 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:08.340203 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914f2628-309c-4704-a27a-45e9c58fe09b None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:08.345963 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 417/837] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 01:18:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:18:08.346270 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:08.351175 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d49c8f-4a7a-47a6-9231-6bc6951770fa None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:08.393728 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b36ba91-bf56-4687-9575-dd9978cae66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:08.394396 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b36ba91-bf56-4687-9575-dd9978cae66f None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:08.394667 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b36ba91-bf56-4687-9575-dd9978cae66f None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:08.394934 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b36ba91-bf56-4687-9575-dd9978cae66f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:08.395652 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b36ba91-bf56-4687-9575-dd9978cae66f None admin] RBAC: Adding query filter params (role.id=fb48693810be495fb4b1893a79429b78, scope.project.id=fa91143910a74c6b896ced5b51f9966a, user.id=fcd5e95467b44175be2478c2c7c89926) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:08.396175 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b36ba91-bf56-4687-9575-dd9978cae66f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:08.398533 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b36ba91-bf56-4687-9575-dd9978cae66f None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:08.410058 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 421/838] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 01:18:08 2022] GET /identity/v3/role_assignments?user.id=fcd5e95467b44175be2478c2c7c89926&scope.project.id=fa91143910a74c6b896ced5b51f9966a&role.id=fb48693810be495fb4b1893a79429b78 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:08.472378 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d49c8f-4a7a-47a6-9231-6bc6951770fa None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:08.520838 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f56ca40-d563-40a0-bf6e-e3add9e9aab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:08.521513 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f56ca40-d563-40a0-bf6e-e3add9e9aab8 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:08.521790 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f56ca40-d563-40a0-bf6e-e3add9e9aab8 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:08.522062 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f56ca40-d563-40a0-bf6e-e3add9e9aab8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:08.530517 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f56ca40-d563-40a0-bf6e-e3add9e9aab8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:08.531987 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f56ca40-d563-40a0-bf6e-e3add9e9aab8 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:08.547555 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-3f56ca40-d563-40a0-bf6e-e3add9e9aab8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 12 01:18:08.547555 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:08.547555 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:08.547555 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:08.547555 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:08.547555 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:08.547555 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:08.547555 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:08.547555 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:08.547555 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:08.547555 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:08.547555 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:08.547555 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 01:18:08.547555 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 01:18:08.547555 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 01:18:08.547555 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 01:18:08.548579 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:08.548579 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:08.548579 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 01:18:08.548579 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 01:18:08.548579 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 01:18:08.548579 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 01:18:08.548579 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:08.548579 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:08.548579 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:08.548579 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:08.548579 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:08.548579 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:08.548579 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:08.548579 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:08.548579 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:08.548579 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:08.548579 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:08.548579 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:08.549501 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:08.549501 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:08.549501 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 01:18:08.549501 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 01:18:08.549501 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 01:18:08.549501 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 01:18:08.549501 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 01:18:08.549501 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 01:18:08.549501 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 12 01:18:08.549501 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:18:08.549501 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 418/839] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Aug 12 01:18:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 01:18:08.556250 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b36ba91-bf56-4687-9575-dd9978cae66f None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:08.663391 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b36ba91-bf56-4687-9575-dd9978cae66f None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:08.699076 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f46ab0-a15c-43d6-91ae-37194d4f869b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:08.699687 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f46ab0-a15c-43d6-91ae-37194d4f869b None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:08.699962 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f46ab0-a15c-43d6-91ae-37194d4f869b None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:08.700232 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f46ab0-a15c-43d6-91ae-37194d4f869b None admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:08.700962 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f46ab0-a15c-43d6-91ae-37194d4f869b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:08.701264 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f46ab0-a15c-43d6-91ae-37194d4f869b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:08.702727 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f46ab0-a15c-43d6-91ae-37194d4f869b None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:08.721778 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 422/840] 10.222.0.26 () {56 vars in 1135 bytes} [Fri Aug 12 01:18:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:08.727344 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f56ca40-d563-40a0-bf6e-e3add9e9aab8 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:08.789613 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:08.833352 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f56ca40-d563-40a0-bf6e-e3add9e9aab8 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:08.869404 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4c49c0-5db0-49c6-88be-41c7bde4fe04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:08.870014 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c49c0-5db0-49c6-88be-41c7bde4fe04 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:08.870318 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c49c0-5db0-49c6-88be-41c7bde4fe04 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:08.870583 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c49c0-5db0-49c6-88be-41c7bde4fe04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:08.939750 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4c49c0-5db0-49c6-88be-41c7bde4fe04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:08.941241 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4c49c0-5db0-49c6-88be-41c7bde4fe04 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:08.998941 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:09.038849 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e4b46-1fbc-4e9b-9cb6-93bad9cd2e06 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:09.039182 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e4b46-1fbc-4e9b-9cb6-93bad9cd2e06 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:09.039394 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e4b46-1fbc-4e9b-9cb6-93bad9cd2e06 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:09.042347 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 423/842] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:18:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 01:18:09.046004 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 419/842] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 01:18:08 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 01:18:09.046606 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6229ecd9-4cad-4354-860d-49a92be2355a None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:09.046892 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6229ecd9-4cad-4354-860d-49a92be2355a None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:09.047164 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6229ecd9-4cad-4354-860d-49a92be2355a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:09.047621 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4c49c0-5db0-49c6-88be-41c7bde4fe04 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:09.065813 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-6229ecd9-4cad-4354-860d-49a92be2355a None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:18:09.067241 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-6229ecd9-4cad-4354-860d-49a92be2355a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:18:09.092979 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:09.146398 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 424/843] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:18:09 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 01:18:09.150766 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0226f-9235-4d1e-bcc9-a8b35901a457 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:09.150766 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0226f-9235-4d1e-bcc9-a8b35901a457 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:09.150766 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0226f-9235-4d1e-bcc9-a8b35901a457 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:09.150766 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 425/844] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:18:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:18:09.154661 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3ed802-df63-4019-9510-ff163b78c4e6 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:09.154946 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3ed802-df63-4019-9510-ff163b78c4e6 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:09.155139 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4c49c0-5db0-49c6-88be-41c7bde4fe04 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:09.155556 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3ed802-df63-4019-9510-ff163b78c4e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:09.173963 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-3a3ed802-df63-4019-9510-ff163b78c4e6 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:18:09.175254 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-3a3ed802-df63-4019-9510-ff163b78c4e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:18:09.202930 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cacb316-8d02-415b-8ebc-52e7e60a03a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:09.203870 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cacb316-8d02-415b-8ebc-52e7e60a03a4 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:09.204505 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cacb316-8d02-415b-8ebc-52e7e60a03a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:09.204916 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cacb316-8d02-415b-8ebc-52e7e60a03a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:09.217937 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cacb316-8d02-415b-8ebc-52e7e60a03a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:09.220105 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cacb316-8d02-415b-8ebc-52e7e60a03a4 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:09.239263 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-1cacb316-8d02-415b-8ebc-52e7e60a03a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:18:09.239263 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:09.239263 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:09.239263 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:09.239263 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:09.239263 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:09.239263 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:09.239263 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:09.239263 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:09.239263 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:09.239263 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:09.239263 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:09.239263 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 01:18:09.239263 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 01:18:09.239263 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 01:18:09.239263 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 01:18:09.240401 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:09.240401 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:09.240401 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:09.240401 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:09.240401 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:09.240401 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:09.240401 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:09.240401 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:09.240401 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:09.240401 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:09.240401 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:09.240401 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:09.240401 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:09.240401 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:09.240401 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:09.240401 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:09.240401 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 01:18:09.241471 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 01:18:09.241471 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:18:09.241471 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:18:09.243937 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 420/845] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:18:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:18:09.249559 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cacb316-8d02-415b-8ebc-52e7e60a03a4 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:09.259280 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 426/846] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:18:09 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 01:18:09.262777 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:09.350411 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cacb316-8d02-415b-8ebc-52e7e60a03a4 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:09.384128 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57156e72-795e-4a4e-8ae0-e392d320f409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:09.385016 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57156e72-795e-4a4e-8ae0-e392d320f409 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:09.385431 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57156e72-795e-4a4e-8ae0-e392d320f409 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:09.385833 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57156e72-795e-4a4e-8ae0-e392d320f409 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:09.386670 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57156e72-795e-4a4e-8ae0-e392d320f409 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:09.387103 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57156e72-795e-4a4e-8ae0-e392d320f409 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:09.388624 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57156e72-795e-4a4e-8ae0-e392d320f409 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:09.401081 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 421/847] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 01:18:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:18:09.406607 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3ed802-df63-4019-9510-ff163b78c4e6 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:09.446912 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57156e72-795e-4a4e-8ae0-e392d320f409 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:09.511165 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:09.529523 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3ed802-df63-4019-9510-ff163b78c4e6 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:09.544625 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:09.569065 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c5cce7-ca26-4365-ac17-a94b1907ebda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:09.569755 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c5cce7-ca26-4365-ac17-a94b1907ebda None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:09.569994 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c5cce7-ca26-4365-ac17-a94b1907ebda None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:09.570262 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c5cce7-ca26-4365-ac17-a94b1907ebda None admin] PATH_INFO: `/v3/projects/service` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:09.577038 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c5cce7-ca26-4365-ac17-a94b1907ebda None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:09.577945 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57156e72-795e-4a4e-8ae0-e392d320f409 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:09.578499 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c5cce7-ca26-4365-ac17-a94b1907ebda None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:09.590275 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-45c5cce7-ca26-4365-ac17-a94b1907ebda None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 01:18:09.590275 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:09.590275 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:09.590275 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:09.590275 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:09.590275 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:09.590275 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:09.590275 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:09.590275 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:09.590275 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:09.590275 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:09.590275 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:09.590275 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 01:18:09.590275 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 01:18:09.590275 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 01:18:09.591247 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 01:18:09.591247 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:09.591247 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:09.591247 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:09.591247 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:09.591247 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:09.591247 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:09.591247 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:09.591247 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:09.591247 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:09.591247 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:09.591247 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:09.591247 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:09.591247 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:09.591247 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:09.591247 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:09.591247 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:09.592126 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 01:18:09.592126 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 01:18:09.592126 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 01:18:09.592126 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 01:18:09.592126 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 01:18:09.592126 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 01:18:09.592126 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 01:18:09.592126 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:18:09.596540 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 427/848] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 01:18:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 01:18:09.597646 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c5cce7-ca26-4365-ac17-a94b1907ebda None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:09.618752 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e27ecc-e869-4d6b-8c3f-adff192d6a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:09.619593 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e27ecc-e869-4d6b-8c3f-adff192d6a28 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:09.620013 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e27ecc-e869-4d6b-8c3f-adff192d6a28 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:09.620350 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e27ecc-e869-4d6b-8c3f-adff192d6a28 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:09.620926 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e27ecc-e869-4d6b-8c3f-adff192d6a28 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:09.622362 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e27ecc-e869-4d6b-8c3f-adff192d6a28 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:09.631290 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-f0e27ecc-e869-4d6b-8c3f-adff192d6a28 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 12 01:18:09.631290 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:09.631290 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 01:18:09.631290 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 01:18:09.631290 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 01:18:09.631290 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 01:18:09.631290 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 01:18:09.631290 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 01:18:09.631290 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 12 01:18:09.631290 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:18:09.631290 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 01:18:09.631290 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:18:09.631290 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:09.631290 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:09.631290 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:09.631290 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:09.631290 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:09.632286 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:09.632286 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:09.632286 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:09.632286 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:09.632286 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:09.632286 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:09.632286 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 01:18:09.632286 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 01:18:09.632286 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 01:18:09.632286 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 01:18:09.632286 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:09.632286 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:09.632286 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:09.632286 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:09.632286 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:09.632286 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:09.633108 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:09.633108 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:09.633108 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:09.633108 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:09.633108 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:09.633108 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:09.633108 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:09.633108 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:09.633108 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:09.633108 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:09.633108 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 01:18:09.633108 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 01:18:09.633108 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 12 01:18:09.633108 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:18:09.633108 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 422/849] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Aug 12 01:18:09 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 01:18:09.633900 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e27ecc-e869-4d6b-8c3f-adff192d6a28 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:09.709668 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c5cce7-ca26-4365-ac17-a94b1907ebda None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:09.741717 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e27ecc-e869-4d6b-8c3f-adff192d6a28 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:09.749152 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be616508-8eff-4ca8-a14a-85b79bc841eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:09.749781 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be616508-8eff-4ca8-a14a-85b79bc841eb None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:09.750058 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be616508-8eff-4ca8-a14a-85b79bc841eb None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:09.750362 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be616508-8eff-4ca8-a14a-85b79bc841eb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:09.761315 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be616508-8eff-4ca8-a14a-85b79bc841eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:18:09.765993 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-be616508-8eff-4ca8-a14a-85b79bc841eb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 01:18:09.765993 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:09.765993 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:09.765993 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:09.765993 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:09.765993 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:09.765993 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:09.765993 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:09.765993 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:09.765993 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:09.765993 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:09.765993 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:09.765993 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:18:09.765993 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:18:09.765993 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:18:09.765993 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:18:09.766907 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:18:09.766907 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:18:09.766907 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:18:09.766907 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:18:09.766907 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:09.766907 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:09.766907 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:09.766907 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:09.766907 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:09.766907 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:09.766907 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:09.766907 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:09.766907 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:09.766907 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:09.766907 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:09.766907 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:09.767733 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:09.767733 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:09.767733 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:09.767733 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:09.767733 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:18:09.767733 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:18:09.767733 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:18:09.767733 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:18:09.767733 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:18:09.767733 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:18:09.767733 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 01:18:09.767733 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:18:09.767733 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 428/850] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Aug 12 01:18:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:18:09.769202 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be616508-8eff-4ca8-a14a-85b79bc841eb None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:09.777917 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:09.781030 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c6d64a-f80c-4abf-a25e-3c7e0354da9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:09.781648 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c6d64a-f80c-4abf-a25e-3c7e0354da9b None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:09.781924 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c6d64a-f80c-4abf-a25e-3c7e0354da9b None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:09.782223 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c6d64a-f80c-4abf-a25e-3c7e0354da9b None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:09.782919 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c6d64a-f80c-4abf-a25e-3c7e0354da9b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:09.783217 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c6d64a-f80c-4abf-a25e-3c7e0354da9b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:09.785349 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c6d64a-f80c-4abf-a25e-3c7e0354da9b None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:09.786951 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:09.799491 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 423/851] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Aug 12 01:18:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:09.800600 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c6d64a-f80c-4abf-a25e-3c7e0354da9b None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:09.878523 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be616508-8eff-4ca8-a14a-85b79bc841eb None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:09.906082 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c6d64a-f80c-4abf-a25e-3c7e0354da9b None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:09.914148 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6478e05-cbc0-4306-afa4-3b546a8df8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:09.914943 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6478e05-cbc0-4306-afa4-3b546a8df8ac None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:09.915681 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6478e05-cbc0-4306-afa4-3b546a8df8ac None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:09.916403 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6478e05-cbc0-4306-afa4-3b546a8df8ac None admin] PATH_INFO: `/v3/services` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:09.917471 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6478e05-cbc0-4306-afa4-3b546a8df8ac None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:09.917932 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6478e05-cbc0-4306-afa4-3b546a8df8ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:09.919560 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6478e05-cbc0-4306-afa4-3b546a8df8ac None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:09.924469 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 429/852] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Aug 12 01:18:09 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:09.925626 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6478e05-cbc0-4306-afa4-3b546a8df8ac None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:09.945765 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eb91e1-9d17-4d96-8a0b-254ad9ab43ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:09.946414 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb91e1-9d17-4d96-8a0b-254ad9ab43ea None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:09.946693 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb91e1-9d17-4d96-8a0b-254ad9ab43ea None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:09.946961 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb91e1-9d17-4d96-8a0b-254ad9ab43ea None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:09.947624 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eb91e1-9d17-4d96-8a0b-254ad9ab43ea None admin] RBAC: Adding query filter params (name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:09.947925 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eb91e1-9d17-4d96-8a0b-254ad9ab43ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:09.949292 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eb91e1-9d17-4d96-8a0b-254ad9ab43ea None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:09.957536 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 424/853] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Aug 12 01:18:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:09.958369 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eb91e1-9d17-4d96-8a0b-254ad9ab43ea None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:10.012295 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:10.015562 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:10.047244 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6478e05-cbc0-4306-afa4-3b546a8df8ac None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:10.066378 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eb91e1-9d17-4d96-8a0b-254ad9ab43ea None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:10.081955 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b2e2d2-9a9e-48e9-a5e8-b6ecb7ce4444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:10.082580 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b2e2d2-9a9e-48e9-a5e8-b6ecb7ce4444 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:10.082851 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b2e2d2-9a9e-48e9-a5e8-b6ecb7ce4444 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:10.083119 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b2e2d2-9a9e-48e9-a5e8-b6ecb7ce4444 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:10.083841 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b2e2d2-9a9e-48e9-a5e8-b6ecb7ce4444 None admin] RBAC: Adding query filter params (role.id=fb48693810be495fb4b1893a79429b78, scope.project.id=fa91143910a74c6b896ced5b51f9966a, user.id=32c1ba237f864b5d9699cb817e42e647) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:10.084139 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b2e2d2-9a9e-48e9-a5e8-b6ecb7ce4444 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:10.085685 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b2e2d2-9a9e-48e9-a5e8-b6ecb7ce4444 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:10.102145 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 430/854] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 01:18:09 2022] GET /identity/v3/role_assignments?user.id=32c1ba237f864b5d9699cb817e42e647&scope.project.id=fa91143910a74c6b896ced5b51f9966a&role.id=fb48693810be495fb4b1893a79429b78 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:10.102145 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b2e2d2-9a9e-48e9-a5e8-b6ecb7ce4444 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:10.113686 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7440780-2e0c-4841-b664-9b85401c6052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:10.114594 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7440780-2e0c-4841-b664-9b85401c6052 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:10.114874 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7440780-2e0c-4841-b664-9b85401c6052 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:10.115145 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7440780-2e0c-4841-b664-9b85401c6052 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:10.115791 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7440780-2e0c-4841-b664-9b85401c6052 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:10.116144 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7440780-2e0c-4841-b664-9b85401c6052 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:10.117668 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7440780-2e0c-4841-b664-9b85401c6052 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:10.123851 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 425/855] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Aug 12 01:18:09 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:10.223162 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b2e2d2-9a9e-48e9-a5e8-b6ecb7ce4444 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:10.265065 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5db2e4b-213b-4cf3-9d0d-9a40b0f0b637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:10.265634 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db2e4b-213b-4cf3-9d0d-9a40b0f0b637 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:10.265908 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db2e4b-213b-4cf3-9d0d-9a40b0f0b637 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:10.266199 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db2e4b-213b-4cf3-9d0d-9a40b0f0b637 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:10.268788 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:10.280741 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5db2e4b-213b-4cf3-9d0d-9a40b0f0b637 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:10.282247 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5db2e4b-213b-4cf3-9d0d-9a40b0f0b637 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:10.297968 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-f5db2e4b-213b-4cf3-9d0d-9a40b0f0b637 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:18:10.297968 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:10.297968 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:10.297968 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:10.297968 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:10.297968 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:10.297968 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:10.297968 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:10.297968 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:10.297968 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:10.297968 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:10.297968 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:10.297968 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 01:18:10.297968 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 01:18:10.297968 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 01:18:10.297968 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 01:18:10.299007 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:10.299007 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:10.299007 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:10.299007 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:10.299007 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:10.299007 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:10.299007 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:10.299007 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:10.299007 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:10.299007 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:10.299007 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:10.299007 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:10.299007 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:10.299007 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:10.299007 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:10.299007 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:10.299007 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 01:18:10.300163 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 01:18:10.300163 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:18:10.300163 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:18:10.300163 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 431/856] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:18:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:18:10.305131 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7440780-2e0c-4841-b664-9b85401c6052 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:10.408294 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7440780-2e0c-4841-b664-9b85401c6052 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:10.418570 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384272a2-9a20-4a22-9b60-c6bac5a27934 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:10.418892 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384272a2-9a20-4a22-9b60-c6bac5a27934 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:10.419163 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384272a2-9a20-4a22-9b60-c6bac5a27934 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:10.420749 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 432/857] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:18:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 01:18:10.425836 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10540820-aaaa-4037-9a83-94c385179c83 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:10.426106 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10540820-aaaa-4037-9a83-94c385179c83 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:10.426401 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10540820-aaaa-4037-9a83-94c385179c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:10.431908 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:10.444935 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-10540820-aaaa-4037-9a83-94c385179c83 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:18:10.446103 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-10540820-aaaa-4037-9a83-94c385179c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:18:10.450159 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c764ba27-86e2-4fb5-9624-4faa4506874c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:10.450776 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c764ba27-86e2-4fb5-9624-4faa4506874c None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:10.451050 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c764ba27-86e2-4fb5-9624-4faa4506874c None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:10.451315 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c764ba27-86e2-4fb5-9624-4faa4506874c None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:10.451953 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c764ba27-86e2-4fb5-9624-4faa4506874c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:10.452248 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c764ba27-86e2-4fb5-9624-4faa4506874c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:10.454043 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c764ba27-86e2-4fb5-9624-4faa4506874c None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:10.474209 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 426/858] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 01:18:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:10.476298 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c764ba27-86e2-4fb5-9624-4faa4506874c None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:10.534715 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 433/859] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:18:10 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 01:18:10.593429 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c764ba27-86e2-4fb5-9624-4faa4506874c None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:10.627352 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05f3b87-ef5e-4653-9f90-3ced1eade131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:10.628009 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f3b87-ef5e-4653-9f90-3ced1eade131 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:10.628332 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f3b87-ef5e-4653-9f90-3ced1eade131 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:10.628599 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f3b87-ef5e-4653-9f90-3ced1eade131 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:10.635668 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05f3b87-ef5e-4653-9f90-3ced1eade131 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:10.637155 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05f3b87-ef5e-4653-9f90-3ced1eade131 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:10.649485 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-e05f3b87-ef5e-4653-9f90-3ced1eade131 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 12 01:18:10.649485 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:10.649485 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:10.649485 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:10.649485 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:10.649485 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:10.649485 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:10.649485 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:10.649485 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:10.649485 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:10.649485 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:10.649485 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:10.649485 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 01:18:10.649485 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 01:18:10.649485 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 01:18:10.649485 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 01:18:10.650496 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:10.650496 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:10.650496 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 01:18:10.650496 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 01:18:10.650496 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 01:18:10.650496 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 01:18:10.650496 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:10.650496 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:10.650496 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:10.650496 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:10.650496 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:10.650496 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:10.650496 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:10.650496 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:10.650496 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:10.650496 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:10.650496 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:10.650496 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:10.651457 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:10.651457 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:10.651457 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 01:18:10.651457 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 01:18:10.651457 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 01:18:10.651457 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 01:18:10.651457 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 01:18:10.651457 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 01:18:10.651457 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 12 01:18:10.651457 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:18:10.655375 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 427/860] 10.222.0.26 () {56 vars in 1117 bytes} [Fri Aug 12 01:18:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 01:18:10.656729 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10540820-aaaa-4037-9a83-94c385179c83 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:10.763965 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10540820-aaaa-4037-9a83-94c385179c83 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:10.781085 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:10.800730 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89525352-33e7-49bd-bff7-410ab7fb130f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:10.801261 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89525352-33e7-49bd-bff7-410ab7fb130f None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:10.801532 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89525352-33e7-49bd-bff7-410ab7fb130f None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:10.801857 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89525352-33e7-49bd-bff7-410ab7fb130f None admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:10.802611 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89525352-33e7-49bd-bff7-410ab7fb130f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:10.802907 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89525352-33e7-49bd-bff7-410ab7fb130f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:10.804317 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89525352-33e7-49bd-bff7-410ab7fb130f None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:10.822398 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 434/861] 10.222.0.26 () {56 vars in 1149 bytes} [Fri Aug 12 01:18:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:10.828042 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05f3b87-ef5e-4653-9f90-3ced1eade131 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:10.828655 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89525352-33e7-49bd-bff7-410ab7fb130f None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:10.877994 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:10.950866 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89525352-33e7-49bd-bff7-410ab7fb130f None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:10.958043 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05f3b87-ef5e-4653-9f90-3ced1eade131 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:10.994253 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc2e68d-d36f-486b-8bba-b1088a8b53da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:10.995170 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2e68d-d36f-486b-8bba-b1088a8b53da None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:10.995490 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2e68d-d36f-486b-8bba-b1088a8b53da None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:10.995834 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2e68d-d36f-486b-8bba-b1088a8b53da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:10.996219 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e093d3f7-d4e4-4535-b13f-da3e625098ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:10.997407 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e093d3f7-d4e4-4535-b13f-da3e625098ce None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:10.998049 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e093d3f7-d4e4-4535-b13f-da3e625098ce None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:10.998687 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e093d3f7-d4e4-4535-b13f-da3e625098ce None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:11.000181 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e093d3f7-d4e4-4535-b13f-da3e625098ce None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:11.002179 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e093d3f7-d4e4-4535-b13f-da3e625098ce None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:11.014584 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-e093d3f7-d4e4-4535-b13f-da3e625098ce None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 12 01:18:11.014584 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:11.014584 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 01:18:11.014584 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 01:18:11.014584 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 01:18:11.014584 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 01:18:11.014584 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 01:18:11.014584 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 01:18:11.014584 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 12 01:18:11.014584 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:18:11.014584 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 01:18:11.014584 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:18:11.014584 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:11.014584 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:11.014584 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:11.014584 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:11.015594 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:11.015594 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:11.015594 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:11.015594 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:11.015594 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:11.015594 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:11.015594 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:11.015594 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 01:18:11.015594 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 01:18:11.015594 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 01:18:11.015594 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 01:18:11.015594 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:11.015594 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:11.015594 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:11.015594 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:11.015594 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:11.015594 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:11.016485 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:11.016485 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:11.016485 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:11.016485 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:11.016485 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:11.016485 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:11.016485 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:11.016485 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:11.016485 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:11.016485 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:11.016485 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 01:18:11.016485 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 01:18:11.016485 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 12 01:18:11.016485 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:18:11.023262 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 435/862] 10.222.0.26 () {56 vars in 1132 bytes} [Fri Aug 12 01:18:10 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 01:18:11.025605 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e093d3f7-d4e4-4535-b13f-da3e625098ce None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:11.079239 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:11.082700 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc2e68d-d36f-486b-8bba-b1088a8b53da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:11.085514 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc2e68d-d36f-486b-8bba-b1088a8b53da None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:11.140004 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:11.143740 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e093d3f7-d4e4-4535-b13f-da3e625098ce None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:11.183196 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c712f1cc-437f-452d-91e3-3618bf94ef03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:11.183955 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712f1cc-437f-452d-91e3-3618bf94ef03 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:11.184319 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712f1cc-437f-452d-91e3-3618bf94ef03 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:11.184677 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712f1cc-437f-452d-91e3-3618bf94ef03 None admin] PATH_INFO: `/v3/services` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:11.185543 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c712f1cc-437f-452d-91e3-3618bf94ef03 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:11.185931 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c712f1cc-437f-452d-91e3-3618bf94ef03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:11.187530 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c712f1cc-437f-452d-91e3-3618bf94ef03 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:11.197812 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 436/863] 10.222.0.26 () {56 vars in 1126 bytes} [Fri Aug 12 01:18:11 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:11.199198 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c712f1cc-437f-452d-91e3-3618bf94ef03 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:11.219502 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 428/864] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 01:18:10 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 01:18:11.224825 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc2e68d-d36f-486b-8bba-b1088a8b53da None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:11.332426 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c712f1cc-437f-452d-91e3-3618bf94ef03 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:11.334554 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:11.357435 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc2e68d-d36f-486b-8bba-b1088a8b53da None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:11.375589 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7cec23-0266-4e83-a93e-27b43bd151bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:11.376315 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7cec23-0266-4e83-a93e-27b43bd151bf None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:11.376591 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7cec23-0266-4e83-a93e-27b43bd151bf None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:11.376916 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7cec23-0266-4e83-a93e-27b43bd151bf None admin] PATH_INFO: `/v3/services` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:11.378071 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7cec23-0266-4e83-a93e-27b43bd151bf None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:11.378558 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7cec23-0266-4e83-a93e-27b43bd151bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:11.380215 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7cec23-0266-4e83-a93e-27b43bd151bf None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:11.394463 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 437/865] 10.222.0.26 () {56 vars in 1126 bytes} [Fri Aug 12 01:18:11 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:11.400947 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf9545d-edad-4183-af70-04f98f809731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:11.402018 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9545d-edad-4183-af70-04f98f809731 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:11.402547 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9545d-edad-4183-af70-04f98f809731 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:11.403002 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf9545d-edad-4183-af70-04f98f809731 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:11.414395 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:11.418503 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf9545d-edad-4183-af70-04f98f809731 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:11.420410 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf9545d-edad-4183-af70-04f98f809731 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:11.438041 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-fbf9545d-edad-4183-af70-04f98f809731 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:18:11.438041 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:11.438041 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:11.438041 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:11.438041 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:11.438041 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:11.438041 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:11.438041 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:11.438041 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:11.438041 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:11.438041 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:11.438041 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:11.438041 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 01:18:11.438041 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 01:18:11.438041 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 01:18:11.438041 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 01:18:11.439151 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:11.439151 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:11.439151 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:11.439151 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:11.439151 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:11.439151 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:11.439151 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:11.439151 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:11.439151 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:11.439151 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:11.439151 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:11.439151 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:11.439151 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:11.439151 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:11.439151 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:11.439151 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:11.439151 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 01:18:11.440049 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 01:18:11.440049 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:18:11.440049 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:18:11.446965 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 429/866] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:18:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 01:18:11.448711 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7cec23-0266-4e83-a93e-27b43bd151bf None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:11.573332 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7cec23-0266-4e83-a93e-27b43bd151bf None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:11.608330 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6fe2d8-416d-4bc9-90f2-993d9933644c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:11.608859 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fe2d8-416d-4bc9-90f2-993d9933644c None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:11.609129 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fe2d8-416d-4bc9-90f2-993d9933644c None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:11.609400 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fe2d8-416d-4bc9-90f2-993d9933644c None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:11.610033 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6fe2d8-416d-4bc9-90f2-993d9933644c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:11.610373 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6fe2d8-416d-4bc9-90f2-993d9933644c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:11.611723 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6fe2d8-416d-4bc9-90f2-993d9933644c None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:11.629011 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 438/867] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 01:18:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:11.630483 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf9545d-edad-4183-af70-04f98f809731 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:11.734589 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf9545d-edad-4183-af70-04f98f809731 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:11.771352 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7938356a-a754-40d0-8137-80eadf111b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:11.771991 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7938356a-a754-40d0-8137-80eadf111b38 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:11.772262 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7938356a-a754-40d0-8137-80eadf111b38 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:11.772528 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7938356a-a754-40d0-8137-80eadf111b38 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:11.780102 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7938356a-a754-40d0-8137-80eadf111b38 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:11.781556 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7938356a-a754-40d0-8137-80eadf111b38 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:11.793283 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-7938356a-a754-40d0-8137-80eadf111b38 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 01:18:11.793283 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:11.793283 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:11.793283 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:11.793283 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:11.793283 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:11.793283 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:11.793283 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:11.793283 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:11.793283 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:11.793283 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:11.793283 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:11.793283 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 01:18:11.793283 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 01:18:11.793283 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 01:18:11.794211 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 01:18:11.794211 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:11.794211 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:11.794211 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:11.794211 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:11.794211 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:11.794211 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:11.794211 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:11.794211 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:11.794211 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:11.794211 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:11.794211 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:11.794211 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:11.794211 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:11.794211 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:11.794211 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:11.794211 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:11.795084 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 01:18:11.795084 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 01:18:11.795084 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 01:18:11.795084 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 01:18:11.795084 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 01:18:11.795084 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 01:18:11.795084 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 01:18:11.795084 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:18:11.798216 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 430/868] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 01:18:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:18:11.800843 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6fe2d8-416d-4bc9-90f2-993d9933644c None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:11.828947 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:11.907421 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6fe2d8-416d-4bc9-90f2-993d9933644c None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:11.943535 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b3a7e-4ddb-4a6c-a960-52a302d02b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:11.944443 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b3a7e-4ddb-4a6c-a960-52a302d02b45 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:11.944885 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b3a7e-4ddb-4a6c-a960-52a302d02b45 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:11.945324 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b3a7e-4ddb-4a6c-a960-52a302d02b45 None admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:11.946167 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327b3a7e-4ddb-4a6c-a960-52a302d02b45 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:11.946604 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327b3a7e-4ddb-4a6c-a960-52a302d02b45 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:11.948146 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327b3a7e-4ddb-4a6c-a960-52a302d02b45 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:11.960797 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 439/869] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Aug 12 01:18:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:11.966743 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7938356a-a754-40d0-8137-80eadf111b38 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:12.022423 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:12.072917 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7938356a-a754-40d0-8137-80eadf111b38 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:12.107625 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef66e55-5fa2-400d-b268-fc896e8b4e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:12.108237 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef66e55-5fa2-400d-b268-fc896e8b4e75 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:12.108507 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef66e55-5fa2-400d-b268-fc896e8b4e75 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:12.108772 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef66e55-5fa2-400d-b268-fc896e8b4e75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:12.109496 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef66e55-5fa2-400d-b268-fc896e8b4e75 None admin] RBAC: Adding query filter params (role.id=90d1ca7df8de4b03a689afc664d0cc3f, scope.project.id=fa91143910a74c6b896ced5b51f9966a, user.id=f3643631cf2d4a9592d465bdeba99669) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:12.109796 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef66e55-5fa2-400d-b268-fc896e8b4e75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:12.111270 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef66e55-5fa2-400d-b268-fc896e8b4e75 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:12.122226 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 431/870] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 01:18:11 2022] GET /identity/v3/role_assignments?user.id=f3643631cf2d4a9592d465bdeba99669&scope.project.id=fa91143910a74c6b896ced5b51f9966a&role.id=90d1ca7df8de4b03a689afc664d0cc3f => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:12.148950 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872dec4-05a6-4918-8dc3-259b0439528e None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:12.149280 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872dec4-05a6-4918-8dc3-259b0439528e None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:12.149498 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872dec4-05a6-4918-8dc3-259b0439528e None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:12.151206 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 440/871] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:18:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:18:12.156971 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0dd3da-fbbb-43f0-90fc-f6ebc8028422 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:12.157251 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0dd3da-fbbb-43f0-90fc-f6ebc8028422 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:12.157570 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0dd3da-fbbb-43f0-90fc-f6ebc8028422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:12.165650 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c0910-3f1c-4408-b7d1-b4ac19ccd55a None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:12.165931 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c0910-3f1c-4408-b7d1-b4ac19ccd55a None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:12.166284 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c0910-3f1c-4408-b7d1-b4ac19ccd55a None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:12.167972 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 441/872] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:18:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:18:12.173610 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd48fad-3c31-42da-b497-b7ac1abf2543 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:12.173893 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd48fad-3c31-42da-b497-b7ac1abf2543 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:12.174217 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd48fad-3c31-42da-b497-b7ac1abf2543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:12.178891 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-2a0dd3da-fbbb-43f0-90fc-f6ebc8028422 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:18:12.180104 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2a0dd3da-fbbb-43f0-90fc-f6ebc8028422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:18:12.193722 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-bdd48fad-3c31-42da-b497-b7ac1abf2543 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:18:12.195012 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-bdd48fad-3c31-42da-b497-b7ac1abf2543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:18:12.272372 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 432/873] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:18:12 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 01:18:12.278434 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 442/874] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:18:12 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 01:18:12.538468 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0dd3da-fbbb-43f0-90fc-f6ebc8028422 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:12.554227 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd48fad-3c31-42da-b497-b7ac1abf2543 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:12.578903 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:12.601519 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:12.657479 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0dd3da-fbbb-43f0-90fc-f6ebc8028422 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:12.681192 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd48fad-3c31-42da-b497-b7ac1abf2543 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:12.695315 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f173bc-abbe-4806-b7d7-b005b56a2934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:12.695970 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f173bc-abbe-4806-b7d7-b005b56a2934 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:12.696241 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f173bc-abbe-4806-b7d7-b005b56a2934 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:12.696506 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f173bc-abbe-4806-b7d7-b005b56a2934 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:12.697085 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f173bc-abbe-4806-b7d7-b005b56a2934 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:12.698583 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f173bc-abbe-4806-b7d7-b005b56a2934 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:12.710054 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-09f173bc-abbe-4806-b7d7-b005b56a2934 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 12 01:18:12.710054 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:12.710054 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 01:18:12.710054 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 01:18:12.710054 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 01:18:12.710054 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 01:18:12.710054 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 01:18:12.710054 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 01:18:12.710054 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 12 01:18:12.710054 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:18:12.710054 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 01:18:12.710054 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:18:12.710054 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:12.710054 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:12.710054 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:12.710054 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:12.710054 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:12.711070 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:12.711070 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:12.711070 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:12.711070 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:12.711070 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:12.711070 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:12.711070 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 01:18:12.711070 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 01:18:12.711070 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 01:18:12.711070 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 01:18:12.711070 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:12.711070 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:12.711070 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:12.711070 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:12.711070 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:12.711070 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:12.711909 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:12.711909 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:12.711909 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:12.711909 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:12.711909 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:12.711909 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:12.711909 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:12.711909 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:12.711909 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:12.711909 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:12.711909 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 01:18:12.711909 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 01:18:12.711909 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 12 01:18:12.711909 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:18:12.711909 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 433/875] 10.222.0.26 () {56 vars in 1126 bytes} [Fri Aug 12 01:18:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:18:12.718705 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f173bc-abbe-4806-b7d7-b005b56a2934 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:12.729655 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca84d84-6a58-466e-bdbe-befde315c0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:12.730421 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca84d84-6a58-466e-bdbe-befde315c0b3 None admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:12.730767 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca84d84-6a58-466e-bdbe-befde315c0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:12.731516 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca84d84-6a58-466e-bdbe-befde315c0b3 None admin] PATH_INFO: `/v3/services` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:12.732229 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca84d84-6a58-466e-bdbe-befde315c0b3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:12.734331 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca84d84-6a58-466e-bdbe-befde315c0b3 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:12.762255 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 443/876] 10.222.0.26 () {60 vars in 1141 bytes} [Fri Aug 12 01:18:12 2022] POST /identity/v3/services => generated 251 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 01:18:12.837257 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f173bc-abbe-4806-b7d7-b005b56a2934 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:12.849739 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:12.883062 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b9ef2b-cb13-4717-8224-552effd69686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:12.883695 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b9ef2b-cb13-4717-8224-552effd69686 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:12.883966 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b9ef2b-cb13-4717-8224-552effd69686 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:12.884230 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b9ef2b-cb13-4717-8224-552effd69686 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:12.884867 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b9ef2b-cb13-4717-8224-552effd69686 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:12.885164 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b9ef2b-cb13-4717-8224-552effd69686 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:12.886587 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b9ef2b-cb13-4717-8224-552effd69686 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:12.892213 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 434/877] 10.222.0.26 () {56 vars in 1122 bytes} [Fri Aug 12 01:18:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:12.899278 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca84d84-6a58-466e-bdbe-befde315c0b3 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:12.990239 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:13.016644 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca84d84-6a58-466e-bdbe-befde315c0b3 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:13.052144 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a176fe0-d2bd-42ba-b8b0-8439a80287f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:13.052764 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a176fe0-d2bd-42ba-b8b0-8439a80287f4 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:13.053038 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a176fe0-d2bd-42ba-b8b0-8439a80287f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:13.053302 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a176fe0-d2bd-42ba-b8b0-8439a80287f4 None admin] PATH_INFO: `/v3/services` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:13.053931 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a176fe0-d2bd-42ba-b8b0-8439a80287f4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:13.054305 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a176fe0-d2bd-42ba-b8b0-8439a80287f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:13.055660 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a176fe0-d2bd-42ba-b8b0-8439a80287f4 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:13.060861 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 444/878] 10.222.0.26 () {56 vars in 1122 bytes} [Fri Aug 12 01:18:12 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:13.367675 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd52505f-2346-42a2-b5b0-5e0378ca560d None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:13.368056 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd52505f-2346-42a2-b5b0-5e0378ca560d None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:13.368173 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd52505f-2346-42a2-b5b0-5e0378ca560d None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:13.369658 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 435/879] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:18:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 01:18:13.374951 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fcfe9e-b8bf-4c21-a4ad-9f19446557fb None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:13.375484 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fcfe9e-b8bf-4c21-a4ad-9f19446557fb None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:13.375945 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fcfe9e-b8bf-4c21-a4ad-9f19446557fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:13.394724 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-d7fcfe9e-b8bf-4c21-a4ad-9f19446557fb None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:18:13.396207 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-d7fcfe9e-b8bf-4c21-a4ad-9f19446557fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:18:13.465504 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 445/880] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:18:13 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 01:18:13.729496 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd52505f-2346-42a2-b5b0-5e0378ca560d None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:13.831222 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd52505f-2346-42a2-b5b0-5e0378ca560d None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:13.866321 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2cc7c9-cd0a-4637-af4c-6743bb77e7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:13.866933 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2cc7c9-cd0a-4637-af4c-6743bb77e7f4 None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:13.867202 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2cc7c9-cd0a-4637-af4c-6743bb77e7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:13.867467 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2cc7c9-cd0a-4637-af4c-6743bb77e7f4 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:13.868116 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2cc7c9-cd0a-4637-af4c-6743bb77e7f4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:13.869471 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2cc7c9-cd0a-4637-af4c-6743bb77e7f4 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:13.887334 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 436/881] 10.222.0.26 () {60 vars in 1141 bytes} [Fri Aug 12 01:18:13 2022] POST /identity/v3/services => generated 269 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:18:14.159427 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9526f507-b1cb-440e-87f3-59e1c919546c None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:14.159954 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9526f507-b1cb-440e-87f3-59e1c919546c None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:14.160222 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9526f507-b1cb-440e-87f3-59e1c919546c None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:14.161733 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 446/882] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:18:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:18:14.167365 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b78b1-c881-4c72-9a0a-9a315d176066 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:14.167648 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b78b1-c881-4c72-9a0a-9a315d176066 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:14.167917 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b78b1-c881-4c72-9a0a-9a315d176066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:14.187640 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-cb8b78b1-c881-4c72-9a0a-9a315d176066 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:18:14.188847 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-cb8b78b1-c881-4c72-9a0a-9a315d176066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:18:14.215338 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:14.267380 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 437/883] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:18:14 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 01:18:14.531806 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9526f507-b1cb-440e-87f3-59e1c919546c None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:14.606778 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:14.641189 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9526f507-b1cb-440e-87f3-59e1c919546c None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:14.678282 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e6dd64-b83b-4836-bfa0-957b2aeefce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:14.679301 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6dd64-b83b-4836-bfa0-957b2aeefce8 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:14.679773 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6dd64-b83b-4836-bfa0-957b2aeefce8 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:14.680231 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6dd64-b83b-4836-bfa0-957b2aeefce8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:14.692363 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e6dd64-b83b-4836-bfa0-957b2aeefce8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:18:14.697273 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-83e6dd64-b83b-4836-bfa0-957b2aeefce8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 12 01:18:14.697273 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:14.697273 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:14.697273 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:14.697273 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:14.697273 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:14.697273 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:14.697273 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:14.697273 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:14.697273 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:14.697273 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:14.697273 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:14.697273 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:18:14.697273 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:18:14.697273 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:18:14.697273 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:18:14.698210 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:18:14.698210 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:18:14.698210 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:18:14.698210 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:18:14.698210 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:14.698210 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:14.698210 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:14.698210 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:14.698210 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:14.698210 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:14.698210 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:14.698210 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:14.698210 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:14.698210 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:14.698210 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:14.698210 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:14.699040 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:14.699040 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:14.699040 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:14.699040 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:14.699040 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:18:14.699040 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:18:14.699040 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:18:14.699040 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:18:14.699040 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:18:14.699040 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:18:14.699040 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 12 01:18:14.699040 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:18:14.701660 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 447/884] 10.222.0.26 () {56 vars in 1120 bytes} [Fri Aug 12 01:18:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:18:14.707559 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8b78b1-c881-4c72-9a0a-9a315d176066 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:14.810393 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8b78b1-c881-4c72-9a0a-9a315d176066 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:14.824349 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19ab05-dfce-4a9e-8a5b-5a27f449f3d4 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:14.824983 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19ab05-dfce-4a9e-8a5b-5a27f449f3d4 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:14.825457 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19ab05-dfce-4a9e-8a5b-5a27f449f3d4 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:14.827288 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 448/885] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:18:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:18:14.832470 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2926cdab-eb7f-4b50-9a14-60d5657de801 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:14.833010 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2926cdab-eb7f-4b50-9a14-60d5657de801 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:14.833493 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2926cdab-eb7f-4b50-9a14-60d5657de801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:14.849244 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec0723e-549c-4965-a159-8d4cf495c50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:14.849862 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec0723e-549c-4965-a159-8d4cf495c50f None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:14.850150 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec0723e-549c-4965-a159-8d4cf495c50f None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:14.850421 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec0723e-549c-4965-a159-8d4cf495c50f None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:14.851080 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec0723e-549c-4965-a159-8d4cf495c50f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:14.851379 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec0723e-549c-4965-a159-8d4cf495c50f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:14.852817 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec0723e-549c-4965-a159-8d4cf495c50f None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:14.854618 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-2926cdab-eb7f-4b50-9a14-60d5657de801 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:18:14.856125 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-2926cdab-eb7f-4b50-9a14-60d5657de801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:18:14.862405 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 438/886] 10.222.0.26 () {56 vars in 1115 bytes} [Fri Aug 12 01:18:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:14.871194 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec0723e-549c-4965-a159-8d4cf495c50f None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:14.892326 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:14.945910 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 449/887] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:18:14 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 01:18:14.986741 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec0723e-549c-4965-a159-8d4cf495c50f None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:15.021975 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fdb990-ca48-4640-ae98-9cbe01b4547a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:15.022985 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fdb990-ca48-4640-ae98-9cbe01b4547a None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:15.023412 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fdb990-ca48-4640-ae98-9cbe01b4547a None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:15.023826 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fdb990-ca48-4640-ae98-9cbe01b4547a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:15.035833 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fdb990-ca48-4640-ae98-9cbe01b4547a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:15.037567 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fdb990-ca48-4640-ae98-9cbe01b4547a None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:15.052809 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-51fdb990-ca48-4640-ae98-9cbe01b4547a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:18:15.052809 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:15.052809 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:15.052809 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:15.052809 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:15.052809 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:15.052809 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:15.052809 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:15.052809 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:15.052809 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:15.052809 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:15.052809 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:15.052809 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 01:18:15.052809 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 01:18:15.052809 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 01:18:15.052809 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 01:18:15.053947 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:15.053947 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:15.053947 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:15.053947 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:15.053947 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:15.053947 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:15.053947 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:15.053947 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:15.053947 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:15.053947 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:15.053947 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:15.053947 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:15.053947 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:15.053947 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:15.053947 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:15.053947 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:15.053947 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 01:18:15.055169 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 01:18:15.055169 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:18:15.055169 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:18:15.056913 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 439/888] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:18:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:18:15.062552 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2926cdab-eb7f-4b50-9a14-60d5657de801 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:15.064769 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d8848-c6fb-4658-ae25-43c561372c73 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:15.065130 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d8848-c6fb-4658-ae25-43c561372c73 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:15.065586 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d8848-c6fb-4658-ae25-43c561372c73 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:15.067157 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 440/889] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:18:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 01:18:15.072390 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b607b90-7dac-4615-baf8-9f7db9261488 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:15.072668 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b607b90-7dac-4615-baf8-9f7db9261488 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:15.072937 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b607b90-7dac-4615-baf8-9f7db9261488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:15.091206 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-9b607b90-7dac-4615-baf8-9f7db9261488 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:18:15.092360 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-9b607b90-7dac-4615-baf8-9f7db9261488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:18:15.126469 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:15.156532 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:15.162103 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 441/890] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:18:15 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 01:18:15.180924 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2926cdab-eb7f-4b50-9a14-60d5657de801 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:15.219289 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b0814f-3d62-46a6-b168-8d49838d9ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:15.220459 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b0814f-3d62-46a6-b168-8d49838d9ce2 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:15.220956 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b0814f-3d62-46a6-b168-8d49838d9ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:15.221479 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b0814f-3d62-46a6-b168-8d49838d9ce2 None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:15.222362 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b0814f-3d62-46a6-b168-8d49838d9ce2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:15.222875 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b0814f-3d62-46a6-b168-8d49838d9ce2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:15.224444 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b0814f-3d62-46a6-b168-8d49838d9ce2 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:15.236890 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 450/891] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 01:18:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:15.242891 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b607b90-7dac-4615-baf8-9f7db9261488 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:15.245719 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b0814f-3d62-46a6-b168-8d49838d9ce2 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:15.355942 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b607b90-7dac-4615-baf8-9f7db9261488 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:15.356623 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b0814f-3d62-46a6-b168-8d49838d9ce2 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:15.382365 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:15.402522 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c453cba9-a347-4bbf-99cd-0ebd0810845f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:15.403275 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453cba9-a347-4bbf-99cd-0ebd0810845f None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:15.403601 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453cba9-a347-4bbf-99cd-0ebd0810845f None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:15.403913 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453cba9-a347-4bbf-99cd-0ebd0810845f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:15.404444 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c453cba9-a347-4bbf-99cd-0ebd0810845f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:15.405209 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad96c00b-ddbb-4b75-b54e-788d3acf7d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:15.405914 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c453cba9-a347-4bbf-99cd-0ebd0810845f None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:15.406035 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad96c00b-ddbb-4b75-b54e-788d3acf7d80 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:15.406398 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad96c00b-ddbb-4b75-b54e-788d3acf7d80 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:15.406758 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad96c00b-ddbb-4b75-b54e-788d3acf7d80 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:15.414474 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad96c00b-ddbb-4b75-b54e-788d3acf7d80 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:15.416362 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad96c00b-ddbb-4b75-b54e-788d3acf7d80 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:15.416784 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-c453cba9-a347-4bbf-99cd-0ebd0810845f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 12 01:18:15.416784 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:15.416784 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 01:18:15.416784 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 01:18:15.416784 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 01:18:15.416784 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 01:18:15.416784 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 01:18:15.416784 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 01:18:15.416784 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 12 01:18:15.416784 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:18:15.416784 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 01:18:15.416784 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:18:15.416784 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:15.416784 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:15.416784 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:15.416784 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:15.416784 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:15.418008 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:15.418008 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:15.418008 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:15.418008 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:15.418008 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:15.418008 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:15.418008 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 01:18:15.418008 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 01:18:15.418008 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 01:18:15.418008 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 01:18:15.418008 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:15.418008 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:15.418008 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:15.418008 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:15.418008 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:15.418008 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:15.418972 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:15.418972 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:15.418972 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:15.418972 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:15.418972 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:15.418972 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:15.418972 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:15.418972 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:15.418972 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:15.418972 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:15.418972 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 01:18:15.418972 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 01:18:15.418972 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 12 01:18:15.418972 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:18:15.418972 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 451/892] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Aug 12 01:18:15 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 01:18:15.423761 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c453cba9-a347-4bbf-99cd-0ebd0810845f None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:15.434600 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-ad96c00b-ddbb-4b75-b54e-788d3acf7d80 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 12 01:18:15.434600 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:15.434600 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:15.434600 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:15.434600 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:15.434600 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:15.434600 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:15.434600 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:15.434600 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:15.434600 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:15.434600 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:15.434600 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:15.434600 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 01:18:15.434600 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 01:18:15.434600 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 01:18:15.434600 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 01:18:15.435785 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:15.435785 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:15.435785 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 01:18:15.435785 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 01:18:15.435785 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 01:18:15.435785 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 01:18:15.435785 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:15.435785 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:15.435785 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:15.435785 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:15.435785 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:15.435785 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:15.435785 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:15.435785 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:15.435785 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:15.435785 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:15.435785 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:15.435785 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:15.436954 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:15.436954 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:15.436954 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 01:18:15.436954 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 01:18:15.436954 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 01:18:15.436954 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 01:18:15.436954 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 01:18:15.436954 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 01:18:15.436954 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 12 01:18:15.436954 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:18:15.442408 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 442/893] 10.222.0.26 () {56 vars in 1117 bytes} [Fri Aug 12 01:18:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:18:15.451065 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad96c00b-ddbb-4b75-b54e-788d3acf7d80 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:15.530736 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:15.536948 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c453cba9-a347-4bbf-99cd-0ebd0810845f None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:15.571958 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d7d70-9bd7-4e0e-a48b-24ebc48e144a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:15.572585 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d7d70-9bd7-4e0e-a48b-24ebc48e144a None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:15.572863 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d7d70-9bd7-4e0e-a48b-24ebc48e144a None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:15.573140 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d7d70-9bd7-4e0e-a48b-24ebc48e144a None admin] PATH_INFO: `/v3/services` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:15.573769 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711d7d70-9bd7-4e0e-a48b-24ebc48e144a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:15.574071 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711d7d70-9bd7-4e0e-a48b-24ebc48e144a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:15.575365 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad96c00b-ddbb-4b75-b54e-788d3acf7d80 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:15.575480 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711d7d70-9bd7-4e0e-a48b-24ebc48e144a None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:15.580368 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 452/894] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Aug 12 01:18:15 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:15.583535 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d7d70-9bd7-4e0e-a48b-24ebc48e144a None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:15.615280 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a4cc4-9791-4a00-902f-a56232edcb43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:15.615870 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a4cc4-9791-4a00-902f-a56232edcb43 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:15.616082 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a4cc4-9791-4a00-902f-a56232edcb43 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:15.616346 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a4cc4-9791-4a00-902f-a56232edcb43 None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:15.617077 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9a4cc4-9791-4a00-902f-a56232edcb43 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:15.617379 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9a4cc4-9791-4a00-902f-a56232edcb43 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:15.618859 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9a4cc4-9791-4a00-902f-a56232edcb43 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:15.636279 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:15.641326 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 443/895] 10.222.0.26 () {56 vars in 1149 bytes} [Fri Aug 12 01:18:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:15.642254 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a4cc4-9791-4a00-902f-a56232edcb43 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:15.697896 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d7d70-9bd7-4e0e-a48b-24ebc48e144a None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:15.732173 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c0f19e-3460-4f46-837b-be4217e671d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:15.732780 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c0f19e-3460-4f46-837b-be4217e671d6 None admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:15.733051 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c0f19e-3460-4f46-837b-be4217e671d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:15.733325 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c0f19e-3460-4f46-837b-be4217e671d6 None admin] PATH_INFO: `/v3/services` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:15.733960 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c0f19e-3460-4f46-837b-be4217e671d6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:15.735339 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c0f19e-3460-4f46-837b-be4217e671d6 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:15.744160 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a4cc4-9791-4a00-902f-a56232edcb43 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:15.751522 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 453/896] 10.222.0.26 () {60 vars in 1141 bytes} [Fri Aug 12 01:18:15 2022] POST /identity/v3/services => generated 241 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:18:15.752502 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c0f19e-3460-4f46-837b-be4217e671d6 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:15.781020 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:15.814684 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce29e3a-93f3-4e83-bd88-3726895cbd0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:15.816676 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce29e3a-93f3-4e83-bd88-3726895cbd0c None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:15.817139 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce29e3a-93f3-4e83-bd88-3726895cbd0c None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:15.817585 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce29e3a-93f3-4e83-bd88-3726895cbd0c None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:15.818825 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce29e3a-93f3-4e83-bd88-3726895cbd0c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:15.819625 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce29e3a-93f3-4e83-bd88-3726895cbd0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:15.821551 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce29e3a-93f3-4e83-bd88-3726895cbd0c None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:15.829301 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 444/897] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Aug 12 01:18:15 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:15.838227 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce29e3a-93f3-4e83-bd88-3726895cbd0c None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:15.896575 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c0f19e-3460-4f46-837b-be4217e671d6 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:15.906925 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:15.939874 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe03c69-a190-4a7c-b6d0-1159ef9e5d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:15.940484 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe03c69-a190-4a7c-b6d0-1159ef9e5d69 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:15.940753 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe03c69-a190-4a7c-b6d0-1159ef9e5d69 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:15.941443 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe03c69-a190-4a7c-b6d0-1159ef9e5d69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:15.953547 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce29e3a-93f3-4e83-bd88-3726895cbd0c None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:15.987686 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23371748-37c4-4289-b092-af3a2a07d24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:15.988575 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23371748-37c4-4289-b092-af3a2a07d24f None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:15.989007 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23371748-37c4-4289-b092-af3a2a07d24f None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:15.989429 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23371748-37c4-4289-b092-af3a2a07d24f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:15.990298 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23371748-37c4-4289-b092-af3a2a07d24f None admin] RBAC: Adding query filter params (interface=public, service_id=77c38b63185b4c2f97336028c79057cb, region_id=RegionOne) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:15.990772 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23371748-37c4-4289-b092-af3a2a07d24f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:15.992285 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23371748-37c4-4289-b092-af3a2a07d24f None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:16.002200 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 445/898] 10.222.0.26 () {56 vars in 1251 bytes} [Fri Aug 12 01:18:15 2022] GET /identity/v3/endpoints?service_id=77c38b63185b4c2f97336028c79057cb&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:16.002200 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868777e0-4ba5-4706-b8dc-b8614b23a947 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:16.002200 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868777e0-4ba5-4706-b8dc-b8614b23a947 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:16.002200 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868777e0-4ba5-4706-b8dc-b8614b23a947 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:16.002850 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 446/899] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:18:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:18:16.006973 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868777e0-4ba5-4706-b8dc-b8614b23a947 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:16.015559 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe03c69-a190-4a7c-b6d0-1159ef9e5d69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:16.016747 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe03c69-a190-4a7c-b6d0-1159ef9e5d69 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:16.051828 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:16.115301 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868777e0-4ba5-4706-b8dc-b8614b23a947 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:16.130698 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 454/900] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 01:18:15 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 01:18:16.131879 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b7290-4461-4e4a-866f-57b00791beaa None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:16.132169 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b7290-4461-4e4a-866f-57b00791beaa None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:16.132439 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b7290-4461-4e4a-866f-57b00791beaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:16.149932 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-ed3b7290-4461-4e4a-866f-57b00791beaa None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:18:16.151079 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-ed3b7290-4461-4e4a-866f-57b00791beaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:18:16.153256 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:16.157618 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf781c1-4f8a-473e-ae11-f390b91a69ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:16.158256 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf781c1-4f8a-473e-ae11-f390b91a69ff None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:16.158626 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf781c1-4f8a-473e-ae11-f390b91a69ff None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:16.159310 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf781c1-4f8a-473e-ae11-f390b91a69ff None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:16.159510 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf781c1-4f8a-473e-ae11-f390b91a69ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:16.160837 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf781c1-4f8a-473e-ae11-f390b91a69ff None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:16.178156 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 447/901] 10.222.0.26 () {56 vars in 1087 bytes} [Fri Aug 12 01:18:16 2022] GET /identity/v3/services => generated 1497 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:18:16.178156 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf781c1-4f8a-473e-ae11-f390b91a69ff None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:16.262263 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 455/902] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:18:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 01:18:16.295775 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf781c1-4f8a-473e-ae11-f390b91a69ff None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:16.313480 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:16.335898 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde99503-5402-4c3f-9047-b815302ef692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:16.336527 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde99503-5402-4c3f-9047-b815302ef692 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:16.336795 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde99503-5402-4c3f-9047-b815302ef692 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:16.337058 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde99503-5402-4c3f-9047-b815302ef692 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:16.348160 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde99503-5402-4c3f-9047-b815302ef692 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:16.349603 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde99503-5402-4c3f-9047-b815302ef692 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:16.367124 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-cde99503-5402-4c3f-9047-b815302ef692 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:18:16.367124 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:16.367124 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:16.367124 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:16.367124 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:16.367124 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:16.367124 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:16.367124 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:16.367124 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:16.367124 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:16.367124 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:16.367124 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:16.367124 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 01:18:16.367124 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 01:18:16.367124 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 01:18:16.367124 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 01:18:16.368090 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:16.368090 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:16.368090 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:16.368090 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:16.368090 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:16.368090 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:16.368090 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:16.368090 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:16.368090 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:16.368090 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:16.368090 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:16.368090 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:16.368090 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:16.368090 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:16.368090 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:16.368090 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:16.368090 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 01:18:16.368962 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 01:18:16.368962 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:18:16.368962 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:18:16.370736 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 448/903] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:18:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:18:16.377010 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b7290-4461-4e4a-866f-57b00791beaa None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:16.482082 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b7290-4461-4e4a-866f-57b00791beaa None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:16.520389 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b0877f-6a76-4a03-abe8-f8a37881eec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:16.521006 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b0877f-6a76-4a03-abe8-f8a37881eec8 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:16.521284 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b0877f-6a76-4a03-abe8-f8a37881eec8 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:16.521552 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b0877f-6a76-4a03-abe8-f8a37881eec8 None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:16.522222 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b0877f-6a76-4a03-abe8-f8a37881eec8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:16.522526 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b0877f-6a76-4a03-abe8-f8a37881eec8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:16.523896 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b0877f-6a76-4a03-abe8-f8a37881eec8 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:16.530557 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:16.536023 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 456/904] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 01:18:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:16.542211 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde99503-5402-4c3f-9047-b815302ef692 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:16.573259 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b0877f-6a76-4a03-abe8-f8a37881eec8 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:16.655280 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde99503-5402-4c3f-9047-b815302ef692 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:16.677281 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b0877f-6a76-4a03-abe8-f8a37881eec8 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:16.695632 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29afaaa1-a2a9-4c0d-9176-c23010dc28df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:16.696297 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29afaaa1-a2a9-4c0d-9176-c23010dc28df None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:16.696571 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29afaaa1-a2a9-4c0d-9176-c23010dc28df None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:16.696840 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29afaaa1-a2a9-4c0d-9176-c23010dc28df None admin] PATH_INFO: `/v3/projects/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:16.704608 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29afaaa1-a2a9-4c0d-9176-c23010dc28df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:16.706938 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29afaaa1-a2a9-4c0d-9176-c23010dc28df None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:16.712429 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3641498-3ba8-4924-b0ad-1f075d820922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:16.713070 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3641498-3ba8-4924-b0ad-1f075d820922 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:16.713345 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3641498-3ba8-4924-b0ad-1f075d820922 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:16.713614 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3641498-3ba8-4924-b0ad-1f075d820922 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:16.714499 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3641498-3ba8-4924-b0ad-1f075d820922 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:16.715849 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3641498-3ba8-4924-b0ad-1f075d820922 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:16.719729 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-29afaaa1-a2a9-4c0d-9176-c23010dc28df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 01:18:16.719729 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:16.719729 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:16.719729 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:16.719729 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:16.719729 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:16.719729 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:16.719729 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:16.719729 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:16.719729 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:16.719729 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:16.719729 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:16.719729 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 01:18:16.719729 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 01:18:16.719729 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 01:18:16.721277 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 01:18:16.721277 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:16.721277 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:16.721277 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:16.721277 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:16.721277 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:16.721277 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:16.721277 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:16.721277 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:16.721277 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:16.721277 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:16.721277 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:16.721277 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:16.721277 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:16.721277 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:16.721277 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:16.721277 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:16.723022 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 01:18:16.723022 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 01:18:16.723022 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 01:18:16.723022 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 01:18:16.723022 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 01:18:16.723022 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 01:18:16.723022 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 01:18:16.723022 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:18:16.726790 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-d3641498-3ba8-4924-b0ad-1f075d820922 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 12 01:18:16.726790 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:16.726790 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 01:18:16.726790 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 01:18:16.726790 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 01:18:16.726790 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 01:18:16.726790 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 01:18:16.726790 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 01:18:16.726790 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 12 01:18:16.726790 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:18:16.726790 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 01:18:16.726790 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:18:16.726790 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:16.726790 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:16.726790 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:16.726790 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:16.728919 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:16.728919 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:16.728919 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:16.728919 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:16.728919 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:16.728919 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:16.728919 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:16.728919 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 01:18:16.728919 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 01:18:16.728919 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 01:18:16.728919 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 01:18:16.728919 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:16.728919 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:16.728919 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:16.728919 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:16.728919 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:16.728919 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:16.736347 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:16.736347 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:16.736347 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:16.736347 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:16.736347 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:16.736347 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:16.736347 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:16.736347 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:16.736347 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:16.736347 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:16.736347 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 01:18:16.736347 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 01:18:16.736347 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 12 01:18:16.736347 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:18:16.738083 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 449/905] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 01:18:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:18:16.738083 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29afaaa1-a2a9-4c0d-9176-c23010dc28df None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:16.738341 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 457/906] 10.222.0.26 () {56 vars in 1132 bytes} [Fri Aug 12 01:18:16 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 01:18:16.738341 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3641498-3ba8-4924-b0ad-1f075d820922 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:16.751643 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:16.816260 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:16.848674 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29afaaa1-a2a9-4c0d-9176-c23010dc28df None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:16.863338 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3641498-3ba8-4924-b0ad-1f075d820922 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:16.885047 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887f0fdd-932b-457c-84d5-9673fc5549cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:16.885659 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f0fdd-932b-457c-84d5-9673fc5549cb None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:16.885935 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f0fdd-932b-457c-84d5-9673fc5549cb None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:16.886229 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f0fdd-932b-457c-84d5-9673fc5549cb None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:16.886929 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887f0fdd-932b-457c-84d5-9673fc5549cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:16.887231 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887f0fdd-932b-457c-84d5-9673fc5549cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:16.888668 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887f0fdd-932b-457c-84d5-9673fc5549cb None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:16.901360 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 450/907] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Aug 12 01:18:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:16.903786 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03fb7ae-46da-4886-bb7d-e3bdd868fdc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:16.904649 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03fb7ae-46da-4886-bb7d-e3bdd868fdc8 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:16.905120 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03fb7ae-46da-4886-bb7d-e3bdd868fdc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:16.905576 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03fb7ae-46da-4886-bb7d-e3bdd868fdc8 None admin] PATH_INFO: `/v3/services` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:16.906740 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03fb7ae-46da-4886-bb7d-e3bdd868fdc8 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:16.906938 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887f0fdd-932b-457c-84d5-9673fc5549cb None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:16.907434 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03fb7ae-46da-4886-bb7d-e3bdd868fdc8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:16.909117 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03fb7ae-46da-4886-bb7d-e3bdd868fdc8 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:16.915397 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 458/908] 10.222.0.26 () {56 vars in 1126 bytes} [Fri Aug 12 01:18:16 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:16.921245 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03fb7ae-46da-4886-bb7d-e3bdd868fdc8 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:17.008675 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:17.036867 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887f0fdd-932b-457c-84d5-9673fc5549cb None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:17.043749 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03fb7ae-46da-4886-bb7d-e3bdd868fdc8 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:17.075730 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:17.082671 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fe28f8-680b-4c78-8736-e3e8b425228e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:17.083286 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe28f8-680b-4c78-8736-e3e8b425228e None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:17.083553 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe28f8-680b-4c78-8736-e3e8b425228e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:17.083817 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe28f8-680b-4c78-8736-e3e8b425228e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:17.084544 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fe28f8-680b-4c78-8736-e3e8b425228e None admin] RBAC: Adding query filter params (role.id=90822fc7f8cf4ded8bccf87f3036eb1a, scope.project.id=fa91143910a74c6b896ced5b51f9966a, user.id=f3643631cf2d4a9592d465bdeba99669) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:17.084875 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fe28f8-680b-4c78-8736-e3e8b425228e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:17.086293 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fe28f8-680b-4c78-8736-e3e8b425228e None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:17.087725 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8347b1c-a0f0-4e47-8121-1af4fc21ce26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:17.088709 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8347b1c-a0f0-4e47-8121-1af4fc21ce26 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:17.089633 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8347b1c-a0f0-4e47-8121-1af4fc21ce26 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:17.090139 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8347b1c-a0f0-4e47-8121-1af4fc21ce26 None admin] PATH_INFO: `/v3/services` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:17.091213 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8347b1c-a0f0-4e47-8121-1af4fc21ce26 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:17.091714 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8347b1c-a0f0-4e47-8121-1af4fc21ce26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:17.092444 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 451/909] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 01:18:16 2022] GET /identity/v3/role_assignments?user.id=f3643631cf2d4a9592d465bdeba99669&scope.project.id=fa91143910a74c6b896ced5b51f9966a&role.id=90822fc7f8cf4ded8bccf87f3036eb1a => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:18:17.093547 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8347b1c-a0f0-4e47-8121-1af4fc21ce26 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:17.099696 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 459/910] 10.222.0.26 () {56 vars in 1126 bytes} [Fri Aug 12 01:18:16 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:18:17.109990 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fe28f8-680b-4c78-8736-e3e8b425228e None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:17.219020 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fe28f8-680b-4c78-8736-e3e8b425228e None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:17.256528 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a62ac5-60e9-431d-a599-b26b21afbf1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:17.257226 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a62ac5-60e9-431d-a599-b26b21afbf1c None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:17.257509 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a62ac5-60e9-431d-a599-b26b21afbf1c None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:17.257779 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a62ac5-60e9-431d-a599-b26b21afbf1c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:17.258522 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a62ac5-60e9-431d-a599-b26b21afbf1c None admin] RBAC: Adding query filter params (interface=public, service_id=f309f4f6176c413a890e57b578ace66c, region_id=RegionOne) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:17.258880 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a62ac5-60e9-431d-a599-b26b21afbf1c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:17.260222 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a62ac5-60e9-431d-a599-b26b21afbf1c None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:17.266485 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 452/911] 10.222.0.26 () {56 vars in 1251 bytes} [Fri Aug 12 01:18:17 2022] GET /identity/v3/endpoints?service_id=f309f4f6176c413a890e57b578ace66c&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:17.272466 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8347b1c-a0f0-4e47-8121-1af4fc21ce26 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:17.380413 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8347b1c-a0f0-4e47-8121-1af4fc21ce26 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:17.415918 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dad108-f666-4b3c-806c-078866b615ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:17.416535 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dad108-f666-4b3c-806c-078866b615ef None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:17.416811 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dad108-f666-4b3c-806c-078866b615ef None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:17.417083 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dad108-f666-4b3c-806c-078866b615ef None admin] PATH_INFO: `/v3/services` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:17.417694 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dad108-f666-4b3c-806c-078866b615ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:17.419080 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dad108-f666-4b3c-806c-078866b615ef None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:17.425745 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 460/912] 10.222.0.26 () {56 vars in 1087 bytes} [Fri Aug 12 01:18:17 2022] GET /identity/v3/services => generated 1497 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:18:17.737818 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b447bba-4052-4885-b955-e32d58e3520e None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:17.738202 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b447bba-4052-4885-b955-e32d58e3520e None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:17.738403 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b447bba-4052-4885-b955-e32d58e3520e None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:17.739969 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 453/913] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:18:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:18:17.745509 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f73584-5bc1-42c7-81f9-2be7ef0eb4f3 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:17.745794 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f73584-5bc1-42c7-81f9-2be7ef0eb4f3 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:17.746063 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f73584-5bc1-42c7-81f9-2be7ef0eb4f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:17.764866 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-44f73584-5bc1-42c7-81f9-2be7ef0eb4f3 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:18:17.766048 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-44f73584-5bc1-42c7-81f9-2be7ef0eb4f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:18:17.819662 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:17.839481 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 461/914] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:18:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 01:18:18.110426 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b447bba-4052-4885-b955-e32d58e3520e None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:18.120595 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:18.152685 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335cab41-dd69-43a7-bab1-3835c45841ea None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:18.153310 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335cab41-dd69-43a7-bab1-3835c45841ea None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:18.153825 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335cab41-dd69-43a7-bab1-3835c45841ea None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:18.155668 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 462/915] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:18:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 01:18:18.161385 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ab485-3c93-4d02-81d0-7819782a893a None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:18.161734 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ab485-3c93-4d02-81d0-7819782a893a None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:18.162086 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ab485-3c93-4d02-81d0-7819782a893a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:18.185370 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-624ab485-3c93-4d02-81d0-7819782a893a None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:18:18.187001 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-624ab485-3c93-4d02-81d0-7819782a893a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:18:18.225174 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b447bba-4052-4885-b955-e32d58e3520e None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:18.269375 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 463/916] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:18:18 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 01:18:18.269689 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53467ee1-eca8-42fe-8f35-9e8a56c7ba3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:18.275032 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53467ee1-eca8-42fe-8f35-9e8a56c7ba3b None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:18.275032 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53467ee1-eca8-42fe-8f35-9e8a56c7ba3b None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:18.275032 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53467ee1-eca8-42fe-8f35-9e8a56c7ba3b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:18.275032 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53467ee1-eca8-42fe-8f35-9e8a56c7ba3b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:18.275032 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53467ee1-eca8-42fe-8f35-9e8a56c7ba3b None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:18.282358 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-53467ee1-eca8-42fe-8f35-9e8a56c7ba3b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 12 01:18:18.282358 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:18.282358 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 01:18:18.282358 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 01:18:18.282358 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 01:18:18.282358 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 01:18:18.282358 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 01:18:18.282358 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 01:18:18.282358 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 12 01:18:18.282358 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:18:18.282358 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 01:18:18.282358 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:18:18.282358 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:18.282358 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:18.282358 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:18.282358 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:18.282358 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:18.283406 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:18.283406 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:18.283406 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:18.283406 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:18.283406 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:18.283406 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:18.283406 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 01:18:18.283406 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 01:18:18.283406 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 01:18:18.283406 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 01:18:18.283406 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:18.283406 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:18.283406 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:18.283406 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:18.283406 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:18.283406 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:18.284897 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:18.284897 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:18.284897 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:18.284897 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:18.284897 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:18.284897 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:18.284897 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:18.284897 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:18.284897 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:18.284897 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:18.284897 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 01:18:18.284897 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 01:18:18.284897 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 12 01:18:18.284897 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:18:18.284897 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 454/917] 10.222.0.26 () {56 vars in 1126 bytes} [Fri Aug 12 01:18:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:18:18.292410 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ab485-3c93-4d02-81d0-7819782a893a None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:18.395919 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ab485-3c93-4d02-81d0-7819782a893a None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:18.411759 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:18.439630 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1eb001-110f-4a13-b66c-8bd183191cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:18.440242 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1eb001-110f-4a13-b66c-8bd183191cf9 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:18.440513 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1eb001-110f-4a13-b66c-8bd183191cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:18.440779 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1eb001-110f-4a13-b66c-8bd183191cf9 None admin] PATH_INFO: `/v3/services` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:18.441407 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1eb001-110f-4a13-b66c-8bd183191cf9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:18.441702 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1eb001-110f-4a13-b66c-8bd183191cf9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:18.443083 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1eb001-110f-4a13-b66c-8bd183191cf9 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:18.448984 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 464/918] 10.222.0.26 () {56 vars in 1122 bytes} [Fri Aug 12 01:18:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:18.454589 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53467ee1-eca8-42fe-8f35-9e8a56c7ba3b None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:18.539419 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:18.574494 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53467ee1-eca8-42fe-8f35-9e8a56c7ba3b None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:18.575092 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1eb001-110f-4a13-b66c-8bd183191cf9 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:18.610920 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa68bd5c-7572-45ae-9672-949eb39fdc9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:18.612215 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa68bd5c-7572-45ae-9672-949eb39fdc9c None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:18.612473 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa68bd5c-7572-45ae-9672-949eb39fdc9c None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:18.612865 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa68bd5c-7572-45ae-9672-949eb39fdc9c None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:18.614050 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa68bd5c-7572-45ae-9672-949eb39fdc9c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:18.614302 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa68bd5c-7572-45ae-9672-949eb39fdc9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:18.615681 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa68bd5c-7572-45ae-9672-949eb39fdc9c None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:18.621053 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 455/919] 10.222.0.26 () {56 vars in 1122 bytes} [Fri Aug 12 01:18:18 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:18.626868 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa68bd5c-7572-45ae-9672-949eb39fdc9c None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:18.696815 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1eb001-110f-4a13-b66c-8bd183191cf9 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:18.733262 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294ce2e6-be60-4fd4-ad03-54dd1044fdcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:18.733899 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ce2e6-be60-4fd4-ad03-54dd1044fdcf None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:18.734221 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ce2e6-be60-4fd4-ad03-54dd1044fdcf None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:18.734494 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ce2e6-be60-4fd4-ad03-54dd1044fdcf None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:18.735081 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294ce2e6-be60-4fd4-ad03-54dd1044fdcf None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:18.736502 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294ce2e6-be60-4fd4-ad03-54dd1044fdcf None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:18.745767 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-294ce2e6-be60-4fd4-ad03-54dd1044fdcf None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 12 01:18:18.745767 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:18.745767 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 01:18:18.745767 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 01:18:18.745767 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 01:18:18.745767 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 01:18:18.745767 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 01:18:18.745767 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 01:18:18.745767 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 12 01:18:18.745767 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:18:18.745767 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 01:18:18.745767 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:18:18.745767 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:18.745767 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:18.745767 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:18.745767 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:18.745767 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:18.746869 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:18.746869 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:18.746869 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:18.746869 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:18.746869 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:18.746869 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:18.746869 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 01:18:18.746869 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 01:18:18.746869 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 01:18:18.746869 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 01:18:18.746869 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:18.746869 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:18.746869 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:18.746869 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:18.746869 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:18.746869 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:18.747722 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:18.747722 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:18.747722 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:18.747722 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:18.747722 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:18.747722 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:18.747722 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:18.747722 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:18.747722 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:18.747722 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:18.747722 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 01:18:18.747722 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 01:18:18.747722 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 12 01:18:18.747722 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:18:18.747722 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 465/920] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Aug 12 01:18:18 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:18:18.755438 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294ce2e6-be60-4fd4-ad03-54dd1044fdcf None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:18.759918 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa68bd5c-7572-45ae-9672-949eb39fdc9c None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:18.795436 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac36d2a-73e1-49ff-8aeb-7d46bdc61553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:18.796137 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac36d2a-73e1-49ff-8aeb-7d46bdc61553 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:18.796517 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac36d2a-73e1-49ff-8aeb-7d46bdc61553 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:18.796853 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac36d2a-73e1-49ff-8aeb-7d46bdc61553 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:18.797623 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac36d2a-73e1-49ff-8aeb-7d46bdc61553 None admin] RBAC: Adding query filter params (interface=public, service_id=28de8efe7b20456794869d9d2a55cd0e, region_id=RegionOne) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:18.797992 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac36d2a-73e1-49ff-8aeb-7d46bdc61553 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:18.799785 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac36d2a-73e1-49ff-8aeb-7d46bdc61553 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:18.801395 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:18.804032 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:18.813006 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 456/921] 10.222.0.26 () {56 vars in 1251 bytes} [Fri Aug 12 01:18:18 2022] GET /identity/v3/endpoints?service_id=28de8efe7b20456794869d9d2a55cd0e&interface=public®ion_id=RegionOne => generated 194 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:18.814213 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac36d2a-73e1-49ff-8aeb-7d46bdc61553 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:18.867878 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294ce2e6-be60-4fd4-ad03-54dd1044fdcf None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:18.904500 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a79e73-0aaf-46b2-b687-083bcc0ec3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:18.905261 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a79e73-0aaf-46b2-b687-083bcc0ec3a0 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:18.905632 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a79e73-0aaf-46b2-b687-083bcc0ec3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:18.905994 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a79e73-0aaf-46b2-b687-083bcc0ec3a0 None admin] PATH_INFO: `/v3/services` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:18.906836 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a79e73-0aaf-46b2-b687-083bcc0ec3a0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:18.907256 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a79e73-0aaf-46b2-b687-083bcc0ec3a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:18.909441 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a79e73-0aaf-46b2-b687-083bcc0ec3a0 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:18.920155 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 466/922] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Aug 12 01:18:18 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:18:18.921184 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a79e73-0aaf-46b2-b687-083bcc0ec3a0 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:18.926403 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac36d2a-73e1-49ff-8aeb-7d46bdc61553 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:18.963539 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee414ee9-dc58-4de5-9cdd-e02482d7ec2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:18.964389 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee414ee9-dc58-4de5-9cdd-e02482d7ec2b None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:18.964849 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee414ee9-dc58-4de5-9cdd-e02482d7ec2b None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:18.965277 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee414ee9-dc58-4de5-9cdd-e02482d7ec2b None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:18.966147 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee414ee9-dc58-4de5-9cdd-e02482d7ec2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:18.967677 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee414ee9-dc58-4de5-9cdd-e02482d7ec2b None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:18.978264 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 457/923] 10.222.0.26 () {56 vars in 1087 bytes} [Fri Aug 12 01:18:18 2022] GET /identity/v3/services => generated 1497 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:18:19.035717 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a79e73-0aaf-46b2-b687-083bcc0ec3a0 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:19.044072 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:19.059666 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc4c3c-88e4-4346-82c1-162fd91d7345 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:19.059990 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc4c3c-88e4-4346-82c1-162fd91d7345 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:19.060216 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc4c3c-88e4-4346-82c1-162fd91d7345 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:19.062043 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 458/924] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:18:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 01:18:19.068225 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995de8dd-9a72-41c8-be9d-5103e7b8fead None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:19.068519 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995de8dd-9a72-41c8-be9d-5103e7b8fead None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:19.068770 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995de8dd-9a72-41c8-be9d-5103e7b8fead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:19.074875 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b2807-7f92-47d4-986c-f57af9b47a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:19.075804 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b2807-7f92-47d4-986c-f57af9b47a92 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:19.075913 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b2807-7f92-47d4-986c-f57af9b47a92 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:19.076156 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b2807-7f92-47d4-986c-f57af9b47a92 None admin] PATH_INFO: `/v3/services` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:19.076907 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491b2807-7f92-47d4-986c-f57af9b47a92 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:19.077206 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491b2807-7f92-47d4-986c-f57af9b47a92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:19.078616 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491b2807-7f92-47d4-986c-f57af9b47a92 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:19.084709 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 467/925] 10.222.0.26 () {56 vars in 1114 bytes} [Fri Aug 12 01:18:18 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:19.089125 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-995de8dd-9a72-41c8-be9d-5103e7b8fead None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:18:19.090437 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b2807-7f92-47d4-986c-f57af9b47a92 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:19.091032 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-995de8dd-9a72-41c8-be9d-5103e7b8fead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:18:19.167204 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:19.182815 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 459/926] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:18:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 01:18:19.211877 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b2807-7f92-47d4-986c-f57af9b47a92 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:19.250099 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e3bba9-9889-435f-8ed3-b821205dcab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:19.251152 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3bba9-9889-435f-8ed3-b821205dcab4 None admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:19.251641 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3bba9-9889-435f-8ed3-b821205dcab4 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:19.252236 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3bba9-9889-435f-8ed3-b821205dcab4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:19.253123 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e3bba9-9889-435f-8ed3-b821205dcab4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:19.254733 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e3bba9-9889-435f-8ed3-b821205dcab4 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:19.280391 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 468/927] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:18:19 2022] POST /identity/v3/endpoints => generated 346 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 01:18:19.391378 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91309d83-938b-4342-ac6b-8d106f4e8925 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:19.391720 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91309d83-938b-4342-ac6b-8d106f4e8925 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:19.391931 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91309d83-938b-4342-ac6b-8d106f4e8925 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:19.393819 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 460/928] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:18:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:18:19.399631 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02f6e8-3ffa-4e8c-a559-3c76c5856e53 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:19.400149 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02f6e8-3ffa-4e8c-a559-3c76c5856e53 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:19.400149 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02f6e8-3ffa-4e8c-a559-3c76c5856e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:19.420526 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-2e02f6e8-3ffa-4e8c-a559-3c76c5856e53 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:18:19.421724 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-2e02f6e8-3ffa-4e8c-a559-3c76c5856e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:18:19.444356 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:19.449575 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91309d83-938b-4342-ac6b-8d106f4e8925 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:19.511549 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 469/929] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:18:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 01:18:19.575678 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91309d83-938b-4342-ac6b-8d106f4e8925 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:19.612911 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f884bc-ff45-476e-83b7-770386829dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:19.613940 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f884bc-ff45-476e-83b7-770386829dee None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:19.614431 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f884bc-ff45-476e-83b7-770386829dee None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:19.614926 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f884bc-ff45-476e-83b7-770386829dee None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:19.626396 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f884bc-ff45-476e-83b7-770386829dee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:18:19.632166 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-96f884bc-ff45-476e-83b7-770386829dee None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 12 01:18:19.632166 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:19.632166 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:19.632166 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:19.632166 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:19.632166 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:19.632166 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:19.632166 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:19.632166 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:19.632166 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:19.632166 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:19.632166 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:19.632166 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:18:19.632166 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:18:19.632166 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:18:19.632166 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:18:19.633096 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:18:19.633096 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:18:19.633096 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:18:19.633096 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:18:19.633096 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:19.633096 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:19.633096 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:19.633096 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:19.633096 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:19.633096 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:19.633096 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:19.633096 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:19.633096 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:19.633096 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:19.633096 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:19.633096 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:19.633940 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:19.633940 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:19.633940 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:19.633940 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:19.633940 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:18:19.633940 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:18:19.633940 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:18:19.633940 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:18:19.633940 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:18:19.633940 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:18:19.633940 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 12 01:18:19.633940 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:18:19.636610 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 461/930] 10.222.0.26 () {56 vars in 1120 bytes} [Fri Aug 12 01:18:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:18:19.644714 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e02f6e8-3ffa-4e8c-a559-3c76c5856e53 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:19.770739 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e02f6e8-3ffa-4e8c-a559-3c76c5856e53 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:19.777383 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f884bc-ff45-476e-83b7-770386829dee None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:19.822361 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b0aac-a3bb-4a82-be81-7b917b7b45bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:19.823388 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b0aac-a3bb-4a82-be81-7b917b7b45bf None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:19.823874 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b0aac-a3bb-4a82-be81-7b917b7b45bf None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:19.824327 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b0aac-a3bb-4a82-be81-7b917b7b45bf None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:19.825192 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314b0aac-a3bb-4a82-be81-7b917b7b45bf None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:19.825707 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314b0aac-a3bb-4a82-be81-7b917b7b45bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:19.827493 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314b0aac-a3bb-4a82-be81-7b917b7b45bf None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:19.838190 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 470/931] 10.222.0.26 () {56 vars in 1115 bytes} [Fri Aug 12 01:18:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:19.843452 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b0aac-a3bb-4a82-be81-7b917b7b45bf None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:19.845834 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:19.871660 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:19.917929 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f884bc-ff45-476e-83b7-770386829dee None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:19.964425 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3d8384-79d6-4760-aa80-08ddec9756d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:19.965780 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d8384-79d6-4760-aa80-08ddec9756d5 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:19.968044 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d8384-79d6-4760-aa80-08ddec9756d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:19.968569 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d8384-79d6-4760-aa80-08ddec9756d5 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:19.969430 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3d8384-79d6-4760-aa80-08ddec9756d5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:19.971302 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3d8384-79d6-4760-aa80-08ddec9756d5 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:19.972172 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b0aac-a3bb-4a82-be81-7b917b7b45bf None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:19.982416 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-7e3d8384-79d6-4760-aa80-08ddec9756d5 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 12 01:18:19.982416 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:19.982416 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 01:18:19.982416 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 01:18:19.982416 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 01:18:19.982416 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 01:18:19.982416 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 01:18:19.982416 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 01:18:19.982416 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 12 01:18:19.982416 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:18:19.982416 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 01:18:19.982416 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:18:19.982416 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:19.982416 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:19.982416 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:19.982416 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:19.983607 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:19.983607 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:19.983607 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:19.983607 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:19.983607 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:19.983607 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:19.983607 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:19.983607 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 01:18:19.983607 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 01:18:19.983607 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 01:18:19.983607 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 01:18:19.983607 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:19.983607 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:19.983607 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:19.983607 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:19.983607 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:19.983607 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:19.986072 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:19.986072 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:19.986072 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:19.986072 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:19.986072 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:19.986072 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:19.986072 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:19.986072 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:19.986072 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:19.986072 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:19.986072 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 01:18:19.986072 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 01:18:19.986072 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 12 01:18:19.986072 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:18:19.991111 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 462/932] 10.222.0.26 () {56 vars in 1132 bytes} [Fri Aug 12 01:18:19 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:18:19.997909 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3d8384-79d6-4760-aa80-08ddec9756d5 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:20.014411 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3bceb7-8ed5-4f32-859d-6b85c11d149f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:20.015835 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3bceb7-8ed5-4f32-859d-6b85c11d149f None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:20.016308 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3bceb7-8ed5-4f32-859d-6b85c11d149f None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:20.016585 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3bceb7-8ed5-4f32-859d-6b85c11d149f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:20.035640 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3bceb7-8ed5-4f32-859d-6b85c11d149f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:20.037069 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3bceb7-8ed5-4f32-859d-6b85c11d149f None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:20.057761 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-8a3bceb7-8ed5-4f32-859d-6b85c11d149f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:18:20.057761 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:20.057761 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:20.057761 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:20.057761 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:20.057761 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:20.057761 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:20.057761 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:20.057761 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:20.057761 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:20.057761 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:20.057761 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:20.057761 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 01:18:20.057761 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 01:18:20.057761 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 01:18:20.057761 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 01:18:20.058900 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:20.058900 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:20.058900 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:20.058900 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:20.058900 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:20.058900 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:20.058900 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:20.058900 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:20.058900 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:20.058900 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:20.058900 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:20.058900 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:20.058900 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:20.058900 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:20.058900 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:20.058900 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:20.058900 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 01:18:20.059859 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 01:18:20.059859 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:18:20.059859 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:18:20.060450 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 471/933] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:18:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:18:20.066018 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3bceb7-8ed5-4f32-859d-6b85c11d149f None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:20.128027 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3d8384-79d6-4760-aa80-08ddec9756d5 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:20.146169 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:20.161479 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:20.172014 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c5ff2d-1bc4-4306-b7c6-80eb7e204d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:20.173165 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5ff2d-1bc4-4306-b7c6-80eb7e204d76 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:20.173677 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5ff2d-1bc4-4306-b7c6-80eb7e204d76 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:20.174296 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5ff2d-1bc4-4306-b7c6-80eb7e204d76 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:20.175551 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c5ff2d-1bc4-4306-b7c6-80eb7e204d76 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:20.176120 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c5ff2d-1bc4-4306-b7c6-80eb7e204d76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:20.177589 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c5ff2d-1bc4-4306-b7c6-80eb7e204d76 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:20.187936 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 463/934] 10.222.0.26 () {56 vars in 1126 bytes} [Fri Aug 12 01:18:19 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:20.190966 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c5ff2d-1bc4-4306-b7c6-80eb7e204d76 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:20.218527 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3bceb7-8ed5-4f32-859d-6b85c11d149f None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:20.272247 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f083670-ea21-4b1b-af17-2b08ad330b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:20.274165 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f083670-ea21-4b1b-af17-2b08ad330b8c None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:20.274642 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f083670-ea21-4b1b-af17-2b08ad330b8c None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:20.275084 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f083670-ea21-4b1b-af17-2b08ad330b8c None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:20.275871 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f083670-ea21-4b1b-af17-2b08ad330b8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:20.276400 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f083670-ea21-4b1b-af17-2b08ad330b8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:20.278001 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f083670-ea21-4b1b-af17-2b08ad330b8c None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:20.296227 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 472/935] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 01:18:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:18:20.302557 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f083670-ea21-4b1b-af17-2b08ad330b8c None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:20.309854 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c5ff2d-1bc4-4306-b7c6-80eb7e204d76 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:20.351011 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7008e94b-c1b2-457f-b1cc-a00bbe515a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:20.352041 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7008e94b-c1b2-457f-b1cc-a00bbe515a1e None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:20.352161 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7008e94b-c1b2-457f-b1cc-a00bbe515a1e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:20.352507 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7008e94b-c1b2-457f-b1cc-a00bbe515a1e None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:20.353243 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7008e94b-c1b2-457f-b1cc-a00bbe515a1e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:20.353635 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7008e94b-c1b2-457f-b1cc-a00bbe515a1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:20.355189 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7008e94b-c1b2-457f-b1cc-a00bbe515a1e None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:20.365795 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 464/936] 10.222.0.26 () {56 vars in 1126 bytes} [Fri Aug 12 01:18:20 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:18:20.368077 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7008e94b-c1b2-457f-b1cc-a00bbe515a1e None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:20.429344 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f083670-ea21-4b1b-af17-2b08ad330b8c None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:20.433257 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:20.458822 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:20.475477 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74252550-6af0-4794-ba30-be73c6bac4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:20.476510 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74252550-6af0-4794-ba30-be73c6bac4e2 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:20.477001 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74252550-6af0-4794-ba30-be73c6bac4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:20.478141 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74252550-6af0-4794-ba30-be73c6bac4e2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:20.488190 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74252550-6af0-4794-ba30-be73c6bac4e2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:20.490785 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74252550-6af0-4794-ba30-be73c6bac4e2 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:20.507345 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-74252550-6af0-4794-ba30-be73c6bac4e2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 12 01:18:20.507345 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:20.507345 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:20.507345 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:20.507345 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:20.507345 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:20.507345 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:20.507345 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:20.507345 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:20.507345 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:20.507345 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:20.507345 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:20.507345 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 01:18:20.507345 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 01:18:20.507345 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 01:18:20.507345 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 01:18:20.508304 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:20.508304 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:20.508304 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 01:18:20.508304 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 01:18:20.508304 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 01:18:20.508304 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 01:18:20.508304 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:20.508304 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:20.508304 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:20.508304 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:20.508304 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:20.508304 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:20.508304 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:20.508304 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:20.508304 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:20.508304 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:20.508304 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:20.508304 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:20.509220 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:20.509220 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:20.509220 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 01:18:20.509220 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 01:18:20.509220 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 01:18:20.509220 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 01:18:20.509220 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 01:18:20.509220 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 01:18:20.509220 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 12 01:18:20.509220 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:18:20.512161 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 473/937] 10.222.0.26 () {56 vars in 1117 bytes} [Fri Aug 12 01:18:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:18:20.518029 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7008e94b-c1b2-457f-b1cc-a00bbe515a1e None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:20.520056 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74252550-6af0-4794-ba30-be73c6bac4e2 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:20.561832 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5dcab3-a3ce-4065-9e32-76e8f2e81e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:20.562896 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5dcab3-a3ce-4065-9e32-76e8f2e81e46 None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:20.563512 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5dcab3-a3ce-4065-9e32-76e8f2e81e46 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:20.564004 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5dcab3-a3ce-4065-9e32-76e8f2e81e46 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:20.565646 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5dcab3-a3ce-4065-9e32-76e8f2e81e46 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:20.567296 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5dcab3-a3ce-4065-9e32-76e8f2e81e46 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:20.599967 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 465/938] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:18:20 2022] POST /identity/v3/endpoints => generated 347 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 01:18:20.655991 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74252550-6af0-4794-ba30-be73c6bac4e2 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:20.703352 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b99410-a55c-4fad-8894-e90fc1bcae2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:20.703972 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b99410-a55c-4fad-8894-e90fc1bcae2b None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:20.704241 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b99410-a55c-4fad-8894-e90fc1bcae2b None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:20.704502 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b99410-a55c-4fad-8894-e90fc1bcae2b None admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:20.705307 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b99410-a55c-4fad-8894-e90fc1bcae2b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:20.705608 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b99410-a55c-4fad-8894-e90fc1bcae2b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:20.707104 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b99410-a55c-4fad-8894-e90fc1bcae2b None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:20.728765 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 474/939] 10.222.0.26 () {56 vars in 1149 bytes} [Fri Aug 12 01:18:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:18:20.734683 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5dcab3-a3ce-4065-9e32-76e8f2e81e46 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:20.851127 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:20.858098 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5dcab3-a3ce-4065-9e32-76e8f2e81e46 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:20.919818 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32589919-e571-4eab-8f8d-4854374e9202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:20.920872 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32589919-e571-4eab-8f8d-4854374e9202 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:20.921358 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32589919-e571-4eab-8f8d-4854374e9202 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:20.921909 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32589919-e571-4eab-8f8d-4854374e9202 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:20.933729 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32589919-e571-4eab-8f8d-4854374e9202 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:20.935504 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32589919-e571-4eab-8f8d-4854374e9202 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:20.951448 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-32589919-e571-4eab-8f8d-4854374e9202 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:18:20.951448 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:20.951448 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:20.951448 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:20.951448 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:20.951448 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:20.951448 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:20.951448 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:20.951448 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:20.951448 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:20.951448 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:20.951448 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:20.951448 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 01:18:20.951448 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 01:18:20.951448 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 01:18:20.951448 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 01:18:20.952440 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:20.952440 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:20.952440 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:20.952440 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:20.952440 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:20.952440 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:20.952440 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:20.952440 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:20.952440 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:20.952440 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:20.952440 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:20.952440 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:20.952440 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:20.952440 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:20.952440 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:20.952440 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:20.952440 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 01:18:20.953308 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 01:18:20.953308 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:18:20.953308 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:18:20.955679 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 466/940] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:18:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:18:20.963252 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b99410-a55c-4fad-8894-e90fc1bcae2b None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:21.008276 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:21.070584 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb26414-2bcc-4612-b3c8-97a114dee89f None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:21.071216 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb26414-2bcc-4612-b3c8-97a114dee89f None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:21.071702 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb26414-2bcc-4612-b3c8-97a114dee89f None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:21.072330 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b99410-a55c-4fad-8894-e90fc1bcae2b None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:21.073925 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 467/941] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:18:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:18:21.078976 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb394c47-1dc5-4f36-9ed5-788a752a6751 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:21.079185 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb394c47-1dc5-4f36-9ed5-788a752a6751 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:21.079434 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb394c47-1dc5-4f36-9ed5-788a752a6751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:21.098385 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-bb394c47-1dc5-4f36-9ed5-788a752a6751 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:18:21.099581 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-bb394c47-1dc5-4f36-9ed5-788a752a6751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:18:21.120040 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fa7333-0dd1-4d0f-865c-b96afbd2e22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:21.121491 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa7333-0dd1-4d0f-865c-b96afbd2e22d None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:21.122349 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa7333-0dd1-4d0f-865c-b96afbd2e22d None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:21.122827 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa7333-0dd1-4d0f-865c-b96afbd2e22d None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:21.123914 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fa7333-0dd1-4d0f-865c-b96afbd2e22d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:21.124787 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fa7333-0dd1-4d0f-865c-b96afbd2e22d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:21.126984 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fa7333-0dd1-4d0f-865c-b96afbd2e22d None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:21.143188 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 475/942] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 01:18:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:21.154146 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fa7333-0dd1-4d0f-865c-b96afbd2e22d None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:21.176166 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 468/943] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:18:21 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 01:18:21.257878 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:21.260822 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fa7333-0dd1-4d0f-865c-b96afbd2e22d None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:21.295487 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef0d8b4-2a33-4f57-ace9-83b06e214410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:21.296116 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef0d8b4-2a33-4f57-ace9-83b06e214410 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:21.296387 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef0d8b4-2a33-4f57-ace9-83b06e214410 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:21.296652 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef0d8b4-2a33-4f57-ace9-83b06e214410 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:21.303796 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef0d8b4-2a33-4f57-ace9-83b06e214410 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:21.305230 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef0d8b4-2a33-4f57-ace9-83b06e214410 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:21.316888 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-6ef0d8b4-2a33-4f57-ace9-83b06e214410 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 01:18:21.316888 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:21.316888 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:21.316888 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:21.316888 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:21.316888 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:21.316888 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:21.316888 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:21.316888 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:21.316888 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:21.316888 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:21.316888 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:21.316888 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 01:18:21.316888 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 01:18:21.316888 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 01:18:21.317760 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 01:18:21.317760 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:21.317760 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:21.317760 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:21.317760 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:21.317760 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:21.317760 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:21.317760 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:21.317760 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:21.317760 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:21.317760 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:21.317760 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:21.317760 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:21.317760 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:21.317760 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:21.317760 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:21.317760 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:21.318670 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 01:18:21.318670 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 01:18:21.318670 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 01:18:21.318670 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 01:18:21.318670 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 01:18:21.318670 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 01:18:21.318670 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 01:18:21.318670 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:18:21.318670 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 476/944] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 01:18:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:18:21.325400 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb394c47-1dc5-4f36-9ed5-788a752a6751 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:21.408437 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:21.431526 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb394c47-1dc5-4f36-9ed5-788a752a6751 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:21.439819 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b614fb0-4852-47ad-a954-3acb950ef532 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:21.439819 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b614fb0-4852-47ad-a954-3acb950ef532 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:21.440427 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b614fb0-4852-47ad-a954-3acb950ef532 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:21.441662 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 477/945] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:18:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:18:21.446604 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b51f7f3-19be-4169-9dff-e2508dc66db6 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:21.446891 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b51f7f3-19be-4169-9dff-e2508dc66db6 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:21.447167 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b51f7f3-19be-4169-9dff-e2508dc66db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:21.465231 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-1b51f7f3-19be-4169-9dff-e2508dc66db6 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:18:21.466471 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-1b51f7f3-19be-4169-9dff-e2508dc66db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:18:21.468457 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3512ad5-bce0-447a-a6ed-f018a0ca3948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:21.469357 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3512ad5-bce0-447a-a6ed-f018a0ca3948 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:21.469633 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3512ad5-bce0-447a-a6ed-f018a0ca3948 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:21.469905 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3512ad5-bce0-447a-a6ed-f018a0ca3948 None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:21.470692 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3512ad5-bce0-447a-a6ed-f018a0ca3948 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:21.470997 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3512ad5-bce0-447a-a6ed-f018a0ca3948 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:21.472428 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3512ad5-bce0-447a-a6ed-f018a0ca3948 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:21.484284 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 469/946] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Aug 12 01:18:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:21.487936 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3512ad5-bce0-447a-a6ed-f018a0ca3948 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:21.545115 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 478/947] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:18:21 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 01:18:21.545923 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b51f7f3-19be-4169-9dff-e2508dc66db6 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:21.605328 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3512ad5-bce0-447a-a6ed-f018a0ca3948 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:21.639774 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11955868-3954-4a88-b823-6f768910baf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:21.640400 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11955868-3954-4a88-b823-6f768910baf0 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:21.640668 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11955868-3954-4a88-b823-6f768910baf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:21.640930 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11955868-3954-4a88-b823-6f768910baf0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:21.641505 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11955868-3954-4a88-b823-6f768910baf0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:21.643071 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11955868-3954-4a88-b823-6f768910baf0 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:21.652348 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-11955868-3954-4a88-b823-6f768910baf0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 12 01:18:21.652348 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:21.652348 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 01:18:21.652348 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 01:18:21.652348 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 01:18:21.652348 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 01:18:21.652348 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 01:18:21.652348 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 01:18:21.652348 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 12 01:18:21.652348 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:18:21.652348 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 01:18:21.652348 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:18:21.652348 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:21.652348 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:21.652348 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:21.652348 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:21.652348 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:21.653334 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:21.653334 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:21.653334 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:21.653334 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:21.653334 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:21.653334 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:21.653334 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 01:18:21.653334 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 01:18:21.653334 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 01:18:21.653334 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 01:18:21.653334 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:21.653334 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:21.653334 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:21.653334 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:21.653334 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:21.653334 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:21.654554 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:21.654554 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:21.654554 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:21.654554 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:21.654554 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:21.654554 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:21.654554 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:21.654554 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:21.654554 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:21.654554 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:21.654554 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 01:18:21.654554 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 01:18:21.654554 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 12 01:18:21.654554 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:18:21.654554 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 470/948] 10.222.0.26 () {56 vars in 1126 bytes} [Fri Aug 12 01:18:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:18:21.656538 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:21.661997 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11955868-3954-4a88-b823-6f768910baf0 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:21.668166 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b51f7f3-19be-4169-9dff-e2508dc66db6 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:21.672775 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:21.715738 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c09207-49fb-4e6a-9c74-d777cb214d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:21.716417 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c09207-49fb-4e6a-9c74-d777cb214d71 None admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:21.716695 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c09207-49fb-4e6a-9c74-d777cb214d71 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:21.716968 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c09207-49fb-4e6a-9c74-d777cb214d71 None admin] PATH_INFO: `/v3/projects/fa91143910a74c6b896ced5b51f9966a/users/f3643631cf2d4a9592d465bdeba99669/roles/90822fc7f8cf4ded8bccf87f3036eb1a` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:21.719815 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c09207-49fb-4e6a-9c74-d777cb214d71 None admin] RBAC: Authorizing `identity:create_grant(project_id=fa91143910a74c6b896ced5b51f9966a, user_id=f3643631cf2d4a9592d465bdeba99669, role_id=90822fc7f8cf4ded8bccf87f3036eb1a)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:21.721301 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c09207-49fb-4e6a-9c74-d777cb214d71 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:21.740359 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 479/949] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Aug 12 01:18:21 2022] PUT /identity/v3/projects/fa91143910a74c6b896ced5b51f9966a/users/f3643631cf2d4a9592d465bdeba99669/roles/90822fc7f8cf4ded8bccf87f3036eb1a => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:18:21.776393 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11955868-3954-4a88-b823-6f768910baf0 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:21.810723 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c09207-49fb-4e6a-9c74-d777cb214d71 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:21.815312 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ccf765-4860-4c6c-a81e-d941259bdfe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:21.815850 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ccf765-4860-4c6c-a81e-d941259bdfe0 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:21.816121 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ccf765-4860-4c6c-a81e-d941259bdfe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:21.816387 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ccf765-4860-4c6c-a81e-d941259bdfe0 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:21.817020 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ccf765-4860-4c6c-a81e-d941259bdfe0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:21.817312 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ccf765-4860-4c6c-a81e-d941259bdfe0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:21.818749 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ccf765-4860-4c6c-a81e-d941259bdfe0 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:21.829136 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 471/950] 10.222.0.26 () {56 vars in 1122 bytes} [Fri Aug 12 01:18:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:21.835418 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ccf765-4860-4c6c-a81e-d941259bdfe0 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:21.929373 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:21.939100 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c09207-49fb-4e6a-9c74-d777cb214d71 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:21.970269 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ccf765-4860-4c6c-a81e-d941259bdfe0 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:21.985176 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3696ae-eeea-4949-b2ad-fe2b899d2447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:21.986431 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3696ae-eeea-4949-b2ad-fe2b899d2447 None admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:21.986978 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3696ae-eeea-4949-b2ad-fe2b899d2447 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:21.987899 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3696ae-eeea-4949-b2ad-fe2b899d2447 None admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:21.988999 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3696ae-eeea-4949-b2ad-fe2b899d2447 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:21.991295 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3696ae-eeea-4949-b2ad-fe2b899d2447 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:21.994711 dv-cinder-784815-15-smb devstack@keystone.service[81555]: WARNING keystone.server.flask.common [None req-fc3696ae-eeea-4949-b2ad-fe2b899d2447 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 12 01:18:22.013590 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40ab746-1bc5-4f92-a169-b89776e39609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:22.014247 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ab746-1bc5-4f92-a169-b89776e39609 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:22.014544 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ab746-1bc5-4f92-a169-b89776e39609 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:22.014788 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ab746-1bc5-4f92-a169-b89776e39609 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:22.015387 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40ab746-1bc5-4f92-a169-b89776e39609 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:22.015685 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40ab746-1bc5-4f92-a169-b89776e39609 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:22.017107 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40ab746-1bc5-4f92-a169-b89776e39609 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:22.017570 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.sql.core [None req-fc3696ae-eeea-4949-b2ad-fe2b899d2447 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 12 01:18:22.017570 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 12 01:18:22.017570 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [parameters: {'id': '516a3fd250e248fbb8f242ee87d7686e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 12 01:18:22.017570 dv-cinder-784815-15-smb devstack@keystone.service[81555]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81555) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 12 01:18:22.022668 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 472/951] 10.222.0.26 () {56 vars in 1122 bytes} [Fri Aug 12 01:18:21 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:18:22.026865 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-fc3696ae-eeea-4949-b2ad-fe2b899d2447 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 516a3fd250e248fbb8f242ee87d7686e.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 516a3fd250e248fbb8f242ee87d7686e. Aug 12 01:18:22.026865 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:22.026865 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 12 01:18:22.026865 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 12 01:18:22.026865 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 12 01:18:22.026865 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 12 01:18:22.026865 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 12 01:18:22.026865 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application result = self._query(query) Aug 12 01:18:22.026865 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 12 01:18:22.026865 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application conn.query(q) Aug 12 01:18:22.026865 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 12 01:18:22.026865 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 12 01:18:22.026865 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 12 01:18:22.027642 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application result.read() Aug 12 01:18:22.027642 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 12 01:18:22.027642 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 12 01:18:22.027642 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 12 01:18:22.027642 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 12 01:18:22.027642 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 12 01:18:22.027642 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 12 01:18:22.027642 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 12 01:18:22.027642 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 12 01:18:22.027642 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 12 01:18:22.027642 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:18:22.027642 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 12 01:18:22.027642 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:18:22.027642 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:22.027642 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 12 01:18:22.027642 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 12 01:18:22.027642 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 12 01:18:22.027642 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 12 01:18:22.028615 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 12 01:18:22.028615 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application next(self.gen) Aug 12 01:18:22.028615 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 12 01:18:22.028615 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application yield resource Aug 12 01:18:22.028615 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 12 01:18:22.028615 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application next(self.gen) Aug 12 01:18:22.028615 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 12 01:18:22.028615 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self.session.rollback() Aug 12 01:18:22.028615 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 12 01:18:22.028615 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self.force_reraise() Aug 12 01:18:22.028615 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 12 01:18:22.028615 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise self.value Aug 12 01:18:22.028615 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 12 01:18:22.028615 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 12 01:18:22.028615 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 12 01:18:22.028615 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application session.commit() Aug 12 01:18:22.028615 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 12 01:18:22.029511 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 12 01:18:22.029511 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 12 01:18:22.029511 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self._prepare_impl() Aug 12 01:18:22.029511 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 12 01:18:22.029511 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self.session.flush() Aug 12 01:18:22.029511 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 12 01:18:22.029511 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self._flush(objects) Aug 12 01:18:22.029511 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 12 01:18:22.029511 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 12 01:18:22.029511 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 12 01:18:22.029511 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application compat.raise_( Aug 12 01:18:22.029511 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 12 01:18:22.029511 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception Aug 12 01:18:22.029511 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 12 01:18:22.029511 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application flush_context.execute() Aug 12 01:18:22.029511 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 12 01:18:22.029511 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rec.execute(self) Aug 12 01:18:22.030706 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 12 01:18:22.030706 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 12 01:18:22.030706 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 12 01:18:22.030706 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 12 01:18:22.030706 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 12 01:18:22.030706 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 12 01:18:22.030706 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 12 01:18:22.030706 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 12 01:18:22.030706 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 12 01:18:22.030706 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 12 01:18:22.030706 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 12 01:18:22.030706 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 12 01:18:22.030706 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 12 01:18:22.030706 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 12 01:18:22.030706 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 12 01:18:22.031617 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 12 01:18:22.031617 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 12 01:18:22.031617 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception Aug 12 01:18:22.031617 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 12 01:18:22.031617 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 12 01:18:22.031617 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 12 01:18:22.031617 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 12 01:18:22.031617 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 12 01:18:22.031617 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application result = self._query(query) Aug 12 01:18:22.031617 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 12 01:18:22.031617 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application conn.query(q) Aug 12 01:18:22.031617 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 12 01:18:22.031617 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 12 01:18:22.031617 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 12 01:18:22.031617 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application result.read() Aug 12 01:18:22.031617 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 12 01:18:22.031617 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 12 01:18:22.032663 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 12 01:18:22.032663 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 12 01:18:22.032663 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 12 01:18:22.032663 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 12 01:18:22.032663 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 12 01:18:22.032663 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 12 01:18:22.032663 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 12 01:18:22.032663 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 12 01:18:22.032663 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [parameters: {'id': '516a3fd250e248fbb8f242ee87d7686e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 12 01:18:22.032663 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 12 01:18:22.032663 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:18:22.032663 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 01:18:22.032663 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:18:22.032663 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:22.032663 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 12 01:18:22.033743 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 12 01:18:22.033743 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 12 01:18:22.033743 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 12 01:18:22.033743 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 12 01:18:22.033743 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:18:22.033743 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 01:18:22.033743 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:18:22.033743 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:22.033743 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:22.033743 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:22.033743 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:22.033743 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:22.033743 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:22.033743 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:22.033743 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:22.033743 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:22.033743 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:22.035579 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:22.035579 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 12 01:18:22.035579 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 12 01:18:22.035579 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:22.035579 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:22.035579 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 12 01:18:22.035579 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 12 01:18:22.035579 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 516a3fd250e248fbb8f242ee87d7686e. Aug 12 01:18:22.035579 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:18:22.036546 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40ab746-1bc5-4f92-a169-b89776e39609 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:22.037985 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 480/952] 10.222.0.26 () {60 vars in 1140 bytes} [Fri Aug 12 01:18:21 2022] POST /identity/v3/projects => generated 262 bytes in 228 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 12 01:18:22.044712 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3696ae-eeea-4949-b2ad-fe2b899d2447 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:22.057763 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:22.167468 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40ab746-1bc5-4f92-a169-b89776e39609 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:22.167857 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3696ae-eeea-4949-b2ad-fe2b899d2447 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:22.203222 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8dbc8d-64c1-40d2-9b57-a24d0433404a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:22.203921 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8dbc8d-64c1-40d2-9b57-a24d0433404a None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:22.204307 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8dbc8d-64c1-40d2-9b57-a24d0433404a None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:22.204665 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8dbc8d-64c1-40d2-9b57-a24d0433404a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:22.205532 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8dbc8d-64c1-40d2-9b57-a24d0433404a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:22.207014 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8dbc8d-64c1-40d2-9b57-a24d0433404a None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:22.211960 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:22.216700 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba008e5-8109-4a89-9423-f835c0f2d5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:22.217521 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba008e5-8109-4a89-9423-f835c0f2d5bb None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:22.218391 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba008e5-8109-4a89-9423-f835c0f2d5bb None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:22.218800 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba008e5-8109-4a89-9423-f835c0f2d5bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:22.229025 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba008e5-8109-4a89-9423-f835c0f2d5bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:22.231463 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba008e5-8109-4a89-9423-f835c0f2d5bb None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:22.242240 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 473/953] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:18:22 2022] POST /identity/v3/endpoints => generated 349 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:18:22.244252 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-cba008e5-8109-4a89-9423-f835c0f2d5bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 01:18:22.244252 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:22.244252 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:22.244252 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:22.244252 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:22.244252 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:22.244252 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:22.244252 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:22.244252 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:22.244252 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:22.244252 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:22.244252 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:22.244252 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 01:18:22.244252 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 01:18:22.244252 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 01:18:22.245491 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 01:18:22.245491 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:22.245491 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:22.245491 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:22.245491 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:22.245491 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:22.245491 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:22.245491 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:22.245491 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:22.245491 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:22.245491 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:22.245491 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:22.245491 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:22.245491 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:22.245491 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:22.245491 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:22.245491 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:22.246475 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 01:18:22.246475 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 01:18:22.246475 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 01:18:22.246475 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 01:18:22.246475 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 01:18:22.246475 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 01:18:22.246475 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 01:18:22.246475 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:18:22.253112 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 481/954] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 01:18:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 01:18:22.256041 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8dbc8d-64c1-40d2-9b57-a24d0433404a None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:22.379678 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8dbc8d-64c1-40d2-9b57-a24d0433404a None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:22.416636 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d847e4-96e8-4c41-9811-934362621a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:22.417564 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d847e4-96e8-4c41-9811-934362621a22 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:22.418009 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d847e4-96e8-4c41-9811-934362621a22 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:22.418492 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d847e4-96e8-4c41-9811-934362621a22 None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:22.419326 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d847e4-96e8-4c41-9811-934362621a22 None admin] RBAC: Adding query filter params (name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:22.419791 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d847e4-96e8-4c41-9811-934362621a22 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:22.421403 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d847e4-96e8-4c41-9811-934362621a22 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:22.439824 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 474/955] 10.222.0.26 () {56 vars in 1112 bytes} [Fri Aug 12 01:18:22 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:22.737146 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9193b8-55e3-40d9-ab39-e460748e9b20 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:22.737663 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9193b8-55e3-40d9-ab39-e460748e9b20 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:22.737663 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9193b8-55e3-40d9-ab39-e460748e9b20 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:22.742194 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 482/956] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:18:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:18:22.747574 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcde658-266a-4a82-b32a-2a8b00fff8f9 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:22.747858 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcde658-266a-4a82-b32a-2a8b00fff8f9 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:22.748131 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcde658-266a-4a82-b32a-2a8b00fff8f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:22.766959 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-6bcde658-266a-4a82-b32a-2a8b00fff8f9 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:18:22.768183 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-6bcde658-266a-4a82-b32a-2a8b00fff8f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:18:22.812458 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:22.839316 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 475/957] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:18:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 01:18:23.101792 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9193b8-55e3-40d9-ab39-e460748e9b20 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:23.170438 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:23.211208 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9193b8-55e3-40d9-ab39-e460748e9b20 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:23.244969 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037c47e0-aab1-4b6f-96d8-f538dacfd111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:23.245603 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037c47e0-aab1-4b6f-96d8-f538dacfd111 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:23.245877 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037c47e0-aab1-4b6f-96d8-f538dacfd111 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:23.246168 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037c47e0-aab1-4b6f-96d8-f538dacfd111 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:23.246753 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037c47e0-aab1-4b6f-96d8-f538dacfd111 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:23.248104 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037c47e0-aab1-4b6f-96d8-f538dacfd111 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:23.257015 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-037c47e0-aab1-4b6f-96d8-f538dacfd111 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 12 01:18:23.257015 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:23.257015 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 01:18:23.257015 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 01:18:23.257015 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 01:18:23.257015 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 01:18:23.257015 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 01:18:23.257015 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 01:18:23.257015 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 12 01:18:23.257015 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:18:23.257015 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 01:18:23.257015 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:18:23.257015 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:23.257015 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:23.257015 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:23.257015 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:23.257015 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:23.258075 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:23.258075 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:23.258075 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:23.258075 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:23.258075 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:23.258075 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:23.258075 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 01:18:23.258075 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 01:18:23.258075 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 01:18:23.258075 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 01:18:23.258075 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:23.258075 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:23.258075 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:23.258075 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:23.258075 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:23.258075 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:23.258953 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:23.258953 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:23.258953 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:23.258953 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:23.258953 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:23.258953 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:23.258953 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:23.258953 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:23.258953 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:23.258953 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:23.258953 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 01:18:23.258953 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 01:18:23.258953 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 12 01:18:23.258953 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:18:23.258953 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 483/958] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 01:18:23 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:18:23.264048 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcde658-266a-4a82-b32a-2a8b00fff8f9 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:23.369900 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcde658-266a-4a82-b32a-2a8b00fff8f9 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:23.405529 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0899777b-e5c1-4eb1-ac1b-2b7deed5d743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:23.406592 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0899777b-e5c1-4eb1-ac1b-2b7deed5d743 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:23.407061 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0899777b-e5c1-4eb1-ac1b-2b7deed5d743 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:23.407616 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0899777b-e5c1-4eb1-ac1b-2b7deed5d743 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:23.408523 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0899777b-e5c1-4eb1-ac1b-2b7deed5d743 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:23.409085 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0899777b-e5c1-4eb1-ac1b-2b7deed5d743 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:23.410732 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0899777b-e5c1-4eb1-ac1b-2b7deed5d743 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:23.417218 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 476/959] 10.222.0.26 () {56 vars in 1112 bytes} [Fri Aug 12 01:18:23 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:23.423547 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037c47e0-aab1-4b6f-96d8-f538dacfd111 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:23.536090 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037c47e0-aab1-4b6f-96d8-f538dacfd111 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:23.565509 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:23.571461 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c09a3ad-3f80-42ab-9045-b0ed6b4cec68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:23.572333 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c09a3ad-3f80-42ab-9045-b0ed6b4cec68 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:23.572607 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c09a3ad-3f80-42ab-9045-b0ed6b4cec68 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:23.572931 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c09a3ad-3f80-42ab-9045-b0ed6b4cec68 None admin] PATH_INFO: `/v3/services` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:23.573749 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c09a3ad-3f80-42ab-9045-b0ed6b4cec68 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:23.574286 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c09a3ad-3f80-42ab-9045-b0ed6b4cec68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:23.575738 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c09a3ad-3f80-42ab-9045-b0ed6b4cec68 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:23.580749 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 484/960] 10.222.0.26 () {56 vars in 1112 bytes} [Fri Aug 12 01:18:23 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:23.707496 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c1a55-6553-485b-ac87-48c1cf7aed58 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:23.707674 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c1a55-6553-485b-ac87-48c1cf7aed58 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:23.707954 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c1a55-6553-485b-ac87-48c1cf7aed58 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:23.709594 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 477/961] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:18:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:18:23.715254 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f5d43-1081-42e1-bdd9-6b7f0abb3294 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:23.715541 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f5d43-1081-42e1-bdd9-6b7f0abb3294 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:23.715819 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f5d43-1081-42e1-bdd9-6b7f0abb3294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:23.736975 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-e88f5d43-1081-42e1-bdd9-6b7f0abb3294 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:18:23.738621 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-e88f5d43-1081-42e1-bdd9-6b7f0abb3294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:18:23.808483 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 485/962] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:18:23 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 01:18:24.078340 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88c1a55-6553-485b-ac87-48c1cf7aed58 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:24.121764 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:24.182750 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88c1a55-6553-485b-ac87-48c1cf7aed58 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:24.217152 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5bf886-4961-40c6-a1ba-ef3ccabf18c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:24.217789 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5bf886-4961-40c6-a1ba-ef3ccabf18c6 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:24.218065 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5bf886-4961-40c6-a1ba-ef3ccabf18c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:24.218364 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5bf886-4961-40c6-a1ba-ef3ccabf18c6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:24.237868 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5bf886-4961-40c6-a1ba-ef3ccabf18c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:18:24.238310 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-4b5bf886-4961-40c6-a1ba-ef3ccabf18c6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 12 01:18:24.238310 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:24.238310 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:24.238310 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:24.238310 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:24.238310 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:24.238310 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:24.238310 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:24.238310 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:24.238310 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:24.238310 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:24.238310 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:24.238310 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:18:24.238310 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:18:24.238310 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:18:24.238310 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:18:24.239204 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:18:24.239204 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:18:24.239204 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:18:24.239204 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:18:24.239204 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:24.239204 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:24.239204 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:24.239204 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:24.239204 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:24.239204 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:24.239204 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:24.239204 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:24.239204 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:24.239204 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:24.239204 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:24.239204 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:24.240039 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:24.240039 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:24.240039 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:24.240039 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:24.240039 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:18:24.240039 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:18:24.240039 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:18:24.240039 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:18:24.240039 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:18:24.240039 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:18:24.240039 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 12 01:18:24.240039 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:18:24.240714 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a4b3e-3e8f-4117-b8c7-e77fcbb20cd3 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:24.240714 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a4b3e-3e8f-4117-b8c7-e77fcbb20cd3 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:24.240714 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a4b3e-3e8f-4117-b8c7-e77fcbb20cd3 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:24.241888 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 486/963] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:18:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:18:24.242888 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 478/964] 10.222.0.26 () {56 vars in 1120 bytes} [Fri Aug 12 01:18:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:18:24.246982 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79125375-6b84-44a2-8660-254e0301ce88 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:24.247252 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79125375-6b84-44a2-8660-254e0301ce88 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:24.247546 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79125375-6b84-44a2-8660-254e0301ce88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:24.248644 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5bf886-4961-40c6-a1ba-ef3ccabf18c6 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:24.265586 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-79125375-6b84-44a2-8660-254e0301ce88 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:18:24.266814 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-79125375-6b84-44a2-8660-254e0301ce88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:18:24.341627 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 487/965] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:18:24 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 01:18:24.356779 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5bf886-4961-40c6-a1ba-ef3ccabf18c6 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:24.358454 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:24.394855 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55768bc0-8615-4700-9c3b-bb5e41c18016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:24.395460 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55768bc0-8615-4700-9c3b-bb5e41c18016 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:24.395731 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55768bc0-8615-4700-9c3b-bb5e41c18016 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:24.395995 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55768bc0-8615-4700-9c3b-bb5e41c18016 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:24.396648 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55768bc0-8615-4700-9c3b-bb5e41c18016 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:24.396941 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55768bc0-8615-4700-9c3b-bb5e41c18016 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:24.398335 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55768bc0-8615-4700-9c3b-bb5e41c18016 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:24.406884 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 479/966] 10.222.0.26 () {56 vars in 1115 bytes} [Fri Aug 12 01:18:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:18:24.412452 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79125375-6b84-44a2-8660-254e0301ce88 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:24.467997 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:24.513887 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f244bc-ba33-461a-891d-d5e90f73e8b6 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:24.514226 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f244bc-ba33-461a-891d-d5e90f73e8b6 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:24.514456 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f244bc-ba33-461a-891d-d5e90f73e8b6 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:24.517014 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 480/967] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:18:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 01:18:24.520641 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79125375-6b84-44a2-8660-254e0301ce88 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:24.521112 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1173804-4a7c-4e19-a421-e07a5bf923aa None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:24.521391 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1173804-4a7c-4e19-a421-e07a5bf923aa None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:24.521662 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1173804-4a7c-4e19-a421-e07a5bf923aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:24.539720 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-f1173804-4a7c-4e19-a421-e07a5bf923aa None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:18:24.540898 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f1173804-4a7c-4e19-a421-e07a5bf923aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:18:24.556554 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce361cb-aaba-4e2e-b37b-9bfb81d52215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:24.557525 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce361cb-aaba-4e2e-b37b-9bfb81d52215 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:24.558001 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce361cb-aaba-4e2e-b37b-9bfb81d52215 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:24.558573 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce361cb-aaba-4e2e-b37b-9bfb81d52215 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:24.568854 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce361cb-aaba-4e2e-b37b-9bfb81d52215 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:24.570560 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce361cb-aaba-4e2e-b37b-9bfb81d52215 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:24.585623 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-bce361cb-aaba-4e2e-b37b-9bfb81d52215 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:18:24.585623 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:24.585623 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:24.585623 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:24.585623 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:24.585623 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:24.585623 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:24.585623 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:24.585623 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:24.585623 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:24.585623 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:24.585623 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:24.585623 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 01:18:24.585623 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 01:18:24.585623 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 01:18:24.585623 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 01:18:24.586630 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:24.586630 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:24.586630 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:24.586630 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:24.586630 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:24.586630 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:24.586630 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:24.586630 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:24.586630 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:24.586630 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:24.586630 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:24.586630 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:24.586630 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:24.586630 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:24.586630 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:24.586630 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:24.586630 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 01:18:24.587518 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 01:18:24.587518 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:18:24.587518 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:18:24.589550 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 488/968] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:18:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:18:24.595578 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce361cb-aaba-4e2e-b37b-9bfb81d52215 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:24.607830 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 481/969] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:18:24 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 01:18:24.627692 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1173804-4a7c-4e19-a421-e07a5bf923aa None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:24.724484 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce361cb-aaba-4e2e-b37b-9bfb81d52215 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:24.734028 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:24.744629 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:24.760945 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1173804-4a7c-4e19-a421-e07a5bf923aa None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:24.771759 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489e831e-c084-4950-8717-33f43571ee0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:24.772413 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e831e-c084-4950-8717-33f43571ee0c None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:24.772647 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e831e-c084-4950-8717-33f43571ee0c None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:24.772917 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e831e-c084-4950-8717-33f43571ee0c None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:24.773653 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489e831e-c084-4950-8717-33f43571ee0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:24.773979 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489e831e-c084-4950-8717-33f43571ee0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:24.775347 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489e831e-c084-4950-8717-33f43571ee0c None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:24.789080 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 489/970] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 01:18:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:18:24.794938 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489e831e-c084-4950-8717-33f43571ee0c None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:24.798091 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e5311d-98ce-45e5-a946-26aea9d662b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:24.798931 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e5311d-98ce-45e5-a946-26aea9d662b6 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:24.799465 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e5311d-98ce-45e5-a946-26aea9d662b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:24.799797 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e5311d-98ce-45e5-a946-26aea9d662b6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:24.800431 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e5311d-98ce-45e5-a946-26aea9d662b6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:24.801868 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e5311d-98ce-45e5-a946-26aea9d662b6 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:24.811450 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-94e5311d-98ce-45e5-a946-26aea9d662b6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 12 01:18:24.811450 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:24.811450 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 01:18:24.811450 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 01:18:24.811450 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 01:18:24.811450 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 01:18:24.811450 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 01:18:24.811450 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 01:18:24.811450 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 12 01:18:24.811450 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:18:24.811450 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 01:18:24.811450 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:18:24.811450 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:24.811450 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:24.811450 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:24.811450 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:24.811450 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:24.812466 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:24.812466 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:24.812466 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:24.812466 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:24.812466 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:24.812466 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:24.812466 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 01:18:24.812466 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 01:18:24.812466 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 01:18:24.812466 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 01:18:24.812466 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:24.812466 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:24.812466 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:24.812466 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:24.812466 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:24.812466 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:24.813309 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:24.813309 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:24.813309 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:24.813309 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:24.813309 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:24.813309 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:24.813309 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:24.813309 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:24.813309 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:24.813309 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:24.813309 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 01:18:24.813309 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 01:18:24.813309 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 12 01:18:24.813309 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:18:24.813309 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 482/971] 10.222.0.26 () {56 vars in 1126 bytes} [Fri Aug 12 01:18:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 01:18:24.818508 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e5311d-98ce-45e5-a946-26aea9d662b6 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:24.910482 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489e831e-c084-4950-8717-33f43571ee0c None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:24.942271 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e5311d-98ce-45e5-a946-26aea9d662b6 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:24.945829 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2633fd79-e4d8-4136-8705-7ffc0decf6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:24.946555 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2633fd79-e4d8-4136-8705-7ffc0decf6c2 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:24.946833 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2633fd79-e4d8-4136-8705-7ffc0decf6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:24.947105 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2633fd79-e4d8-4136-8705-7ffc0decf6c2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:24.954319 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2633fd79-e4d8-4136-8705-7ffc0decf6c2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:24.956641 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2633fd79-e4d8-4136-8705-7ffc0decf6c2 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:24.969181 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-2633fd79-e4d8-4136-8705-7ffc0decf6c2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 12 01:18:24.969181 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:24.969181 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:24.969181 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:24.969181 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:24.969181 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:24.969181 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:24.969181 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:24.969181 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:24.969181 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:24.969181 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:24.969181 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:24.969181 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 01:18:24.969181 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 01:18:24.969181 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 01:18:24.969181 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 01:18:24.970150 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:24.970150 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:24.970150 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 01:18:24.970150 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 01:18:24.970150 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 01:18:24.970150 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 01:18:24.970150 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:24.970150 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:24.970150 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:24.970150 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:24.970150 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:24.970150 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:24.970150 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:24.970150 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:24.970150 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:24.970150 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:24.970150 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:24.970150 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:24.971200 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:24.971200 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:24.971200 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 01:18:24.971200 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 01:18:24.971200 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 01:18:24.971200 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 01:18:24.971200 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 01:18:24.971200 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 01:18:24.971200 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 12 01:18:24.971200 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:18:24.971742 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 490/972] 10.222.0.26 () {56 vars in 1117 bytes} [Fri Aug 12 01:18:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:18:24.972681 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2633fd79-e4d8-4136-8705-7ffc0decf6c2 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:24.988776 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3565b4b2-1c91-4069-b968-0bcf60bb4565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:24.989897 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565b4b2-1c91-4069-b968-0bcf60bb4565 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:24.990352 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565b4b2-1c91-4069-b968-0bcf60bb4565 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:24.990626 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565b4b2-1c91-4069-b968-0bcf60bb4565 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:24.991263 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3565b4b2-1c91-4069-b968-0bcf60bb4565 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:24.991691 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3565b4b2-1c91-4069-b968-0bcf60bb4565 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:24.993060 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3565b4b2-1c91-4069-b968-0bcf60bb4565 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:24.997967 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 483/973] 10.222.0.26 () {56 vars in 1122 bytes} [Fri Aug 12 01:18:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:24.998726 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3565b4b2-1c91-4069-b968-0bcf60bb4565 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:25.003301 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:25.026293 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:25.082840 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2633fd79-e4d8-4136-8705-7ffc0decf6c2 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:25.113114 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3565b4b2-1c91-4069-b968-0bcf60bb4565 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:25.121879 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445961bc-64b7-472a-a647-fa35249aa8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:25.122533 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445961bc-64b7-472a-a647-fa35249aa8d5 None admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:25.123013 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445961bc-64b7-472a-a647-fa35249aa8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:25.123137 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445961bc-64b7-472a-a647-fa35249aa8d5 None admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:25.123708 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445961bc-64b7-472a-a647-fa35249aa8d5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:25.125125 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445961bc-64b7-472a-a647-fa35249aa8d5 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:25.140837 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.sql.core [None req-445961bc-64b7-472a-a647-fa35249aa8d5 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 12 01:18:25.140837 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 12 01:18:25.140837 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [parameters: {'user_id': '4ab01260108e4a78a0398eec7c7ef594', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 12 01:18:25.140837 dv-cinder-784815-15-smb devstack@keystone.service[81555]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81555) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 12 01:18:25.148766 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-445961bc-64b7-472a-a647-fa35249aa8d5 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 12 01:18:25.148766 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:25.148766 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 12 01:18:25.148766 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 12 01:18:25.148766 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 12 01:18:25.148766 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 12 01:18:25.148766 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 12 01:18:25.148766 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application result = self._query(query) Aug 12 01:18:25.148766 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 12 01:18:25.148766 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application conn.query(q) Aug 12 01:18:25.148766 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 12 01:18:25.148766 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 12 01:18:25.148766 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 12 01:18:25.148766 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application result.read() Aug 12 01:18:25.148766 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 12 01:18:25.149657 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 12 01:18:25.149657 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 12 01:18:25.149657 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 12 01:18:25.149657 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 12 01:18:25.149657 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 12 01:18:25.149657 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 12 01:18:25.149657 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 12 01:18:25.149657 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 12 01:18:25.149657 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:18:25.149657 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 12 01:18:25.149657 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:18:25.149657 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:25.149657 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 12 01:18:25.149657 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 12 01:18:25.149657 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 12 01:18:25.149657 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 12 01:18:25.149657 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 12 01:18:25.149657 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application next(self.gen) Aug 12 01:18:25.150646 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 12 01:18:25.150646 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application yield resource Aug 12 01:18:25.150646 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 12 01:18:25.150646 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application next(self.gen) Aug 12 01:18:25.150646 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 12 01:18:25.150646 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self.session.rollback() Aug 12 01:18:25.150646 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 12 01:18:25.150646 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self.force_reraise() Aug 12 01:18:25.150646 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 12 01:18:25.150646 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise self.value Aug 12 01:18:25.150646 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 12 01:18:25.150646 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 12 01:18:25.150646 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 12 01:18:25.150646 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application session.commit() Aug 12 01:18:25.150646 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 12 01:18:25.150646 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 12 01:18:25.150646 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 12 01:18:25.151543 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self._prepare_impl() Aug 12 01:18:25.151543 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 12 01:18:25.151543 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self.session.flush() Aug 12 01:18:25.151543 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 12 01:18:25.151543 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self._flush(objects) Aug 12 01:18:25.151543 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 12 01:18:25.151543 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 12 01:18:25.151543 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 12 01:18:25.151543 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application compat.raise_( Aug 12 01:18:25.151543 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 12 01:18:25.151543 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception Aug 12 01:18:25.151543 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 12 01:18:25.151543 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application flush_context.execute() Aug 12 01:18:25.151543 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 12 01:18:25.151543 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rec.execute(self) Aug 12 01:18:25.151543 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 12 01:18:25.151543 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 12 01:18:25.152419 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 12 01:18:25.152419 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 12 01:18:25.152419 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 12 01:18:25.152419 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 12 01:18:25.152419 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 12 01:18:25.152419 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 12 01:18:25.152419 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 12 01:18:25.152419 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 12 01:18:25.152419 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 12 01:18:25.152419 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 12 01:18:25.152419 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 12 01:18:25.152419 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 12 01:18:25.152419 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 12 01:18:25.152419 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 12 01:18:25.152419 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 12 01:18:25.152419 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception Aug 12 01:18:25.153282 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 12 01:18:25.153282 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 12 01:18:25.153282 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 12 01:18:25.153282 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 12 01:18:25.153282 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 12 01:18:25.153282 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application result = self._query(query) Aug 12 01:18:25.153282 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 12 01:18:25.153282 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application conn.query(q) Aug 12 01:18:25.153282 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 12 01:18:25.153282 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 12 01:18:25.153282 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 12 01:18:25.153282 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application result.read() Aug 12 01:18:25.153282 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 12 01:18:25.153282 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 12 01:18:25.153282 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 12 01:18:25.153282 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 12 01:18:25.155250 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 12 01:18:25.155250 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 12 01:18:25.155250 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 12 01:18:25.155250 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 12 01:18:25.155250 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 12 01:18:25.155250 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 12 01:18:25.155250 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [parameters: {'user_id': '4ab01260108e4a78a0398eec7c7ef594', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 12 01:18:25.155250 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 12 01:18:25.155250 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:18:25.155250 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 01:18:25.155250 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:18:25.155250 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:25.155250 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:25.155250 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:25.155250 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:25.156388 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:25.156388 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:25.156388 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:25.156388 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:25.156388 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:25.156388 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:25.156388 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:25.156388 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 12 01:18:25.156388 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 12 01:18:25.156388 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:25.156388 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:25.156388 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 01:18:25.156388 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 01:18:25.156388 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 01:18:25.156388 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 01:18:25.156388 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 12 01:18:25.156388 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 12 01:18:25.157533 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 12 01:18:25.157533 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 12 01:18:25.157533 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 12 01:18:25.157533 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 12 01:18:25.157533 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 12 01:18:25.157533 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:18:25.157533 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 491/974] 10.222.0.26 () {60 vars in 1131 bytes} [Fri Aug 12 01:18:24 2022] POST /identity/v3/users => generated 160 bytes in 178 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:18:25.157533 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445961bc-64b7-472a-a647-fa35249aa8d5 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:25.158891 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64401e4a-a76f-4e1f-b1a6-64c0d0d47afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:25.163957 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64401e4a-a76f-4e1f-b1a6-64c0d0d47afb None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:25.164528 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64401e4a-a76f-4e1f-b1a6-64c0d0d47afb None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:25.164749 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64401e4a-a76f-4e1f-b1a6-64c0d0d47afb None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:25.165500 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64401e4a-a76f-4e1f-b1a6-64c0d0d47afb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:25.165804 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64401e4a-a76f-4e1f-b1a6-64c0d0d47afb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:25.167275 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64401e4a-a76f-4e1f-b1a6-64c0d0d47afb None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:25.185962 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 484/975] 10.222.0.26 () {56 vars in 1149 bytes} [Fri Aug 12 01:18:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:25.186664 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64401e4a-a76f-4e1f-b1a6-64c0d0d47afb None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:25.254583 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:25.268269 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445961bc-64b7-472a-a647-fa35249aa8d5 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:25.278882 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:25.303358 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64401e4a-a76f-4e1f-b1a6-64c0d0d47afb None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:25.308598 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c1a523-76e2-4219-af49-ed5bac9fc09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:25.309220 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c1a523-76e2-4219-af49-ed5bac9fc09d None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:25.309491 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c1a523-76e2-4219-af49-ed5bac9fc09d None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:25.309758 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c1a523-76e2-4219-af49-ed5bac9fc09d None admin] PATH_INFO: `/v3/services` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:25.310418 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c1a523-76e2-4219-af49-ed5bac9fc09d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:25.310715 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c1a523-76e2-4219-af49-ed5bac9fc09d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:25.312440 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c1a523-76e2-4219-af49-ed5bac9fc09d None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:25.325318 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 492/976] 10.222.0.26 () {56 vars in 1122 bytes} [Fri Aug 12 01:18:25 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:25.325318 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c1a523-76e2-4219-af49-ed5bac9fc09d None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:25.346460 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb02b3a-e4a9-4964-9104-69df594f09e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:25.347093 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb02b3a-e4a9-4964-9104-69df594f09e5 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:25.347371 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb02b3a-e4a9-4964-9104-69df594f09e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:25.347638 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb02b3a-e4a9-4964-9104-69df594f09e5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:25.354934 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb02b3a-e4a9-4964-9104-69df594f09e5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:25.356368 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb02b3a-e4a9-4964-9104-69df594f09e5 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:25.368371 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-5fb02b3a-e4a9-4964-9104-69df594f09e5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 12 01:18:25.368371 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:25.368371 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:25.368371 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:25.368371 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:25.368371 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:25.368371 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:25.368371 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:25.368371 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:25.368371 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:25.368371 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:25.368371 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:25.368371 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 01:18:25.368371 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 01:18:25.368371 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 01:18:25.368371 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 01:18:25.369943 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:25.369943 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:25.369943 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 01:18:25.369943 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 01:18:25.369943 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 01:18:25.369943 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 01:18:25.369943 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:25.369943 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:25.369943 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:25.369943 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:25.369943 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:25.369943 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:25.369943 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:25.369943 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:25.369943 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:25.369943 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:25.369943 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:25.369943 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:25.371329 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:25.371329 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:25.371329 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 01:18:25.371329 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 01:18:25.371329 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 01:18:25.371329 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 01:18:25.371329 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 01:18:25.371329 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 01:18:25.371329 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 12 01:18:25.371329 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:18:25.371329 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 485/977] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 01:18:25 2022] GET /identity/v3/users/cinder => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:18:25.371329 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb02b3a-e4a9-4964-9104-69df594f09e5 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:25.429356 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c1a523-76e2-4219-af49-ed5bac9fc09d None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:25.463828 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0838ff48-b9da-418e-b0eb-1c3acf6c2f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:25.464431 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0838ff48-b9da-418e-b0eb-1c3acf6c2f46 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:25.464708 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0838ff48-b9da-418e-b0eb-1c3acf6c2f46 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:25.464971 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0838ff48-b9da-418e-b0eb-1c3acf6c2f46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:25.475624 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb02b3a-e4a9-4964-9104-69df594f09e5 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:25.495858 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:25.519872 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bcc8a0-9345-4bfe-aac2-31135e944a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:25.520488 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bcc8a0-9345-4bfe-aac2-31135e944a41 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:25.520796 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bcc8a0-9345-4bfe-aac2-31135e944a41 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:25.521031 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bcc8a0-9345-4bfe-aac2-31135e944a41 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:25.521739 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bcc8a0-9345-4bfe-aac2-31135e944a41 None admin] RBAC: Adding query filter params (interface=admin, service_id=28de8efe7b20456794869d9d2a55cd0e, region_id=RegionOne) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:25.522223 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bcc8a0-9345-4bfe-aac2-31135e944a41 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:25.523443 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bcc8a0-9345-4bfe-aac2-31135e944a41 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:25.533384 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 486/978] 10.222.0.26 () {56 vars in 1249 bytes} [Fri Aug 12 01:18:25 2022] GET /identity/v3/endpoints?service_id=28de8efe7b20456794869d9d2a55cd0e&interface=admin®ion_id=RegionOne => generated 193 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:25.533384 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bcc8a0-9345-4bfe-aac2-31135e944a41 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:25.536219 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:25.551597 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0838ff48-b9da-418e-b0eb-1c3acf6c2f46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:25.553070 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0838ff48-b9da-418e-b0eb-1c3acf6c2f46 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:25.634443 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bcc8a0-9345-4bfe-aac2-31135e944a41 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:25.654888 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 493/979] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 01:18:25 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 01:18:25.655718 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0838ff48-b9da-418e-b0eb-1c3acf6c2f46 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:25.670296 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa46f8-44e7-4054-93da-38bb951f381f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:25.670989 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa46f8-44e7-4054-93da-38bb951f381f None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:25.671266 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa46f8-44e7-4054-93da-38bb951f381f None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:25.671533 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa46f8-44e7-4054-93da-38bb951f381f None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:25.672282 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aa46f8-44e7-4054-93da-38bb951f381f None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:25.672633 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aa46f8-44e7-4054-93da-38bb951f381f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:25.674134 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aa46f8-44e7-4054-93da-38bb951f381f None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:25.706619 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:25.718068 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 487/980] 10.222.0.26 () {56 vars in 1101 bytes} [Fri Aug 12 01:18:25 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:25.718068 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663642d3-1fe4-44d5-8b3d-17b4ad7d6a0a None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:25.718068 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663642d3-1fe4-44d5-8b3d-17b4ad7d6a0a None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:25.718068 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663642d3-1fe4-44d5-8b3d-17b4ad7d6a0a None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:25.718068 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 488/981] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:18:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:18:25.718068 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663642d3-1fe4-44d5-8b3d-17b4ad7d6a0a None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:25.764706 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0838ff48-b9da-418e-b0eb-1c3acf6c2f46 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:25.781790 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:25.806805 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542aa8ca-fb2b-44d0-b59b-27b1faf48b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:25.807602 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542aa8ca-fb2b-44d0-b59b-27b1faf48b7d None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:25.807968 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542aa8ca-fb2b-44d0-b59b-27b1faf48b7d None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:25.808327 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542aa8ca-fb2b-44d0-b59b-27b1faf48b7d None admin] PATH_INFO: `/v3/services` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:25.809064 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542aa8ca-fb2b-44d0-b59b-27b1faf48b7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:25.810587 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542aa8ca-fb2b-44d0-b59b-27b1faf48b7d None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:25.826148 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 494/982] 10.222.0.26 () {56 vars in 1087 bytes} [Fri Aug 12 01:18:25 2022] GET /identity/v3/services => generated 1497 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:18:25.826148 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5adbe51-6947-4939-8e07-45de4fc03459 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:25.826148 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5adbe51-6947-4939-8e07-45de4fc03459 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:25.826148 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5adbe51-6947-4939-8e07-45de4fc03459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:25.838600 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663642d3-1fe4-44d5-8b3d-17b4ad7d6a0a None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:25.843031 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-c5adbe51-6947-4939-8e07-45de4fc03459 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:18:25.844626 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-c5adbe51-6947-4939-8e07-45de4fc03459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:18:25.890476 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8605d72c-e15b-4286-a76f-139552a01726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:25.892470 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605d72c-e15b-4286-a76f-139552a01726 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:25.892755 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605d72c-e15b-4286-a76f-139552a01726 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:25.893058 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605d72c-e15b-4286-a76f-139552a01726 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:25.911963 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8605d72c-e15b-4286-a76f-139552a01726 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:25.913484 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8605d72c-e15b-4286-a76f-139552a01726 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:25.935444 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 495/983] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:18:25 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 01:18:25.937079 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-8605d72c-e15b-4286-a76f-139552a01726 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:18:25.937079 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:25.937079 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:25.937079 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:25.937079 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:25.937079 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:25.937079 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:25.937079 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:25.937079 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:25.937079 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:25.937079 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:25.937079 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:25.937079 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 01:18:25.937079 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 01:18:25.937079 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 01:18:25.937079 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 01:18:25.938020 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:25.938020 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:25.938020 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:25.938020 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:25.938020 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:25.938020 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:25.938020 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:25.938020 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:25.938020 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:25.938020 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:25.938020 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:25.938020 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:25.938020 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:25.938020 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:25.938020 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:25.938020 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:25.938020 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 01:18:25.939405 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 01:18:25.939405 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:18:25.939405 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:18:25.939405 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 489/984] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:18:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:18:25.945633 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5adbe51-6947-4939-8e07-45de4fc03459 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:25.996380 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:26.051031 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5adbe51-6947-4939-8e07-45de4fc03459 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:26.086514 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bdbf31-b36c-4d7e-b3ed-582fda1c055b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:26.087264 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdbf31-b36c-4d7e-b3ed-582fda1c055b None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:26.087636 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdbf31-b36c-4d7e-b3ed-582fda1c055b None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:26.088030 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdbf31-b36c-4d7e-b3ed-582fda1c055b None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:26.088771 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bdbf31-b36c-4d7e-b3ed-582fda1c055b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:26.089164 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bdbf31-b36c-4d7e-b3ed-582fda1c055b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:26.090654 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bdbf31-b36c-4d7e-b3ed-582fda1c055b None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:26.106147 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 496/985] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 01:18:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:26.108590 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8605d72c-e15b-4286-a76f-139552a01726 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:26.202304 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bdbf31-b36c-4d7e-b3ed-582fda1c055b None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:26.211859 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8605d72c-e15b-4286-a76f-139552a01726 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:26.225896 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:26.250773 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422ba238-7fb9-4dfa-b85b-47a3350e59ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:26.251654 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ba238-7fb9-4dfa-b85b-47a3350e59ec None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:26.252390 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ba238-7fb9-4dfa-b85b-47a3350e59ec None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:26.252812 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ba238-7fb9-4dfa-b85b-47a3350e59ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:26.260328 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422ba238-7fb9-4dfa-b85b-47a3350e59ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:26.261994 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422ba238-7fb9-4dfa-b85b-47a3350e59ec None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:26.273258 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-422ba238-7fb9-4dfa-b85b-47a3350e59ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 01:18:26.273258 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:26.273258 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:26.273258 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:26.273258 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:26.273258 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:26.273258 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:26.273258 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:26.273258 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:26.273258 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:26.273258 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:26.273258 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:26.273258 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 01:18:26.273258 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 01:18:26.273258 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 01:18:26.274238 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 01:18:26.274238 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:26.274238 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:26.274238 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:26.274238 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:26.274238 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:26.274238 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:26.274238 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:26.274238 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:26.274238 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:26.274238 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:26.274238 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:26.274238 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:26.274238 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:26.274238 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:26.274238 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:26.274238 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:26.280489 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 01:18:26.280489 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 01:18:26.280489 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 01:18:26.280489 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 01:18:26.280489 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 01:18:26.280489 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 01:18:26.280489 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 01:18:26.280489 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:18:26.280489 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 490/986] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 01:18:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:18:26.282319 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422ba238-7fb9-4dfa-b85b-47a3350e59ec None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:26.317505 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bdbf31-b36c-4d7e-b3ed-582fda1c055b None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:26.324911 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:26.353182 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f539219f-de7b-4c8e-85e5-a298e51ffcff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:26.353987 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f539219f-de7b-4c8e-85e5-a298e51ffcff None admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:26.354332 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f539219f-de7b-4c8e-85e5-a298e51ffcff None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:26.354608 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f539219f-de7b-4c8e-85e5-a298e51ffcff None admin] PATH_INFO: `/v3/services` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:26.355244 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f539219f-de7b-4c8e-85e5-a298e51ffcff None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:26.356667 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f539219f-de7b-4c8e-85e5-a298e51ffcff None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:26.372385 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 497/987] 10.222.0.26 () {60 vars in 1141 bytes} [Fri Aug 12 01:18:26 2022] POST /identity/v3/services => generated 242 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 01:18:26.396804 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422ba238-7fb9-4dfa-b85b-47a3350e59ec None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:26.441646 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c8c89c-66a6-4e8c-8b8f-8b077d783d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:26.442309 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c8c89c-66a6-4e8c-8b8f-8b077d783d9c None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:26.442631 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c8c89c-66a6-4e8c-8b8f-8b077d783d9c None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:26.442897 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c8c89c-66a6-4e8c-8b8f-8b077d783d9c None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:26.443594 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c8c89c-66a6-4e8c-8b8f-8b077d783d9c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:26.443899 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c8c89c-66a6-4e8c-8b8f-8b077d783d9c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:26.445339 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c8c89c-66a6-4e8c-8b8f-8b077d783d9c None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:26.459133 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 491/988] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Aug 12 01:18:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:18:26.465058 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f539219f-de7b-4c8e-85e5-a298e51ffcff None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:26.573339 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f539219f-de7b-4c8e-85e5-a298e51ffcff None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:26.606295 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02aae0c-27a3-48ab-bc4b-cb158a8ca2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:26.607064 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02aae0c-27a3-48ab-bc4b-cb158a8ca2fc None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:26.607440 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02aae0c-27a3-48ab-bc4b-cb158a8ca2fc None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:26.607805 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02aae0c-27a3-48ab-bc4b-cb158a8ca2fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:26.608668 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02aae0c-27a3-48ab-bc4b-cb158a8ca2fc None admin] RBAC: Adding query filter params (role.id=90822fc7f8cf4ded8bccf87f3036eb1a, scope.project.id=fa91143910a74c6b896ced5b51f9966a, user.id=f3643631cf2d4a9592d465bdeba99669) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:26.609070 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02aae0c-27a3-48ab-bc4b-cb158a8ca2fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:26.610630 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02aae0c-27a3-48ab-bc4b-cb158a8ca2fc None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:26.617021 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 498/989] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 01:18:26 2022] GET /identity/v3/role_assignments?user.id=f3643631cf2d4a9592d465bdeba99669&scope.project.id=fa91143910a74c6b896ced5b51f9966a&role.id=90822fc7f8cf4ded8bccf87f3036eb1a => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:27.741282 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafc882-058f-4b98-8f41-293b3660f393 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:27.741804 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafc882-058f-4b98-8f41-293b3660f393 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:27.741804 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafc882-058f-4b98-8f41-293b3660f393 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:27.743039 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 492/990] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:18:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:18:27.748467 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346dd3e6-3f1d-45f5-8b85-ed90e8f29c32 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:27.748872 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346dd3e6-3f1d-45f5-8b85-ed90e8f29c32 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:27.748961 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346dd3e6-3f1d-45f5-8b85-ed90e8f29c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:27.767673 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-346dd3e6-3f1d-45f5-8b85-ed90e8f29c32 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:18:27.768830 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-346dd3e6-3f1d-45f5-8b85-ed90e8f29c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:18:27.792707 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:27.836477 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 499/991] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:18:27 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 01:18:28.095276 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fafc882-058f-4b98-8f41-293b3660f393 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:28.125122 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:28.205733 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fafc882-058f-4b98-8f41-293b3660f393 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:28.242024 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f1e155-0e93-44a5-98f7-d22496c93f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:28.242664 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1e155-0e93-44a5-98f7-d22496c93f1d None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:28.242936 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1e155-0e93-44a5-98f7-d22496c93f1d None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:28.243196 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1e155-0e93-44a5-98f7-d22496c93f1d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:28.243771 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f1e155-0e93-44a5-98f7-d22496c93f1d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:28.245119 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f1e155-0e93-44a5-98f7-d22496c93f1d None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:28.253853 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-58f1e155-0e93-44a5-98f7-d22496c93f1d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 12 01:18:28.253853 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:28.253853 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 01:18:28.253853 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 01:18:28.253853 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 01:18:28.253853 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 01:18:28.253853 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 01:18:28.253853 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 01:18:28.253853 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 12 01:18:28.253853 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:18:28.253853 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 01:18:28.253853 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:18:28.253853 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:28.253853 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:28.253853 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:28.253853 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:28.253853 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:28.254969 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:28.254969 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:28.254969 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:28.254969 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:28.254969 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:28.254969 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:28.254969 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 01:18:28.254969 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 01:18:28.254969 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 01:18:28.254969 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 01:18:28.254969 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:28.254969 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:28.254969 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:28.254969 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:28.254969 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:28.254969 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:28.255822 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:28.255822 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:28.255822 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:28.255822 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:28.255822 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:28.255822 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:28.255822 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:28.255822 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:28.255822 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:28.255822 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:28.255822 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 01:18:28.255822 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 01:18:28.255822 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 12 01:18:28.255822 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:18:28.258482 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 493/992] 10.222.0.26 () {56 vars in 1126 bytes} [Fri Aug 12 01:18:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:18:28.260882 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346dd3e6-3f1d-45f5-8b85-ed90e8f29c32 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:28.313961 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f2377-1c07-42ae-9cde-a7c55a9030ef None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:28.314345 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f2377-1c07-42ae-9cde-a7c55a9030ef None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:28.314604 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f2377-1c07-42ae-9cde-a7c55a9030ef None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:28.316063 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 494/993] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:18:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 01:18:28.320804 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd3c44-0c28-47f1-8d70-064bccf74120 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:28.321087 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd3c44-0c28-47f1-8d70-064bccf74120 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:28.321354 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd3c44-0c28-47f1-8d70-064bccf74120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:28.339833 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-82dd3c44-0c28-47f1-8d70-064bccf74120 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:18:28.341007 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-82dd3c44-0c28-47f1-8d70-064bccf74120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:18:28.363372 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346dd3e6-3f1d-45f5-8b85-ed90e8f29c32 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:28.410054 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457a2854-7c49-4a69-9dc9-820157a0239f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:28.410692 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457a2854-7c49-4a69-9dc9-820157a0239f None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:28.410968 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457a2854-7c49-4a69-9dc9-820157a0239f None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:28.411230 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457a2854-7c49-4a69-9dc9-820157a0239f None admin] PATH_INFO: `/v3/services` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:28.411855 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457a2854-7c49-4a69-9dc9-820157a0239f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:28.412151 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457a2854-7c49-4a69-9dc9-820157a0239f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:28.413506 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 495/994] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:18:28 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 01:18:28.413615 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457a2854-7c49-4a69-9dc9-820157a0239f None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:28.425959 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 500/995] 10.222.0.26 () {56 vars in 1122 bytes} [Fri Aug 12 01:18:28 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:28.426892 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd3c44-0c28-47f1-8d70-064bccf74120 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:28.457068 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:28.521269 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c380c93-e7fb-4fb3-a76e-b52ee5370285 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:28.521541 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c380c93-e7fb-4fb3-a76e-b52ee5370285 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:28.521811 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c380c93-e7fb-4fb3-a76e-b52ee5370285 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:28.526284 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 501/996] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:18:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 01:18:28.528539 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef5b5c-291b-442e-b455-045f53aab094 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:28.528990 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef5b5c-291b-442e-b455-045f53aab094 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:28.529433 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef5b5c-291b-442e-b455-045f53aab094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:28.546068 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd3c44-0c28-47f1-8d70-064bccf74120 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:28.550947 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-e6ef5b5c-291b-442e-b455-045f53aab094 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:18:28.552308 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-e6ef5b5c-291b-442e-b455-045f53aab094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:18:28.575659 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:28.587502 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee6a0c4-e1d7-4f51-b76c-481908324111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:28.588519 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee6a0c4-e1d7-4f51-b76c-481908324111 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:28.589011 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee6a0c4-e1d7-4f51-b76c-481908324111 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:28.589455 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee6a0c4-e1d7-4f51-b76c-481908324111 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:28.590357 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee6a0c4-e1d7-4f51-b76c-481908324111 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:28.590832 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee6a0c4-e1d7-4f51-b76c-481908324111 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:28.592447 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee6a0c4-e1d7-4f51-b76c-481908324111 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:28.598969 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 496/997] 10.222.0.26 () {56 vars in 1122 bytes} [Fri Aug 12 01:18:28 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:28.604596 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee6a0c4-e1d7-4f51-b76c-481908324111 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:28.629469 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 502/998] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:18:28 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 01:18:28.692682 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ef5b5c-291b-442e-b455-045f53aab094 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:28.695187 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:28.711798 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee6a0c4-e1d7-4f51-b76c-481908324111 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:28.755074 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d9ae8-493f-4a05-bb51-98a2b6b85f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:28.756081 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d9ae8-493f-4a05-bb51-98a2b6b85f3c None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:28.756554 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d9ae8-493f-4a05-bb51-98a2b6b85f3c None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:28.757013 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d9ae8-493f-4a05-bb51-98a2b6b85f3c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:28.758196 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9d9ae8-493f-4a05-bb51-98a2b6b85f3c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:28.760337 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9d9ae8-493f-4a05-bb51-98a2b6b85f3c None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:28.777327 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 497/999] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:18:28 2022] POST /identity/v3/endpoints => generated 325 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 01:18:28.801438 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ef5b5c-291b-442e-b455-045f53aab094 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:28.846819 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dad59c5-d49a-4811-a5c2-23d80ef16fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:28.847453 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad59c5-d49a-4811-a5c2-23d80ef16fa7 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:28.847719 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad59c5-d49a-4811-a5c2-23d80ef16fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:28.847988 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad59c5-d49a-4811-a5c2-23d80ef16fa7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:28.848654 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dad59c5-d49a-4811-a5c2-23d80ef16fa7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:28.850018 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dad59c5-d49a-4811-a5c2-23d80ef16fa7 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:28.859906 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-4dad59c5-d49a-4811-a5c2-23d80ef16fa7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 12 01:18:28.859906 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:28.859906 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 01:18:28.859906 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 01:18:28.859906 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 01:18:28.859906 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 01:18:28.859906 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 01:18:28.859906 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 01:18:28.859906 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 12 01:18:28.859906 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:18:28.859906 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 01:18:28.859906 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:18:28.859906 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:28.859906 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:28.859906 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:28.859906 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:28.859906 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:28.861234 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:28.861234 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:28.861234 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:28.861234 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:28.861234 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:28.861234 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:28.861234 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 01:18:28.861234 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 01:18:28.861234 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 01:18:28.861234 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 01:18:28.861234 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:28.861234 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:28.861234 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:28.861234 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:28.861234 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:28.861234 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:28.862315 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:28.862315 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:28.862315 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:28.862315 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:28.862315 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:28.862315 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:28.862315 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:28.862315 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:28.862315 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:28.862315 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:28.862315 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 01:18:28.862315 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 01:18:28.862315 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 12 01:18:28.862315 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:18:28.863967 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 503/1000] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 01:18:28 2022] GET /identity/v3/services/compute => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:18:28.871302 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d9ae8-493f-4a05-bb51-98a2b6b85f3c None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:28.901204 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dad59c5-d49a-4811-a5c2-23d80ef16fa7 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:28.920051 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:28.987627 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d9ae8-493f-4a05-bb51-98a2b6b85f3c None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:29.017084 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dad59c5-d49a-4811-a5c2-23d80ef16fa7 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:29.022222 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea925fe-0843-4302-ba1a-57af926ded7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:29.022832 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea925fe-0843-4302-ba1a-57af926ded7c None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:29.023095 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea925fe-0843-4302-ba1a-57af926ded7c None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:29.023364 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea925fe-0843-4302-ba1a-57af926ded7c None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:29.023985 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea925fe-0843-4302-ba1a-57af926ded7c None admin] RBAC: Adding query filter params (name=compute) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:29.024278 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea925fe-0843-4302-ba1a-57af926ded7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:29.025647 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea925fe-0843-4302-ba1a-57af926ded7c None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:29.034152 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 498/1001] 10.222.0.26 () {56 vars in 1112 bytes} [Fri Aug 12 01:18:28 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:29.036085 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea925fe-0843-4302-ba1a-57af926ded7c None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:29.051502 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:29.058108 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf00da1-1355-41b0-b7a6-576a7d3f840f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:29.058786 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf00da1-1355-41b0-b7a6-576a7d3f840f None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:29.059055 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf00da1-1355-41b0-b7a6-576a7d3f840f None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:29.059327 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf00da1-1355-41b0-b7a6-576a7d3f840f None admin] PATH_INFO: `/v3/services/image` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:29.059903 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf00da1-1355-41b0-b7a6-576a7d3f840f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:29.061252 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf00da1-1355-41b0-b7a6-576a7d3f840f None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:29.070649 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-caf00da1-1355-41b0-b7a6-576a7d3f840f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 12 01:18:29.070649 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:29.070649 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 01:18:29.070649 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 01:18:29.070649 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 01:18:29.070649 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 01:18:29.070649 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 01:18:29.070649 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 01:18:29.070649 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 12 01:18:29.070649 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:18:29.070649 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 01:18:29.070649 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:18:29.070649 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:29.070649 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:29.070649 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:29.070649 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:29.070649 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:29.071669 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:29.071669 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:29.071669 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:29.071669 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:29.071669 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:29.071669 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:29.071669 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 01:18:29.071669 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 01:18:29.071669 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 01:18:29.071669 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 01:18:29.071669 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:29.071669 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:29.071669 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:29.071669 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:29.071669 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:29.071669 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:29.072507 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:29.072507 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:29.072507 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:29.072507 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:29.072507 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:29.072507 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:29.072507 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:29.072507 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:29.072507 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:29.072507 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:29.072507 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 01:18:29.072507 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 01:18:29.072507 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 12 01:18:29.072507 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:18:29.072507 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 504/1002] 10.222.0.26 () {56 vars in 1105 bytes} [Fri Aug 12 01:18:28 2022] GET /identity/v3/services/image => generated 86 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 01:18:29.077806 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf00da1-1355-41b0-b7a6-576a7d3f840f None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:29.153834 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea925fe-0843-4302-ba1a-57af926ded7c None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:29.159638 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:29.184193 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf00da1-1355-41b0-b7a6-576a7d3f840f None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:29.190065 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0453e26e-736f-468e-aa13-94a2de2f6916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:29.191061 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0453e26e-736f-468e-aa13-94a2de2f6916 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:29.191540 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0453e26e-736f-468e-aa13-94a2de2f6916 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:29.191896 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0453e26e-736f-468e-aa13-94a2de2f6916 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:29.192612 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0453e26e-736f-468e-aa13-94a2de2f6916 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:29.193002 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0453e26e-736f-468e-aa13-94a2de2f6916 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:29.194478 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0453e26e-736f-468e-aa13-94a2de2f6916 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:29.199954 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 499/1003] 10.222.0.26 () {56 vars in 1112 bytes} [Fri Aug 12 01:18:29 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:29.205527 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0453e26e-736f-468e-aa13-94a2de2f6916 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:29.226605 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ed63c9-7fbe-48b8-8964-d47a14de1182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:29.227219 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed63c9-7fbe-48b8-8964-d47a14de1182 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:29.227496 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed63c9-7fbe-48b8-8964-d47a14de1182 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:29.227792 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed63c9-7fbe-48b8-8964-d47a14de1182 None admin] PATH_INFO: `/v3/services` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:29.228498 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ed63c9-7fbe-48b8-8964-d47a14de1182 None admin] RBAC: Adding query filter params (name=image) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:29.228798 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ed63c9-7fbe-48b8-8964-d47a14de1182 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:29.230253 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ed63c9-7fbe-48b8-8964-d47a14de1182 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:29.235656 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 505/1004] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:18:29 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:18:29.241569 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ed63c9-7fbe-48b8-8964-d47a14de1182 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:29.286561 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:29.317016 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0453e26e-736f-468e-aa13-94a2de2f6916 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:29.346813 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ed63c9-7fbe-48b8-8964-d47a14de1182 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:29.354661 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca987579-d150-4d9b-9081-6ca9acf0ca46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:29.355382 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca987579-d150-4d9b-9081-6ca9acf0ca46 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:29.355753 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca987579-d150-4d9b-9081-6ca9acf0ca46 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:29.356118 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca987579-d150-4d9b-9081-6ca9acf0ca46 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:29.356890 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca987579-d150-4d9b-9081-6ca9acf0ca46 None admin] RBAC: Adding query filter params (interface=public, service_id=9885463be6874e34aff8a58517f7ca6d, region_id=RegionOne) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:29.357264 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca987579-d150-4d9b-9081-6ca9acf0ca46 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:29.358770 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca987579-d150-4d9b-9081-6ca9acf0ca46 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:29.364227 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 500/1005] 10.222.0.26 () {56 vars in 1251 bytes} [Fri Aug 12 01:18:29 2022] GET /identity/v3/endpoints?service_id=9885463be6874e34aff8a58517f7ca6d&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:18:29.369896 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca987579-d150-4d9b-9081-6ca9acf0ca46 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:29.383175 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e267e1-a23e-491d-a3b5-2e04154befb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:29.383873 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e267e1-a23e-491d-a3b5-2e04154befb6 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:29.384217 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e267e1-a23e-491d-a3b5-2e04154befb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:29.384551 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e267e1-a23e-491d-a3b5-2e04154befb6 None admin] PATH_INFO: `/v3/services` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:29.385249 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e267e1-a23e-491d-a3b5-2e04154befb6 None admin] RBAC: Adding query filter params (type=image) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:29.385552 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e267e1-a23e-491d-a3b5-2e04154befb6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:29.386934 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e267e1-a23e-491d-a3b5-2e04154befb6 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:29.398969 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 506/1006] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:18:29 2022] GET /identity/v3/services?type=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:29.482998 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca987579-d150-4d9b-9081-6ca9acf0ca46 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:29.522262 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd5270b-39a3-4bd4-8be2-55e7c1604092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:29.523063 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5270b-39a3-4bd4-8be2-55e7c1604092 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:29.523341 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5270b-39a3-4bd4-8be2-55e7c1604092 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:29.523608 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5270b-39a3-4bd4-8be2-55e7c1604092 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:29.524225 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd5270b-39a3-4bd4-8be2-55e7c1604092 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:29.525641 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd5270b-39a3-4bd4-8be2-55e7c1604092 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:29.542225 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 501/1007] 10.222.0.26 () {56 vars in 1087 bytes} [Fri Aug 12 01:18:29 2022] GET /identity/v3/services => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 01:18:30.656829 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44c6e0-a25e-4d6c-ac1b-7f899285945f None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:30.657361 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44c6e0-a25e-4d6c-ac1b-7f899285945f None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:30.657361 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44c6e0-a25e-4d6c-ac1b-7f899285945f None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:30.659001 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 507/1008] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:18:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:18:30.664346 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f20889-a680-4bd4-88da-c37d944ce9d1 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:30.664773 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f20889-a680-4bd4-88da-c37d944ce9d1 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:30.664848 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f20889-a680-4bd4-88da-c37d944ce9d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:30.671381 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:30.683663 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-39f20889-a680-4bd4-88da-c37d944ce9d1 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:18:30.684803 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-39f20889-a680-4bd4-88da-c37d944ce9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:18:30.753518 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 502/1009] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:18:30 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 01:18:31.012653 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a44c6e0-a25e-4d6c-ac1b-7f899285945f None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:31.022443 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:31.121707 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a44c6e0-a25e-4d6c-ac1b-7f899285945f None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:31.156906 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3d054e-b57d-42d4-979e-9a83579cd0c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:31.157622 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d054e-b57d-42d4-979e-9a83579cd0c0 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:31.157978 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d054e-b57d-42d4-979e-9a83579cd0c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:31.158283 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d054e-b57d-42d4-979e-9a83579cd0c0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:31.159412 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3d054e-b57d-42d4-979e-9a83579cd0c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:31.160829 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3d054e-b57d-42d4-979e-9a83579cd0c0 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:31.162594 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 508/1010] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:18:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:31.169277 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f20889-a680-4bd4-88da-c37d944ce9d1 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:31.267596 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f20889-a680-4bd4-88da-c37d944ce9d1 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:31.296584 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:31.303216 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fdf0fb-3755-4281-89e2-3af5e0ebaaa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:31.303522 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78aa0f-332c-412c-b559-b621b4473d42 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:31.303786 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78aa0f-332c-412c-b559-b621b4473d42 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:31.303898 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fdf0fb-3755-4281-89e2-3af5e0ebaaa7 None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:31.304052 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78aa0f-332c-412c-b559-b621b4473d42 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:31.304145 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fdf0fb-3755-4281-89e2-3af5e0ebaaa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:31.304303 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fdf0fb-3755-4281-89e2-3af5e0ebaaa7 None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:31.304977 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fdf0fb-3755-4281-89e2-3af5e0ebaaa7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:31.305531 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 509/1011] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:18:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 01:18:31.306433 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fdf0fb-3755-4281-89e2-3af5e0ebaaa7 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:31.310370 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894aaf6e-4ae7-43c0-840e-fff10605d984 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:31.310655 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894aaf6e-4ae7-43c0-840e-fff10605d984 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:31.310908 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894aaf6e-4ae7-43c0-840e-fff10605d984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:31.328887 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-894aaf6e-4ae7-43c0-840e-fff10605d984 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:18:31.330287 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-894aaf6e-4ae7-43c0-840e-fff10605d984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:18:31.335685 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 503/1012] 10.222.0.26 () {60 vars in 1141 bytes} [Fri Aug 12 01:18:31 2022] POST /identity/v3/projects => generated 311 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:18:31.410165 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 510/1013] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:18:31 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 01:18:31.460993 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a9369-41b1-486a-9dab-6a197dff16b4 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:31.461351 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a9369-41b1-486a-9dab-6a197dff16b4 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:31.461512 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a9369-41b1-486a-9dab-6a197dff16b4 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:31.463092 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 504/1014] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:18:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:18:31.468772 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c86e49-2747-4474-830b-7d9802ea93e3 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:31.469109 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c86e49-2747-4474-830b-7d9802ea93e3 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:31.469278 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c86e49-2747-4474-830b-7d9802ea93e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:31.478383 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:31.491910 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-28c86e49-2747-4474-830b-7d9802ea93e3 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:18:31.493524 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-28c86e49-2747-4474-830b-7d9802ea93e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:18:31.563593 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 511/1015] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:18:31 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 01:18:31.673456 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a9369-41b1-486a-9dab-6a197dff16b4 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:31.778953 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a9369-41b1-486a-9dab-6a197dff16b4 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:31.813279 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de96ad5-9fae-4cc6-a479-475ce3b4f462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:31.813991 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de96ad5-9fae-4cc6-a479-475ce3b4f462 None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:31.814406 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de96ad5-9fae-4cc6-a479-475ce3b4f462 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:31.814693 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de96ad5-9fae-4cc6-a479-475ce3b4f462 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:31.815330 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de96ad5-9fae-4cc6-a479-475ce3b4f462 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:31.816708 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de96ad5-9fae-4cc6-a479-475ce3b4f462 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:31.824663 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c86e49-2747-4474-830b-7d9802ea93e3 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:31.834593 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 505/1016] 10.222.0.26 () {60 vars in 1141 bytes} [Fri Aug 12 01:18:31 2022] POST /identity/v3/services => generated 242 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:18:31.936354 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c86e49-2747-4474-830b-7d9802ea93e3 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:31.973447 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:31.979929 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181e690a-4302-4272-87db-b23c88bb5be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:31.980573 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e690a-4302-4272-87db-b23c88bb5be5 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:31.980862 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e690a-4302-4272-87db-b23c88bb5be5 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:31.981131 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e690a-4302-4272-87db-b23c88bb5be5 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:31.981740 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181e690a-4302-4272-87db-b23c88bb5be5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:31.983198 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181e690a-4302-4272-87db-b23c88bb5be5 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:31.992689 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-181e690a-4302-4272-87db-b23c88bb5be5 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 12 01:18:31.992689 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:31.992689 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 01:18:31.992689 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 01:18:31.992689 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 01:18:31.992689 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 01:18:31.992689 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 01:18:31.992689 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 01:18:31.992689 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 12 01:18:31.992689 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:18:31.992689 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 01:18:31.992689 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:18:31.992689 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:31.992689 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:31.992689 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:31.992689 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:31.992689 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:31.993906 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:31.993906 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:31.993906 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:31.993906 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:31.993906 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:31.993906 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:31.993906 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 01:18:31.993906 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 01:18:31.993906 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 01:18:31.993906 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 01:18:31.993906 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:31.993906 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:31.993906 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:31.993906 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:31.993906 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:31.993906 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:31.994854 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:31.994854 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:31.994854 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:31.994854 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:31.994854 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:31.994854 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:31.994854 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:31.994854 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:31.994854 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:31.994854 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:31.994854 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 01:18:31.994854 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 01:18:31.994854 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 12 01:18:31.994854 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:18:31.994854 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 512/1017] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 01:18:31 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 01:18:32.001766 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de96ad5-9fae-4cc6-a479-475ce3b4f462 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:32.049394 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:32.107032 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de96ad5-9fae-4cc6-a479-475ce3b4f462 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:32.141020 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53580a01-f11a-4843-83eb-d47bb6965ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:32.141732 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53580a01-f11a-4843-83eb-d47bb6965ff5 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:32.142134 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53580a01-f11a-4843-83eb-d47bb6965ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:32.142423 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53580a01-f11a-4843-83eb-d47bb6965ff5 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:32.143055 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53580a01-f11a-4843-83eb-d47bb6965ff5 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:32.143356 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53580a01-f11a-4843-83eb-d47bb6965ff5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:32.144723 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53580a01-f11a-4843-83eb-d47bb6965ff5 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:32.154299 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 506/1018] 10.222.0.26 () {56 vars in 1112 bytes} [Fri Aug 12 01:18:32 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:32.155511 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181e690a-4302-4272-87db-b23c88bb5be5 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:32.257666 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181e690a-4302-4272-87db-b23c88bb5be5 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:32.291244 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79724b1e-fd4d-4007-adb3-a138b808af25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:32.291841 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79724b1e-fd4d-4007-adb3-a138b808af25 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:32.292115 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79724b1e-fd4d-4007-adb3-a138b808af25 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:32.292378 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79724b1e-fd4d-4007-adb3-a138b808af25 None admin] PATH_INFO: `/v3/services` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:32.293001 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79724b1e-fd4d-4007-adb3-a138b808af25 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:32.293295 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79724b1e-fd4d-4007-adb3-a138b808af25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:32.294676 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79724b1e-fd4d-4007-adb3-a138b808af25 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:32.301592 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 513/1019] 10.222.0.26 () {56 vars in 1112 bytes} [Fri Aug 12 01:18:32 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:18:32.306009 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53580a01-f11a-4843-83eb-d47bb6965ff5 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:32.409691 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53580a01-f11a-4843-83eb-d47bb6965ff5 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:32.419705 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:32.446676 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b08153-23da-4925-aca6-c35392d22ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:32.447277 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b08153-23da-4925-aca6-c35392d22ffa None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:32.447546 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b08153-23da-4925-aca6-c35392d22ffa None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:32.447813 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b08153-23da-4925-aca6-c35392d22ffa None admin] PATH_INFO: `/v3/endpoints` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:32.448466 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b08153-23da-4925-aca6-c35392d22ffa None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:32.449824 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b08153-23da-4925-aca6-c35392d22ffa None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:32.472734 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 507/1020] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:18:32 2022] POST /identity/v3/endpoints => generated 334 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:18:33.315311 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a75438-ccba-4aeb-a5cd-a409b193c448 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:33.315857 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a75438-ccba-4aeb-a5cd-a409b193c448 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:33.315857 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a75438-ccba-4aeb-a5cd-a409b193c448 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:33.317420 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 514/1021] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:18:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:18:33.322697 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a0907-a945-40ac-ac25-fbcaeed98d55 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:33.323132 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a0907-a945-40ac-ac25-fbcaeed98d55 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:33.323295 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a0907-a945-40ac-ac25-fbcaeed98d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:33.341637 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-983a0907-a945-40ac-ac25-fbcaeed98d55 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:18:33.342869 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-983a0907-a945-40ac-ac25-fbcaeed98d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:18:33.419218 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 508/1022] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:18:33 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 01:18:33.682241 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a75438-ccba-4aeb-a5cd-a409b193c448 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:33.742572 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:33.744370 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b531ce95-1dbd-436b-8d28-261731f6f23a None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:33.744656 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b531ce95-1dbd-436b-8d28-261731f6f23a None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:33.744963 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b531ce95-1dbd-436b-8d28-261731f6f23a None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:33.746506 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 509/1023] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:18:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 01:18:33.751515 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d260e2a-002f-4f81-912a-8cc0a16d7e9f None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:33.752282 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d260e2a-002f-4f81-912a-8cc0a16d7e9f None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:33.752573 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d260e2a-002f-4f81-912a-8cc0a16d7e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:33.770827 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-2d260e2a-002f-4f81-912a-8cc0a16d7e9f None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:18:33.772011 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2d260e2a-002f-4f81-912a-8cc0a16d7e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:18:33.787262 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a75438-ccba-4aeb-a5cd-a409b193c448 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:33.821401 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6a7935-a829-458a-9f2e-36fe200669c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:33.822031 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a7935-a829-458a-9f2e-36fe200669c8 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:33.822330 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a7935-a829-458a-9f2e-36fe200669c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:33.822599 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a7935-a829-458a-9f2e-36fe200669c8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:33.823688 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6a7935-a829-458a-9f2e-36fe200669c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:33.825105 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6a7935-a829-458a-9f2e-36fe200669c8 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:33.826889 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 515/1024] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:18:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:33.832300 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6a7935-a829-458a-9f2e-36fe200669c8 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:33.844360 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 510/1025] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:18:33 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 01:18:33.936260 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6a7935-a829-458a-9f2e-36fe200669c8 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:33.962898 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:33.974186 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db72fe90-c663-42aa-9c19-d1867ce1a729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:33.974798 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db72fe90-c663-42aa-9c19-d1867ce1a729 None admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:33.975074 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db72fe90-c663-42aa-9c19-d1867ce1a729 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:33.975341 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db72fe90-c663-42aa-9c19-d1867ce1a729 None admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:33.975974 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db72fe90-c663-42aa-9c19-d1867ce1a729 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:33.977461 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db72fe90-c663-42aa-9c19-d1867ce1a729 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:34.000256 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 516/1026] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Aug 12 01:18:33 2022] POST /identity/v3/users => generated 285 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 01:18:34.111735 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d260e2a-002f-4f81-912a-8cc0a16d7e9f None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:34.135708 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:34.222511 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d260e2a-002f-4f81-912a-8cc0a16d7e9f None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:34.259234 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a136b76-e53a-4e36-bc7b-35a23b0273d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:34.259868 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a136b76-e53a-4e36-bc7b-35a23b0273d3 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:34.260139 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a136b76-e53a-4e36-bc7b-35a23b0273d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:34.260405 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a136b76-e53a-4e36-bc7b-35a23b0273d3 None admin] PATH_INFO: `/v3/services/image` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:34.260978 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a136b76-e53a-4e36-bc7b-35a23b0273d3 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:34.262366 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a136b76-e53a-4e36-bc7b-35a23b0273d3 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:34.270929 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-8a136b76-e53a-4e36-bc7b-35a23b0273d3 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 12 01:18:34.270929 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:34.270929 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 01:18:34.270929 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 01:18:34.270929 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 01:18:34.270929 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 01:18:34.270929 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 01:18:34.270929 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 01:18:34.270929 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 12 01:18:34.270929 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:18:34.270929 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 01:18:34.270929 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:18:34.270929 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:34.270929 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:34.270929 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:34.270929 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:34.270929 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:34.271919 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:34.271919 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:34.271919 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:34.271919 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:34.271919 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:34.271919 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:34.271919 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 01:18:34.271919 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 01:18:34.271919 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 01:18:34.271919 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 01:18:34.271919 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:34.271919 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:34.271919 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:34.271919 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:34.271919 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:34.271919 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:34.274088 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:34.274088 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:34.274088 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:34.274088 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:34.274088 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:34.274088 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:34.274088 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:34.274088 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:34.274088 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:34.274088 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:34.274088 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 01:18:34.274088 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 01:18:34.274088 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 12 01:18:34.274088 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:18:34.274088 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 511/1027] 10.222.0.26 () {56 vars in 1105 bytes} [Fri Aug 12 01:18:34 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:18:34.279246 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db72fe90-c663-42aa-9c19-d1867ce1a729 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:34.386056 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db72fe90-c663-42aa-9c19-d1867ce1a729 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:34.423481 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f45b037-32b0-4015-a929-73a3b7273a82 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:34.424035 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f45b037-32b0-4015-a929-73a3b7273a82 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:34.424035 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f45b037-32b0-4015-a929-73a3b7273a82 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:34.425277 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 512/1028] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:18:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:18:34.425830 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3ddb38-c56f-458b-94b7-4789a4a62c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:34.426704 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3ddb38-c56f-458b-94b7-4789a4a62c89 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:34.427136 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3ddb38-c56f-458b-94b7-4789a4a62c89 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:34.427552 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3ddb38-c56f-458b-94b7-4789a4a62c89 None admin] PATH_INFO: `/v3/services` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:34.428347 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3ddb38-c56f-458b-94b7-4789a4a62c89 None admin] RBAC: Adding query filter params (name=image) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:34.428921 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3ddb38-c56f-458b-94b7-4789a4a62c89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:34.430428 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f21161-de22-4edb-be16-a5c78baf7636 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:34.430643 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3ddb38-c56f-458b-94b7-4789a4a62c89 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:34.430765 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f21161-de22-4edb-be16-a5c78baf7636 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:34.430957 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f21161-de22-4edb-be16-a5c78baf7636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:34.437165 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 517/1029] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:18:34 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:34.442326 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3ddb38-c56f-458b-94b7-4789a4a62c89 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:34.449570 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-75f21161-de22-4edb-be16-a5c78baf7636 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:18:34.450771 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-75f21161-de22-4edb-be16-a5c78baf7636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:18:34.504971 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:34.530232 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 513/1030] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:18:34 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 01:18:34.571287 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3ddb38-c56f-458b-94b7-4789a4a62c89 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:34.606519 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a121e6e5-653f-4e4c-b7f9-fb9d69119d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:34.607120 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a121e6e5-653f-4e4c-b7f9-fb9d69119d47 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:34.607383 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a121e6e5-653f-4e4c-b7f9-fb9d69119d47 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:34.607659 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a121e6e5-653f-4e4c-b7f9-fb9d69119d47 None admin] PATH_INFO: `/v3/services` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:34.608278 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a121e6e5-653f-4e4c-b7f9-fb9d69119d47 None admin] RBAC: Adding query filter params (type=image) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:34.608572 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a121e6e5-653f-4e4c-b7f9-fb9d69119d47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:34.609955 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a121e6e5-653f-4e4c-b7f9-fb9d69119d47 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:34.620332 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 518/1031] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:18:34 2022] GET /identity/v3/services?type=image => generated 350 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:34.621659 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f21161-de22-4edb-be16-a5c78baf7636 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:34.638855 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:34.728134 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f21161-de22-4edb-be16-a5c78baf7636 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:34.761772 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1f821f-4345-4986-bf39-ac486af091d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:34.762686 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f821f-4345-4986-bf39-ac486af091d2 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:34.763152 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f821f-4345-4986-bf39-ac486af091d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:34.763606 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f821f-4345-4986-bf39-ac486af091d2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:34.764520 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1f821f-4345-4986-bf39-ac486af091d2 None admin] RBAC: Adding query filter params (interface=public, service_id=50d853679aba48ac8415a4d5e2ce2624, region_id=RegionOne) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:34.765011 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1f821f-4345-4986-bf39-ac486af091d2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:34.766661 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1f821f-4345-4986-bf39-ac486af091d2 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:34.771949 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 514/1032] 10.222.0.26 () {56 vars in 1251 bytes} [Fri Aug 12 01:18:34 2022] GET /identity/v3/endpoints?service_id=50d853679aba48ac8415a4d5e2ce2624&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:34.777945 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a121e6e5-653f-4e4c-b7f9-fb9d69119d47 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:34.793141 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1f821f-4345-4986-bf39-ac486af091d2 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:34.873350 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:34.896227 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1f821f-4345-4986-bf39-ac486af091d2 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:34.897001 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a121e6e5-653f-4e4c-b7f9-fb9d69119d47 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:34.908213 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:34.933264 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c9cd4-02a2-4c07-a8c9-1b371a30e962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:34.933948 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c9cd4-02a2-4c07-a8c9-1b371a30e962 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:34.934288 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c9cd4-02a2-4c07-a8c9-1b371a30e962 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:34.934506 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c9cd4-02a2-4c07-a8c9-1b371a30e962 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:34.934880 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441173c7-e315-4395-9345-ca9891e860cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:34.935489 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441173c7-e315-4395-9345-ca9891e860cc None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:34.935764 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441173c7-e315-4395-9345-ca9891e860cc None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:34.936031 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441173c7-e315-4395-9345-ca9891e860cc None admin] PATH_INFO: `/v3/services` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:34.936638 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441173c7-e315-4395-9345-ca9891e860cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:34.937995 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441173c7-e315-4395-9345-ca9891e860cc None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:34.945516 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832c9cd4-02a2-4c07-a8c9-1b371a30e962 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:18:34.950799 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-832c9cd4-02a2-4c07-a8c9-1b371a30e962 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 12 01:18:34.950799 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:34.950799 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:34.950799 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:34.950799 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:34.950799 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:34.950799 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:34.950799 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:34.950799 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:34.950799 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:34.950799 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:34.950799 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:34.950799 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:18:34.950799 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:18:34.950799 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:18:34.950799 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:18:34.951955 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:18:34.951955 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:18:34.951955 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:18:34.951955 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:18:34.951955 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:34.951955 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:34.951955 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:34.951955 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:34.951955 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:34.951955 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:34.951955 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:34.951955 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:34.951955 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:34.951955 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:34.951955 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:34.951955 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:34.953025 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:34.953025 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:34.953025 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:34.953025 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:34.953025 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:18:34.953025 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:18:34.953025 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:18:34.953025 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:18:34.953025 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:18:34.953025 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:18:34.953025 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 12 01:18:34.953025 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:18:34.954361 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 519/1033] 10.222.0.26 () {56 vars in 1087 bytes} [Fri Aug 12 01:18:34 2022] GET /identity/v3/services => generated 1957 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:18:34.958180 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 515/1034] 10.222.0.26 () {56 vars in 1120 bytes} [Fri Aug 12 01:18:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 01:18:34.961339 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441173c7-e315-4395-9345-ca9891e860cc None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:35.075017 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441173c7-e315-4395-9345-ca9891e860cc None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:35.112999 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8a89ba-ff89-4761-97f2-c657a71a7980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:35.113612 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a89ba-ff89-4761-97f2-c657a71a7980 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:35.113884 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a89ba-ff89-4761-97f2-c657a71a7980 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:35.114156 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a89ba-ff89-4761-97f2-c657a71a7980 None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:35.114831 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8a89ba-ff89-4761-97f2-c657a71a7980 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:35.115129 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8a89ba-ff89-4761-97f2-c657a71a7980 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:35.116480 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8a89ba-ff89-4761-97f2-c657a71a7980 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:35.125445 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 520/1035] 10.222.0.26 () {56 vars in 1115 bytes} [Fri Aug 12 01:18:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:35.131089 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c9cd4-02a2-4c07-a8c9-1b371a30e962 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:35.233735 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c9cd4-02a2-4c07-a8c9-1b371a30e962 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:35.267104 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c95cca-4758-48e0-8bfd-ed2351856139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:35.267918 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c95cca-4758-48e0-8bfd-ed2351856139 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:35.268282 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c95cca-4758-48e0-8bfd-ed2351856139 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:35.268641 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c95cca-4758-48e0-8bfd-ed2351856139 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:35.278498 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:35.281118 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c95cca-4758-48e0-8bfd-ed2351856139 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:35.283268 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c95cca-4758-48e0-8bfd-ed2351856139 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:35.298049 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-93c95cca-4758-48e0-8bfd-ed2351856139 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:18:35.298049 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:35.298049 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:35.298049 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:35.298049 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:35.298049 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:35.298049 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:35.298049 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:35.298049 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:35.298049 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:35.298049 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:35.298049 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:35.298049 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 01:18:35.298049 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 01:18:35.298049 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 01:18:35.298049 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 01:18:35.299225 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:35.299225 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:35.299225 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:35.299225 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:35.299225 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:35.299225 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:35.299225 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:35.299225 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:35.299225 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:35.299225 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:35.299225 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:35.299225 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:35.299225 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:35.299225 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:35.299225 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:35.299225 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:35.299225 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 01:18:35.300311 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 01:18:35.300311 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:18:35.300311 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:18:35.306065 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 516/1036] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:18:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:18:35.307568 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8a89ba-ff89-4761-97f2-c657a71a7980 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:35.345891 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:35.414185 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8a89ba-ff89-4761-97f2-c657a71a7980 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:35.448262 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae24d8be-a9fd-4dd8-a2f9-d52abbfc8044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:35.448864 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae24d8be-a9fd-4dd8-a2f9-d52abbfc8044 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:35.449134 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae24d8be-a9fd-4dd8-a2f9-d52abbfc8044 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:35.449395 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae24d8be-a9fd-4dd8-a2f9-d52abbfc8044 None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:35.450031 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae24d8be-a9fd-4dd8-a2f9-d52abbfc8044 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:35.450360 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae24d8be-a9fd-4dd8-a2f9-d52abbfc8044 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:35.451713 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae24d8be-a9fd-4dd8-a2f9-d52abbfc8044 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:35.463745 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 521/1037] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 01:18:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:35.469430 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c95cca-4758-48e0-8bfd-ed2351856139 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:35.570964 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c95cca-4758-48e0-8bfd-ed2351856139 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:35.607012 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1253bab7-cf9e-4616-b7f4-66bf72fc5322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:35.607561 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1253bab7-cf9e-4616-b7f4-66bf72fc5322 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:35.607836 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1253bab7-cf9e-4616-b7f4-66bf72fc5322 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:35.608100 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1253bab7-cf9e-4616-b7f4-66bf72fc5322 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:35.615940 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1253bab7-cf9e-4616-b7f4-66bf72fc5322 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:35.617377 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1253bab7-cf9e-4616-b7f4-66bf72fc5322 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:35.628515 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-1253bab7-cf9e-4616-b7f4-66bf72fc5322 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 12 01:18:35.628515 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:35.628515 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:35.628515 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:35.628515 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:35.628515 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:35.628515 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:35.628515 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:35.628515 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:35.628515 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:35.628515 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:35.628515 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:35.628515 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 01:18:35.628515 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 01:18:35.628515 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 01:18:35.628515 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 01:18:35.629489 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:35.629489 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:35.629489 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 01:18:35.629489 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 01:18:35.629489 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 01:18:35.629489 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 01:18:35.629489 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:35.629489 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:35.629489 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:35.629489 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:35.629489 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:35.629489 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:35.629489 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:35.629489 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:35.629489 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:35.629489 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:35.629489 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:35.629489 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:35.635447 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:35.635447 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:35.635447 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 01:18:35.635447 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 01:18:35.635447 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 01:18:35.635447 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 01:18:35.635447 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 01:18:35.635447 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 01:18:35.635447 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 12 01:18:35.635447 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:18:35.635447 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 517/1038] 10.222.0.26 () {56 vars in 1093 bytes} [Fri Aug 12 01:18:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:18:35.637534 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae24d8be-a9fd-4dd8-a2f9-d52abbfc8044 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:35.735673 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:35.742504 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae24d8be-a9fd-4dd8-a2f9-d52abbfc8044 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:35.776977 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be32948b-5f66-4adb-944d-f4855fb28ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:35.777626 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be32948b-5f66-4adb-944d-f4855fb28ea2 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:35.777899 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be32948b-5f66-4adb-944d-f4855fb28ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:35.778196 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be32948b-5f66-4adb-944d-f4855fb28ea2 None admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:35.778957 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be32948b-5f66-4adb-944d-f4855fb28ea2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:35.779259 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be32948b-5f66-4adb-944d-f4855fb28ea2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:35.780685 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be32948b-5f66-4adb-944d-f4855fb28ea2 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:35.803586 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 522/1039] 10.222.0.26 () {56 vars in 1133 bytes} [Fri Aug 12 01:18:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:35.805341 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1253bab7-cf9e-4616-b7f4-66bf72fc5322 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:35.861252 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:35.910945 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1253bab7-cf9e-4616-b7f4-66bf72fc5322 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:35.945969 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4c96d3-dcd8-432a-8757-c544ab01be53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:35.946619 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c96d3-dcd8-432a-8757-c544ab01be53 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:35.946929 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c96d3-dcd8-432a-8757-c544ab01be53 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:35.947196 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c96d3-dcd8-432a-8757-c544ab01be53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:35.966250 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1b1e8-a481-4ec7-a54b-95ff19456b98 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:35.966511 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1b1e8-a481-4ec7-a54b-95ff19456b98 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:35.966781 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1b1e8-a481-4ec7-a54b-95ff19456b98 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:35.968132 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 523/1040] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:18:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 01:18:35.973844 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ec316-878d-433e-9922-f0389aa9d581 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:35.974144 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ec316-878d-433e-9922-f0389aa9d581 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:35.974440 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ec316-878d-433e-9922-f0389aa9d581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:35.994518 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-3d9ec316-878d-433e-9922-f0389aa9d581 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:18:35.995954 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-3d9ec316-878d-433e-9922-f0389aa9d581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:18:36.019367 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4c96d3-dcd8-432a-8757-c544ab01be53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:36.020875 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4c96d3-dcd8-432a-8757-c544ab01be53 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:36.070913 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 524/1041] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:18:35 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 01:18:36.071833 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:36.128014 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 518/1042] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 01:18:35 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 12 01:18:36.129817 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ec316-878d-433e-9922-f0389aa9d581 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:36.216812 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:36.233679 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ec316-878d-433e-9922-f0389aa9d581 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:36.267640 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a931fa9e-0481-46d1-b7bc-93782b5fbe9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:36.268267 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a931fa9e-0481-46d1-b7bc-93782b5fbe9a None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:36.268535 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a931fa9e-0481-46d1-b7bc-93782b5fbe9a None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:36.268799 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a931fa9e-0481-46d1-b7bc-93782b5fbe9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:36.278791 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a931fa9e-0481-46d1-b7bc-93782b5fbe9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:36.280240 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a931fa9e-0481-46d1-b7bc-93782b5fbe9a None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:36.295430 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-a931fa9e-0481-46d1-b7bc-93782b5fbe9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:18:36.295430 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:36.295430 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:36.295430 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:36.295430 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:36.295430 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:36.295430 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:36.295430 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:36.295430 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:36.295430 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:36.295430 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:36.295430 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:36.295430 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 01:18:36.295430 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 01:18:36.295430 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 01:18:36.295430 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 01:18:36.296397 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:36.296397 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:36.296397 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:36.296397 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:36.296397 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:36.296397 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:36.296397 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:36.296397 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:36.296397 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:36.296397 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:36.296397 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:36.296397 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:36.296397 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:36.296397 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:36.296397 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:36.296397 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:36.296397 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 01:18:36.297303 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 01:18:36.297303 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:18:36.297303 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:18:36.298468 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 525/1043] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:18:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:18:36.302434 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4c96d3-dcd8-432a-8757-c544ab01be53 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:36.333486 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a931fa9e-0481-46d1-b7bc-93782b5fbe9a None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:36.411648 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4c96d3-dcd8-432a-8757-c544ab01be53 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:36.440528 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a931fa9e-0481-46d1-b7bc-93782b5fbe9a None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:36.451718 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eca0c4-c5ee-40ae-b443-5e36f58fa3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:36.452334 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eca0c4-c5ee-40ae-b443-5e36f58fa3e3 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:36.452608 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eca0c4-c5ee-40ae-b443-5e36f58fa3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:36.452875 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eca0c4-c5ee-40ae-b443-5e36f58fa3e3 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:36.453852 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eca0c4-c5ee-40ae-b443-5e36f58fa3e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:36.454183 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eca0c4-c5ee-40ae-b443-5e36f58fa3e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:36.455582 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eca0c4-c5ee-40ae-b443-5e36f58fa3e3 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:36.466875 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 519/1044] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 01:18:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:36.472774 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eca0c4-c5ee-40ae-b443-5e36f58fa3e3 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:36.478947 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd84523-af59-4df7-b6fc-0bd3061f11fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:36.479583 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd84523-af59-4df7-b6fc-0bd3061f11fd None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:36.479861 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd84523-af59-4df7-b6fc-0bd3061f11fd None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:36.480132 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd84523-af59-4df7-b6fc-0bd3061f11fd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:36.483186 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:36.491881 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:36.495929 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd84523-af59-4df7-b6fc-0bd3061f11fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:18:36.501109 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-efd84523-af59-4df7-b6fc-0bd3061f11fd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 01:18:36.501109 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:36.501109 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:36.501109 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:36.501109 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:36.501109 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:36.501109 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:36.501109 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:36.501109 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:36.501109 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:36.501109 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:36.501109 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:36.501109 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:18:36.501109 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:18:36.501109 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:18:36.501109 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:18:36.502057 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:18:36.502057 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:18:36.502057 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:18:36.502057 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:18:36.502057 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:36.502057 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:36.502057 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:36.502057 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:36.502057 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:36.502057 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:36.502057 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:36.502057 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:36.502057 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:36.502057 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:36.502057 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:36.502057 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:36.503199 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:36.503199 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:36.503199 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:36.503199 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:36.503199 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:18:36.503199 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:18:36.503199 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:18:36.503199 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:18:36.503199 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:18:36.503199 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:18:36.503199 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 01:18:36.503199 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:18:36.507862 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 526/1045] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Aug 12 01:18:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 01:18:36.508585 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd84523-af59-4df7-b6fc-0bd3061f11fd None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:36.589327 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eca0c4-c5ee-40ae-b443-5e36f58fa3e3 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:36.618742 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd84523-af59-4df7-b6fc-0bd3061f11fd None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:36.625162 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc557e4-7461-46e4-b685-6caa2a636304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:36.625823 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc557e4-7461-46e4-b685-6caa2a636304 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:36.626106 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc557e4-7461-46e4-b685-6caa2a636304 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:36.626384 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc557e4-7461-46e4-b685-6caa2a636304 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:36.632902 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc557e4-7461-46e4-b685-6caa2a636304 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:36.634362 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc557e4-7461-46e4-b685-6caa2a636304 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:36.645223 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-1cc557e4-7461-46e4-b685-6caa2a636304 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 01:18:36.645223 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:36.645223 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:36.645223 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:36.645223 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:36.645223 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:36.645223 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:36.645223 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:36.645223 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:36.645223 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:36.645223 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:36.645223 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:36.645223 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 01:18:36.645223 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 01:18:36.645223 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 01:18:36.646166 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 01:18:36.646166 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:36.646166 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:36.646166 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:36.646166 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:36.646166 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:36.646166 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:36.646166 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:36.646166 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:36.646166 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:36.646166 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:36.646166 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:36.646166 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:36.646166 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:36.646166 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:36.646166 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:36.646166 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:36.647098 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 01:18:36.647098 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 01:18:36.647098 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 01:18:36.647098 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 01:18:36.647098 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 01:18:36.647098 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 01:18:36.647098 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 01:18:36.647098 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:18:36.647098 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 520/1046] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 01:18:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:18:36.652035 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc557e4-7461-46e4-b685-6caa2a636304 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:36.660549 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac022e8d-4ca0-468d-ba9e-343284b855f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:36.661437 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac022e8d-4ca0-468d-ba9e-343284b855f8 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:36.661929 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac022e8d-4ca0-468d-ba9e-343284b855f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:36.662192 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac022e8d-4ca0-468d-ba9e-343284b855f8 None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:36.662866 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac022e8d-4ca0-468d-ba9e-343284b855f8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:36.663164 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac022e8d-4ca0-468d-ba9e-343284b855f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:36.664841 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac022e8d-4ca0-468d-ba9e-343284b855f8 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:36.679153 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 527/1047] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 01:18:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:36.679989 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac022e8d-4ca0-468d-ba9e-343284b855f8 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:36.728385 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:36.751406 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:36.762744 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc557e4-7461-46e4-b685-6caa2a636304 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:36.793587 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac022e8d-4ca0-468d-ba9e-343284b855f8 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:36.797980 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13122bb-46af-4df2-b1e0-27a60827fba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:36.798866 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13122bb-46af-4df2-b1e0-27a60827fba0 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:36.799342 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13122bb-46af-4df2-b1e0-27a60827fba0 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:36.799784 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13122bb-46af-4df2-b1e0-27a60827fba0 None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:36.800653 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13122bb-46af-4df2-b1e0-27a60827fba0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:36.801130 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13122bb-46af-4df2-b1e0-27a60827fba0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:36.802773 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13122bb-46af-4df2-b1e0-27a60827fba0 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:36.816130 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 521/1048] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Aug 12 01:18:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:18:36.821955 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13122bb-46af-4df2-b1e0-27a60827fba0 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:36.837089 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2095e820-83c1-49c9-9f93-b4450d340db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:36.838079 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095e820-83c1-49c9-9f93-b4450d340db8 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:36.838378 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095e820-83c1-49c9-9f93-b4450d340db8 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:36.838643 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095e820-83c1-49c9-9f93-b4450d340db8 None admin] PATH_INFO: `/v3/users/c2ca22c53b054906888bff69ac4630f5` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:36.852209 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2095e820-83c1-49c9-9f93-b4450d340db8 None admin] RBAC: Authorizing `identity:get_user(user_id=c2ca22c53b054906888bff69ac4630f5)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:36.853688 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2095e820-83c1-49c9-9f93-b4450d340db8 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:36.855366 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 528/1049] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 01:18:36 2022] GET /identity/v3/users/c2ca22c53b054906888bff69ac4630f5 => generated 285 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:18:36.856518 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a53a9ea-cff5-4164-ad84-5561d753a0e8 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:36.856796 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a53a9ea-cff5-4164-ad84-5561d753a0e8 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:36.857061 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a53a9ea-cff5-4164-ad84-5561d753a0e8 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:36.862629 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 529/1050] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:18:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:18:36.862629 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a53a9ea-cff5-4164-ad84-5561d753a0e8 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:36.921335 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13122bb-46af-4df2-b1e0-27a60827fba0 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:36.949758 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:36.957006 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eac90b-b251-47eb-bbfd-9b9c40aa5a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:36.957597 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eac90b-b251-47eb-bbfd-9b9c40aa5a1a None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:36.957873 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eac90b-b251-47eb-bbfd-9b9c40aa5a1a None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:36.958169 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eac90b-b251-47eb-bbfd-9b9c40aa5a1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:36.958894 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eac90b-b251-47eb-bbfd-9b9c40aa5a1a None admin] RBAC: Adding query filter params (role.id=90822fc7f8cf4ded8bccf87f3036eb1a, scope.project.id=fa91143910a74c6b896ced5b51f9966a, user.id=fcd5e95467b44175be2478c2c7c89926) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:36.959196 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eac90b-b251-47eb-bbfd-9b9c40aa5a1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:36.960613 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eac90b-b251-47eb-bbfd-9b9c40aa5a1a None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:36.962964 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a53a9ea-cff5-4164-ad84-5561d753a0e8 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:36.966954 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 522/1051] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 01:18:36 2022] GET /identity/v3/role_assignments?user.id=fcd5e95467b44175be2478c2c7c89926&scope.project.id=fa91143910a74c6b896ced5b51f9966a&role.id=90822fc7f8cf4ded8bccf87f3036eb1a => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:18:36.968177 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d85a88-c048-49ee-ac14-69931677f3b5 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:36.968456 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d85a88-c048-49ee-ac14-69931677f3b5 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:36.968716 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d85a88-c048-49ee-ac14-69931677f3b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:36.981487 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:36.993005 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-62d85a88-c048-49ee-ac14-69931677f3b5 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:18:36.994547 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-62d85a88-c048-49ee-ac14-69931677f3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:18:37.004685 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00730501-865f-495d-b62b-8610cb2b51a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:37.005313 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00730501-865f-495d-b62b-8610cb2b51a4 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:37.005592 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00730501-865f-495d-b62b-8610cb2b51a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:37.005864 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00730501-865f-495d-b62b-8610cb2b51a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:37.078347 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 523/1052] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:18:36 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 01:18:37.082216 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00730501-865f-495d-b62b-8610cb2b51a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:37.083817 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00730501-865f-495d-b62b-8610cb2b51a4 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:37.184881 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 530/1053] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 01:18:36 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 01:18:37.190866 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d85a88-c048-49ee-ac14-69931677f3b5 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:37.289945 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d85a88-c048-49ee-ac14-69931677f3b5 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:37.313476 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:37.325289 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae2a81b-5cd7-4fc1-9b6f-4a0a76bdebc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:37.325913 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae2a81b-5cd7-4fc1-9b6f-4a0a76bdebc4 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:37.326202 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae2a81b-5cd7-4fc1-9b6f-4a0a76bdebc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:37.326471 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae2a81b-5cd7-4fc1-9b6f-4a0a76bdebc4 None admin] PATH_INFO: `/v3/projects/6b5be7a0d45a4ab5a86e7356f266cbf5` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:37.327552 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae2a81b-5cd7-4fc1-9b6f-4a0a76bdebc4 None admin] RBAC: Authorizing `identity:get_project(project_id=6b5be7a0d45a4ab5a86e7356f266cbf5)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:37.329084 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae2a81b-5cd7-4fc1-9b6f-4a0a76bdebc4 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:37.335848 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 524/1054] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 01:18:37 2022] GET /identity/v3/projects/6b5be7a0d45a4ab5a86e7356f266cbf5 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:37.337034 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00730501-865f-495d-b62b-8610cb2b51a4 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:37.340490 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae2a81b-5cd7-4fc1-9b6f-4a0a76bdebc4 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:37.355674 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:37.447990 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae2a81b-5cd7-4fc1-9b6f-4a0a76bdebc4 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:37.457887 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00730501-865f-495d-b62b-8610cb2b51a4 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:37.486789 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ee7ec8-f778-4868-89a1-acb4feb3b1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:37.487376 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee7ec8-f778-4868-89a1-acb4feb3b1ad None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:37.487716 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee7ec8-f778-4868-89a1-acb4feb3b1ad None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:37.487982 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee7ec8-f778-4868-89a1-acb4feb3b1ad None admin] PATH_INFO: `/v3/services/image` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:37.488574 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ee7ec8-f778-4868-89a1-acb4feb3b1ad None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:37.489940 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ee7ec8-f778-4868-89a1-acb4feb3b1ad None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:37.498380 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4697a83c-55ef-4e43-9f56-cf0a5383a5f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:37.498994 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4697a83c-55ef-4e43-9f56-cf0a5383a5f4 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:37.499268 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4697a83c-55ef-4e43-9f56-cf0a5383a5f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:37.499471 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-02ee7ec8-f778-4868-89a1-acb4feb3b1ad None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 12 01:18:37.499471 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:37.499471 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 01:18:37.499471 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 01:18:37.499471 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 01:18:37.499471 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 01:18:37.499471 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 01:18:37.499471 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 01:18:37.499471 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 12 01:18:37.499471 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:18:37.499471 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 01:18:37.499471 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:18:37.499471 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:37.499471 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:37.499471 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:37.499471 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:37.499471 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:37.500519 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:37.500519 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:37.500519 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:37.500519 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:37.500519 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:37.500519 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:37.500519 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 01:18:37.500519 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 01:18:37.500519 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 01:18:37.500519 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 01:18:37.500519 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:37.500519 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:37.500519 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:37.500519 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:37.500519 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:37.500519 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:37.501555 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:37.501555 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:37.501555 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:37.501555 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:37.501555 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:37.501555 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:37.501555 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:37.501555 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:37.501555 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:37.501555 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:37.501555 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 01:18:37.501555 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 01:18:37.501555 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 12 01:18:37.501555 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:18:37.502434 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4697a83c-55ef-4e43-9f56-cf0a5383a5f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:37.502434 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4697a83c-55ef-4e43-9f56-cf0a5383a5f4 None admin] RBAC: Adding query filter params (role.id=fb48693810be495fb4b1893a79429b78, scope.project.id=6b5be7a0d45a4ab5a86e7356f266cbf5, user.id=c2ca22c53b054906888bff69ac4630f5) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:37.502434 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4697a83c-55ef-4e43-9f56-cf0a5383a5f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:37.502629 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 525/1055] 10.222.0.26 () {56 vars in 1105 bytes} [Fri Aug 12 01:18:37 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 01:18:37.506675 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ee7ec8-f778-4868-89a1-acb4feb3b1ad None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:37.507010 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4697a83c-55ef-4e43-9f56-cf0a5383a5f4 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:37.512827 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 531/1056] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 01:18:37 2022] GET /identity/v3/role_assignments?user.id=c2ca22c53b054906888bff69ac4630f5&scope.project.id=6b5be7a0d45a4ab5a86e7356f266cbf5&role.id=fb48693810be495fb4b1893a79429b78 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:37.575695 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:37.624965 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ee7ec8-f778-4868-89a1-acb4feb3b1ad None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:37.661498 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b075f0fb-88de-4bf9-8da0-4c8337f1b4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:37.662095 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075f0fb-88de-4bf9-8da0-4c8337f1b4bf None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:37.662400 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075f0fb-88de-4bf9-8da0-4c8337f1b4bf None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:37.662664 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075f0fb-88de-4bf9-8da0-4c8337f1b4bf None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:37.663623 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b075f0fb-88de-4bf9-8da0-4c8337f1b4bf None admin] RBAC: Adding query filter params (name=image) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:37.663918 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b075f0fb-88de-4bf9-8da0-4c8337f1b4bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:37.665278 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b075f0fb-88de-4bf9-8da0-4c8337f1b4bf None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:37.670475 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 526/1057] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:18:37 2022] GET /identity/v3/services?name=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:37.676238 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4697a83c-55ef-4e43-9f56-cf0a5383a5f4 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:37.758346 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:37.779281 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4697a83c-55ef-4e43-9f56-cf0a5383a5f4 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:37.814965 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1befed5-5d9e-4149-b38e-bf77693d2d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:37.815571 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1befed5-5d9e-4149-b38e-bf77693d2d0e None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:37.815851 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1befed5-5d9e-4149-b38e-bf77693d2d0e None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:37.816120 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1befed5-5d9e-4149-b38e-bf77693d2d0e None admin] PATH_INFO: `/v3/services` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:37.816752 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1befed5-5d9e-4149-b38e-bf77693d2d0e None admin] RBAC: Adding query filter params (type=image) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:37.817048 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1befed5-5d9e-4149-b38e-bf77693d2d0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:37.818449 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1befed5-5d9e-4149-b38e-bf77693d2d0e None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:37.823894 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 532/1058] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:18:37 2022] GET /identity/v3/services?type=image => generated 350 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:37.829648 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b075f0fb-88de-4bf9-8da0-4c8337f1b4bf None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:37.932729 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b075f0fb-88de-4bf9-8da0-4c8337f1b4bf None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:37.954836 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:37.970103 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49137bda-7226-4ad2-9bfb-11c965d1e7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:37.970814 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49137bda-7226-4ad2-9bfb-11c965d1e7d6 None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:37.971088 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49137bda-7226-4ad2-9bfb-11c965d1e7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:37.971354 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49137bda-7226-4ad2-9bfb-11c965d1e7d6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:37.972009 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49137bda-7226-4ad2-9bfb-11c965d1e7d6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:37.973411 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49137bda-7226-4ad2-9bfb-11c965d1e7d6 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:37.998147 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 527/1059] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:18:37 2022] POST /identity/v3/endpoints => generated 327 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:18:38.841718 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b4258-1096-450a-97cb-faeec6440441 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:38.842482 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b4258-1096-450a-97cb-faeec6440441 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:38.842482 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b4258-1096-450a-97cb-faeec6440441 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:38.846146 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 533/1060] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:18:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:18:38.849254 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c1fe6-d020-44bb-b1cd-04a87e107ab8 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:38.849658 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c1fe6-d020-44bb-b1cd-04a87e107ab8 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:38.849846 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c1fe6-d020-44bb-b1cd-04a87e107ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:38.869912 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-909c1fe6-d020-44bb-b1cd-04a87e107ab8 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:18:38.871130 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-909c1fe6-d020-44bb-b1cd-04a87e107ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:18:38.950143 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 528/1061] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:18:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 01:18:39.218144 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83b4258-1096-450a-97cb-faeec6440441 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:39.323763 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83b4258-1096-450a-97cb-faeec6440441 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:39.357384 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a8d8ad-734e-4250-97a3-6693f37c77f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:39.358021 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a8d8ad-734e-4250-97a3-6693f37c77f8 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:39.358322 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a8d8ad-734e-4250-97a3-6693f37c77f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:39.358597 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a8d8ad-734e-4250-97a3-6693f37c77f8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:39.369466 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a8d8ad-734e-4250-97a3-6693f37c77f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:18:39.374227 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-e9a8d8ad-734e-4250-97a3-6693f37c77f8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 12 01:18:39.374227 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:39.374227 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:39.374227 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:39.374227 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:39.374227 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:39.374227 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:39.374227 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:39.374227 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:39.374227 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:39.374227 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:39.374227 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:39.374227 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:18:39.374227 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:18:39.374227 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:18:39.374227 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:18:39.375232 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:18:39.375232 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:18:39.375232 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:18:39.375232 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:18:39.375232 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:39.375232 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:39.375232 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:39.375232 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:39.375232 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:39.375232 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:39.375232 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:39.375232 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:39.375232 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:39.375232 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:39.375232 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:39.375232 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:39.376103 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:39.376103 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:39.376103 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:39.376103 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:39.376103 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:18:39.376103 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:18:39.376103 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:18:39.376103 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:18:39.376103 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:18:39.376103 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:18:39.376103 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 12 01:18:39.376103 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:18:39.378444 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 534/1062] 10.222.0.26 () {56 vars in 1120 bytes} [Fri Aug 12 01:18:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:18:39.381539 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c1fe6-d020-44bb-b1cd-04a87e107ab8 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:39.389975 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b1f6cc-8f09-4179-8f2f-604a89ea74f2 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:39.390300 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b1f6cc-8f09-4179-8f2f-604a89ea74f2 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:39.390612 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b1f6cc-8f09-4179-8f2f-604a89ea74f2 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:39.392008 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 535/1063] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:18:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:18:39.397109 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7a59d-8a70-4668-af12-2fe0353fd7cc None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:39.397386 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7a59d-8a70-4668-af12-2fe0353fd7cc None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:39.398032 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7a59d-8a70-4668-af12-2fe0353fd7cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:39.405483 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:39.417351 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-d6c7a59d-8a70-4668-af12-2fe0353fd7cc None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:18:39.418544 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-d6c7a59d-8a70-4668-af12-2fe0353fd7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:18:39.492685 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 536/1064] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:18:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 01:18:39.493041 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c1fe6-d020-44bb-b1cd-04a87e107ab8 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:39.501403 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:39.530735 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dbbb9e-8907-46ea-9ca0-b42b127b36aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:39.531368 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dbbb9e-8907-46ea-9ca0-b42b127b36aa None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:39.531677 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dbbb9e-8907-46ea-9ca0-b42b127b36aa None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:39.531944 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dbbb9e-8907-46ea-9ca0-b42b127b36aa None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:39.532600 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dbbb9e-8907-46ea-9ca0-b42b127b36aa None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:39.532900 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dbbb9e-8907-46ea-9ca0-b42b127b36aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:39.534312 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dbbb9e-8907-46ea-9ca0-b42b127b36aa None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:39.547621 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 529/1065] 10.222.0.26 () {56 vars in 1115 bytes} [Fri Aug 12 01:18:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:39.549228 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c7a59d-8a70-4668-af12-2fe0353fd7cc None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:39.652377 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c7a59d-8a70-4668-af12-2fe0353fd7cc None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:39.687334 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea2a245-f3a2-4cbe-95ec-2e39da353772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:39.687987 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea2a245-f3a2-4cbe-95ec-2e39da353772 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:39.688275 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea2a245-f3a2-4cbe-95ec-2e39da353772 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:39.688608 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea2a245-f3a2-4cbe-95ec-2e39da353772 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:39.690688 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:39.700425 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea2a245-f3a2-4cbe-95ec-2e39da353772 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:39.701858 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea2a245-f3a2-4cbe-95ec-2e39da353772 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:39.716866 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-1ea2a245-f3a2-4cbe-95ec-2e39da353772 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:18:39.716866 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:39.716866 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:39.716866 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:39.716866 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:39.716866 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:39.716866 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:39.716866 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:39.716866 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:39.716866 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:39.716866 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:39.716866 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:39.716866 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 01:18:39.716866 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 01:18:39.716866 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 01:18:39.716866 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 01:18:39.717842 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:39.717842 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:39.717842 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:39.717842 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:39.717842 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:39.717842 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:39.717842 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:39.717842 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:39.717842 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:39.717842 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:39.717842 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:39.717842 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:39.717842 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:39.717842 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:39.717842 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:39.717842 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:39.717842 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 01:18:39.719239 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 01:18:39.719239 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:18:39.719239 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:18:39.722468 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 537/1066] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:18:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:18:39.724065 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dbbb9e-8907-46ea-9ca0-b42b127b36aa None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:39.751261 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea2a245-f3a2-4cbe-95ec-2e39da353772 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:39.841619 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dbbb9e-8907-46ea-9ca0-b42b127b36aa None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:39.856868 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea2a245-f3a2-4cbe-95ec-2e39da353772 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:39.875947 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cfc049-10fc-4916-aefa-336ee6b7c2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:39.876560 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cfc049-10fc-4916-aefa-336ee6b7c2b3 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:39.876841 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cfc049-10fc-4916-aefa-336ee6b7c2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:39.877109 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cfc049-10fc-4916-aefa-336ee6b7c2b3 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:39.877781 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cfc049-10fc-4916-aefa-336ee6b7c2b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:39.878080 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cfc049-10fc-4916-aefa-336ee6b7c2b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:39.879933 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cfc049-10fc-4916-aefa-336ee6b7c2b3 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:39.892396 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 530/1067] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 01:18:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:39.894312 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125eca7e-d089-4af5-b68d-0ccaa219a699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:39.895048 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125eca7e-d089-4af5-b68d-0ccaa219a699 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:39.895386 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125eca7e-d089-4af5-b68d-0ccaa219a699 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:39.895721 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125eca7e-d089-4af5-b68d-0ccaa219a699 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:39.898149 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cfc049-10fc-4916-aefa-336ee6b7c2b3 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:39.907314 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125eca7e-d089-4af5-b68d-0ccaa219a699 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:18:39.912227 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-125eca7e-d089-4af5-b68d-0ccaa219a699 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 01:18:39.912227 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:39.912227 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:39.912227 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:39.912227 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:39.912227 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:39.912227 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:39.912227 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:39.912227 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:39.912227 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:39.912227 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:39.912227 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:39.912227 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:18:39.912227 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:18:39.912227 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:18:39.912227 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:18:39.913490 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:18:39.913490 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:18:39.913490 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:18:39.913490 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:18:39.913490 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:39.913490 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:39.913490 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:39.913490 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:39.913490 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:39.913490 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:39.913490 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:39.913490 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:39.913490 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:39.913490 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:39.913490 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:39.913490 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:39.914833 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:39.914833 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:39.914833 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:39.914833 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:39.914833 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:18:39.914833 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:18:39.914833 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:18:39.914833 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:18:39.914833 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:18:39.914833 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:18:39.914833 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 01:18:39.914833 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:18:39.914833 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 538/1068] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Aug 12 01:18:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 01:18:39.919590 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125eca7e-d089-4af5-b68d-0ccaa219a699 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:39.928075 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:39.967657 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:40.003638 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cfc049-10fc-4916-aefa-336ee6b7c2b3 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:40.020729 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125eca7e-d089-4af5-b68d-0ccaa219a699 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:40.038510 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f665a4b-573f-4513-8128-758b479ce758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:40.039239 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f665a4b-573f-4513-8128-758b479ce758 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:40.039581 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f665a4b-573f-4513-8128-758b479ce758 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:40.039913 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f665a4b-573f-4513-8128-758b479ce758 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:40.047353 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f665a4b-573f-4513-8128-758b479ce758 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:40.048962 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f665a4b-573f-4513-8128-758b479ce758 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:40.053515 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e403b40-0570-4ee9-9fd5-837db1d275f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:40.054127 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e403b40-0570-4ee9-9fd5-837db1d275f1 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:40.054410 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e403b40-0570-4ee9-9fd5-837db1d275f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:40.054674 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e403b40-0570-4ee9-9fd5-837db1d275f1 None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:40.055324 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e403b40-0570-4ee9-9fd5-837db1d275f1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:40.055619 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e403b40-0570-4ee9-9fd5-837db1d275f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:40.056959 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e403b40-0570-4ee9-9fd5-837db1d275f1 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:40.060141 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-0f665a4b-573f-4513-8128-758b479ce758 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 12 01:18:40.060141 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:40.060141 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:40.060141 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:40.060141 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:40.060141 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:40.060141 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:40.060141 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:40.060141 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:40.060141 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:40.060141 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:40.060141 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:40.060141 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 01:18:40.060141 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 01:18:40.060141 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 01:18:40.060141 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 01:18:40.061240 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:40.061240 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:40.061240 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 01:18:40.061240 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 01:18:40.061240 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 01:18:40.061240 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 01:18:40.061240 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:40.061240 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:40.061240 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:40.061240 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:40.061240 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:40.061240 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:40.061240 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:40.061240 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:40.061240 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:40.061240 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:40.061240 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:40.061240 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:40.067211 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:40.067211 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:40.067211 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 01:18:40.067211 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 01:18:40.067211 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 01:18:40.067211 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 01:18:40.067211 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 01:18:40.067211 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 01:18:40.067211 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 12 01:18:40.067211 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:18:40.067211 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 531/1069] 10.222.0.26 () {56 vars in 1093 bytes} [Fri Aug 12 01:18:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:18:40.067211 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0017c95-0e19-406c-a123-5a9317124251 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:40.067211 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0017c95-0e19-406c-a123-5a9317124251 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:40.067938 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0017c95-0e19-406c-a123-5a9317124251 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:40.067938 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 532/1070] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:18:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:18:40.069235 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0017c95-0e19-406c-a123-5a9317124251 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:40.077112 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 539/1071] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 01:18:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:18:40.077112 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa5331-cb88-4ce1-9a35-321c8445df97 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:40.077112 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa5331-cb88-4ce1-9a35-321c8445df97 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:40.077112 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa5331-cb88-4ce1-9a35-321c8445df97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:40.092307 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-b9fa5331-cb88-4ce1-9a35-321c8445df97 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:18:40.093497 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-b9fa5331-cb88-4ce1-9a35-321c8445df97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:18:40.152367 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:40.158174 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 540/1072] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:18:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 01:18:40.158842 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fa5331-cb88-4ce1-9a35-321c8445df97 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:40.170163 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0017c95-0e19-406c-a123-5a9317124251 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:40.202993 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:40.206484 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837560d9-72dc-453b-9264-a0d7d5474796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:40.207116 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837560d9-72dc-453b-9264-a0d7d5474796 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:40.207365 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837560d9-72dc-453b-9264-a0d7d5474796 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:40.207632 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837560d9-72dc-453b-9264-a0d7d5474796 None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:40.208355 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837560d9-72dc-453b-9264-a0d7d5474796 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:40.208656 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837560d9-72dc-453b-9264-a0d7d5474796 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:40.210091 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837560d9-72dc-453b-9264-a0d7d5474796 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:40.227372 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 533/1073] 10.222.0.26 () {56 vars in 1133 bytes} [Fri Aug 12 01:18:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:40.232910 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837560d9-72dc-453b-9264-a0d7d5474796 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:40.273240 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fa5331-cb88-4ce1-9a35-321c8445df97 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:40.307038 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72f312b-10a4-4b65-94c4-a5689d0296f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:40.307663 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f312b-10a4-4b65-94c4-a5689d0296f2 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:40.307941 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f312b-10a4-4b65-94c4-a5689d0296f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:40.308209 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f312b-10a4-4b65-94c4-a5689d0296f2 None admin] PATH_INFO: `/v3/users/c2ca22c53b054906888bff69ac4630f5` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:40.309336 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72f312b-10a4-4b65-94c4-a5689d0296f2 None admin] RBAC: Authorizing `identity:get_user(user_id=c2ca22c53b054906888bff69ac4630f5)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:40.310793 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72f312b-10a4-4b65-94c4-a5689d0296f2 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:40.312407 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 541/1074] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 01:18:40 2022] GET /identity/v3/users/c2ca22c53b054906888bff69ac4630f5 => generated 285 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:40.318779 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72f312b-10a4-4b65-94c4-a5689d0296f2 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:40.344943 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837560d9-72dc-453b-9264-a0d7d5474796 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:40.382731 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf12cc8-7af4-4a78-8790-81227cb51b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:40.383658 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf12cc8-7af4-4a78-8790-81227cb51b0a None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:40.384161 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf12cc8-7af4-4a78-8790-81227cb51b0a None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:40.384752 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf12cc8-7af4-4a78-8790-81227cb51b0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:40.396068 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf12cc8-7af4-4a78-8790-81227cb51b0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:40.397666 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf12cc8-7af4-4a78-8790-81227cb51b0a None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:40.400819 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:40.415431 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72f312b-10a4-4b65-94c4-a5689d0296f2 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:40.415624 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-faf12cc8-7af4-4a78-8790-81227cb51b0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:18:40.415624 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:40.415624 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:40.415624 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:40.415624 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:40.415624 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:40.415624 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:40.415624 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:40.415624 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:40.415624 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:40.415624 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:40.415624 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:40.415624 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 01:18:40.415624 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 01:18:40.415624 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 01:18:40.415624 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 01:18:40.416499 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:40.416499 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:40.416499 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:40.416499 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:40.416499 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:40.416499 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:40.416499 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:40.416499 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:40.416499 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:40.416499 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:40.416499 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:40.416499 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:40.416499 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:40.416499 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:40.416499 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:40.416499 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:40.416499 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 01:18:40.422542 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 01:18:40.422542 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:18:40.422542 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:18:40.422542 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 534/1075] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:18:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 01:18:40.422542 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf12cc8-7af4-4a78-8790-81227cb51b0a None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:40.429431 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:40.456307 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c1035a-fe46-4b4e-8a3b-262af36c01dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:40.456925 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1035a-fe46-4b4e-8a3b-262af36c01dd None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:40.457198 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1035a-fe46-4b4e-8a3b-262af36c01dd None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:40.457462 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1035a-fe46-4b4e-8a3b-262af36c01dd None admin] PATH_INFO: `/v3/projects/6b5be7a0d45a4ab5a86e7356f266cbf5` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:40.458583 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c1035a-fe46-4b4e-8a3b-262af36c01dd None admin] RBAC: Authorizing `identity:get_project(project_id=6b5be7a0d45a4ab5a86e7356f266cbf5)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:40.459988 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c1035a-fe46-4b4e-8a3b-262af36c01dd None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:40.461757 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 542/1076] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 01:18:40 2022] GET /identity/v3/projects/6b5be7a0d45a4ab5a86e7356f266cbf5 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:18:40.462362 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c1035a-fe46-4b4e-8a3b-262af36c01dd None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:40.527013 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf12cc8-7af4-4a78-8790-81227cb51b0a None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:40.561727 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f002768c-74b2-4a3b-bfbd-a4def29881da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:40.562356 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f002768c-74b2-4a3b-bfbd-a4def29881da None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:40.562691 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f002768c-74b2-4a3b-bfbd-a4def29881da None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:40.562965 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f002768c-74b2-4a3b-bfbd-a4def29881da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:40.565764 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c1035a-fe46-4b4e-8a3b-262af36c01dd None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:40.600191 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603fd498-59f4-4df5-88c6-370f22a06e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:40.600803 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603fd498-59f4-4df5-88c6-370f22a06e6b None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:40.601076 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603fd498-59f4-4df5-88c6-370f22a06e6b None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:40.601387 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603fd498-59f4-4df5-88c6-370f22a06e6b None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:40.602019 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603fd498-59f4-4df5-88c6-370f22a06e6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:40.602346 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603fd498-59f4-4df5-88c6-370f22a06e6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:40.603737 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603fd498-59f4-4df5-88c6-370f22a06e6b None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:40.615253 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 543/1077] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 01:18:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:40.616032 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603fd498-59f4-4df5-88c6-370f22a06e6b None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:40.629400 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:40.636261 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f002768c-74b2-4a3b-bfbd-a4def29881da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:40.637703 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f002768c-74b2-4a3b-bfbd-a4def29881da None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:40.652296 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:40.720091 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603fd498-59f4-4df5-88c6-370f22a06e6b None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:40.736604 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 535/1078] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 01:18:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 12 01:18:40.742490 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f002768c-74b2-4a3b-bfbd-a4def29881da None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:40.754074 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215b65ad-8b35-4eb5-95bb-afc14c5fe595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:40.754806 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b65ad-8b35-4eb5-95bb-afc14c5fe595 None admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:40.755075 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b65ad-8b35-4eb5-95bb-afc14c5fe595 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:40.755344 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b65ad-8b35-4eb5-95bb-afc14c5fe595 None admin] PATH_INFO: `/v3/projects/6b5be7a0d45a4ab5a86e7356f266cbf5/users/c2ca22c53b054906888bff69ac4630f5/roles/fb48693810be495fb4b1893a79429b78` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:40.757285 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215b65ad-8b35-4eb5-95bb-afc14c5fe595 None admin] RBAC: Authorizing `identity:create_grant(project_id=6b5be7a0d45a4ab5a86e7356f266cbf5, user_id=c2ca22c53b054906888bff69ac4630f5, role_id=fb48693810be495fb4b1893a79429b78)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:40.758748 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215b65ad-8b35-4eb5-95bb-afc14c5fe595 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:40.772659 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 544/1079] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Aug 12 01:18:40 2022] PUT /identity/v3/projects/6b5be7a0d45a4ab5a86e7356f266cbf5/users/c2ca22c53b054906888bff69ac4630f5/roles/fb48693810be495fb4b1893a79429b78 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:18:40.778788 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215b65ad-8b35-4eb5-95bb-afc14c5fe595 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:40.853991 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:40.865210 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f002768c-74b2-4a3b-bfbd-a4def29881da None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:40.885368 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:40.894372 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215b65ad-8b35-4eb5-95bb-afc14c5fe595 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:40.907153 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93011fa3-5724-4e47-8355-ba8443660c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:40.907921 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93011fa3-5724-4e47-8355-ba8443660c19 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:40.908191 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93011fa3-5724-4e47-8355-ba8443660c19 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:40.908456 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93011fa3-5724-4e47-8355-ba8443660c19 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:40.916441 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93011fa3-5724-4e47-8355-ba8443660c19 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:40.918145 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93011fa3-5724-4e47-8355-ba8443660c19 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:40.930408 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-93011fa3-5724-4e47-8355-ba8443660c19 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 01:18:40.930408 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:40.930408 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:40.930408 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:40.930408 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:40.930408 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:40.930408 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:40.930408 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:40.930408 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:40.930408 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:40.930408 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:40.930408 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:40.930408 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 01:18:40.930408 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 01:18:40.930408 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 01:18:40.931440 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 01:18:40.931440 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:40.931440 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:40.931440 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:40.931440 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:40.931440 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:40.931440 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:40.931440 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:40.931440 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:40.931440 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:40.931440 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:40.931440 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:40.931440 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:40.931440 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:40.931440 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:40.931440 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:40.931440 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:40.933684 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 01:18:40.933684 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 01:18:40.933684 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 01:18:40.933684 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 01:18:40.933684 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 01:18:40.933684 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 01:18:40.933684 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 01:18:40.933684 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:18:40.933684 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 536/1080] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 01:18:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:18:40.938304 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d84c0-580f-4329-bb07-6abd94475405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:40.938479 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93011fa3-5724-4e47-8355-ba8443660c19 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:40.938563 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d84c0-580f-4329-bb07-6abd94475405 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:40.938563 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d84c0-580f-4329-bb07-6abd94475405 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:40.938823 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d84c0-580f-4329-bb07-6abd94475405 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:40.951827 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9d84c0-580f-4329-bb07-6abd94475405 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:40.953434 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9d84c0-580f-4329-bb07-6abd94475405 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:40.967821 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-dc9d84c0-580f-4329-bb07-6abd94475405 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:18:40.967821 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:40.967821 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:40.967821 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:40.967821 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:40.967821 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:40.967821 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:40.967821 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:40.967821 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:40.967821 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:40.967821 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:40.967821 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:40.967821 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 01:18:40.967821 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 01:18:40.967821 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 01:18:40.967821 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 01:18:40.968959 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:40.968959 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:40.968959 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:40.968959 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:40.968959 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:40.968959 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:40.968959 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:40.968959 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:40.968959 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:40.968959 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:40.968959 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:40.968959 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:40.968959 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:40.968959 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:40.968959 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:40.968959 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:40.968959 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 01:18:40.970049 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 01:18:40.970049 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:18:40.970049 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:18:40.970049 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 545/1081] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:18:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:18:40.974881 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d84c0-580f-4329-bb07-6abd94475405 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:41.045488 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93011fa3-5724-4e47-8355-ba8443660c19 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:41.077992 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d84c0-580f-4329-bb07-6abd94475405 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:41.080735 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fda7bd-025b-4edc-a49b-1e5adba140ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:41.081374 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fda7bd-025b-4edc-a49b-1e5adba140ec None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:41.081647 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fda7bd-025b-4edc-a49b-1e5adba140ec None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:41.081911 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fda7bd-025b-4edc-a49b-1e5adba140ec None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:41.082648 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fda7bd-025b-4edc-a49b-1e5adba140ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:41.082951 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fda7bd-025b-4edc-a49b-1e5adba140ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:41.084375 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fda7bd-025b-4edc-a49b-1e5adba140ec None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:41.101783 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 537/1082] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Aug 12 01:18:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:41.102833 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fda7bd-025b-4edc-a49b-1e5adba140ec None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:41.117071 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa56005-4a7d-4d32-95a4-7aa1cd72a4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:41.117679 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa56005-4a7d-4d32-95a4-7aa1cd72a4ab None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:41.117973 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa56005-4a7d-4d32-95a4-7aa1cd72a4ab None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:41.118247 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa56005-4a7d-4d32-95a4-7aa1cd72a4ab None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:41.118887 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa56005-4a7d-4d32-95a4-7aa1cd72a4ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:41.119188 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa56005-4a7d-4d32-95a4-7aa1cd72a4ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:41.119539 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:41.120550 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa56005-4a7d-4d32-95a4-7aa1cd72a4ab None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:41.138631 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 546/1083] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 01:18:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:18:41.214343 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fda7bd-025b-4edc-a49b-1e5adba140ec None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:41.251146 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5f57b5-f13b-49b6-a8d9-080117b16388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:41.251818 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f57b5-f13b-49b6-a8d9-080117b16388 None admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:41.252088 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f57b5-f13b-49b6-a8d9-080117b16388 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:41.252359 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f57b5-f13b-49b6-a8d9-080117b16388 None admin] PATH_INFO: `/v3/projects/fa91143910a74c6b896ced5b51f9966a/users/fcd5e95467b44175be2478c2c7c89926/roles/90822fc7f8cf4ded8bccf87f3036eb1a` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:41.254632 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5f57b5-f13b-49b6-a8d9-080117b16388 None admin] RBAC: Authorizing `identity:create_grant(project_id=fa91143910a74c6b896ced5b51f9966a, user_id=fcd5e95467b44175be2478c2c7c89926, role_id=90822fc7f8cf4ded8bccf87f3036eb1a)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:41.256082 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5f57b5-f13b-49b6-a8d9-080117b16388 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:41.270880 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 538/1084] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Aug 12 01:18:41 2022] PUT /identity/v3/projects/fa91143910a74c6b896ced5b51f9966a/users/fcd5e95467b44175be2478c2c7c89926/roles/90822fc7f8cf4ded8bccf87f3036eb1a => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 01:18:42.657686 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc9592-b30d-4944-8d9e-b2f303751f9e None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:42.658287 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc9592-b30d-4944-8d9e-b2f303751f9e None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:42.658287 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc9592-b30d-4944-8d9e-b2f303751f9e None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:42.659583 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 547/1085] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:18:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:18:42.665421 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9f09d-d91a-4e49-b68e-5e6760e4ced1 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:42.665858 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9f09d-d91a-4e49-b68e-5e6760e4ced1 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:42.665968 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9f09d-d91a-4e49-b68e-5e6760e4ced1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:42.684716 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-3fb9f09d-d91a-4e49-b68e-5e6760e4ced1 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:18:42.685884 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-3fb9f09d-d91a-4e49-b68e-5e6760e4ced1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:18:42.757124 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 539/1086] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:18:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 01:18:43.021455 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fc9592-b30d-4944-8d9e-b2f303751f9e None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:43.030638 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:43.126706 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fc9592-b30d-4944-8d9e-b2f303751f9e None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:43.161163 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c30f6a-969c-461a-98ea-e8880ef50bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:43.161784 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c30f6a-969c-461a-98ea-e8880ef50bb4 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:43.162054 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c30f6a-969c-461a-98ea-e8880ef50bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:43.162345 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c30f6a-969c-461a-98ea-e8880ef50bb4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:43.173631 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c30f6a-969c-461a-98ea-e8880ef50bb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:18:43.178203 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-85c30f6a-969c-461a-98ea-e8880ef50bb4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 01:18:43.178203 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:43.178203 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:43.178203 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:43.178203 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:43.178203 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:43.178203 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:43.178203 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:43.178203 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:43.178203 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:43.178203 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:43.178203 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:43.178203 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:18:43.178203 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:18:43.178203 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:18:43.178203 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:18:43.179147 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:18:43.179147 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:18:43.179147 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:18:43.179147 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:18:43.179147 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:43.179147 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:43.179147 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:43.179147 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:43.179147 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:43.179147 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:43.179147 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:43.179147 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:43.179147 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:43.179147 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:43.179147 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:43.179147 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:43.179990 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:43.179990 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:43.179990 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:43.179990 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:43.179990 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:18:43.179990 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:18:43.179990 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:18:43.179990 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:18:43.179990 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:18:43.179990 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:18:43.179990 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 01:18:43.179990 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:18:43.179990 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 548/1087] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Aug 12 01:18:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:18:43.184111 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295370ca-5de2-41d8-b90c-3f32321e53b8 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:43.184446 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295370ca-5de2-41d8-b90c-3f32321e53b8 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:43.184806 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295370ca-5de2-41d8-b90c-3f32321e53b8 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:43.185387 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c30f6a-969c-461a-98ea-e8880ef50bb4 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:43.186142 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 540/1088] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:18:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:18:43.191521 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b711aeb-b270-49ba-945e-b36d0dee4af1 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:43.191803 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b711aeb-b270-49ba-945e-b36d0dee4af1 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:43.192070 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b711aeb-b270-49ba-945e-b36d0dee4af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:43.199541 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:43.212051 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-2b711aeb-b270-49ba-945e-b36d0dee4af1 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:18:43.213246 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2b711aeb-b270-49ba-945e-b36d0dee4af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:18:43.251298 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:43.279834 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 541/1089] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:18:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 01:18:43.285222 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c30f6a-969c-461a-98ea-e8880ef50bb4 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:43.318211 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef7309f-8b2b-4d8d-a869-5331e3b74148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:43.318805 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef7309f-8b2b-4d8d-a869-5331e3b74148 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:43.319077 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef7309f-8b2b-4d8d-a869-5331e3b74148 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:43.319342 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef7309f-8b2b-4d8d-a869-5331e3b74148 None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:43.319993 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef7309f-8b2b-4d8d-a869-5331e3b74148 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:43.320289 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef7309f-8b2b-4d8d-a869-5331e3b74148 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:43.321630 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef7309f-8b2b-4d8d-a869-5331e3b74148 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:43.329414 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 549/1090] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 01:18:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:43.335435 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b711aeb-b270-49ba-945e-b36d0dee4af1 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:43.434149 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b711aeb-b270-49ba-945e-b36d0dee4af1 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:43.468215 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8f41e9-5ad5-4fa3-b161-f18bae90a5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:43.468878 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f41e9-5ad5-4fa3-b161-f18bae90a5ec None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:43.469147 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f41e9-5ad5-4fa3-b161-f18bae90a5ec None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:43.469411 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f41e9-5ad5-4fa3-b161-f18bae90a5ec None admin] PATH_INFO: `/v3/users/c2ca22c53b054906888bff69ac4630f5` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:43.470555 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8f41e9-5ad5-4fa3-b161-f18bae90a5ec None admin] RBAC: Authorizing `identity:get_user(user_id=c2ca22c53b054906888bff69ac4630f5)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:43.471983 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8f41e9-5ad5-4fa3-b161-f18bae90a5ec None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:43.473528 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 542/1091] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 01:18:43 2022] GET /identity/v3/users/c2ca22c53b054906888bff69ac4630f5 => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:43.479539 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef7309f-8b2b-4d8d-a869-5331e3b74148 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:43.542841 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8f41e9-5ad5-4fa3-b161-f18bae90a5ec None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:43.545754 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:43.582861 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef7309f-8b2b-4d8d-a869-5331e3b74148 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:43.607962 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:43.616273 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a308c6-b203-4159-978a-66d85e636a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:43.616875 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a308c6-b203-4159-978a-66d85e636a2d None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:43.617151 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a308c6-b203-4159-978a-66d85e636a2d None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:43.617417 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a308c6-b203-4159-978a-66d85e636a2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:43.648170 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8f41e9-5ad5-4fa3-b161-f18bae90a5ec None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:43.682993 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0936b0ed-64f3-45d6-9284-b3ec57cfe989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:43.683612 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0936b0ed-64f3-45d6-9284-b3ec57cfe989 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:43.683871 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0936b0ed-64f3-45d6-9284-b3ec57cfe989 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:43.684134 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0936b0ed-64f3-45d6-9284-b3ec57cfe989 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:43.684836 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a308c6-b203-4159-978a-66d85e636a2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:43.686323 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a308c6-b203-4159-978a-66d85e636a2d None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:43.695686 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0936b0ed-64f3-45d6-9284-b3ec57cfe989 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:18:43.700256 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-0936b0ed-64f3-45d6-9284-b3ec57cfe989 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 12 01:18:43.700256 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:43.700256 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:43.700256 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:43.700256 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:43.700256 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:43.700256 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:43.700256 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:43.700256 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:43.700256 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:43.700256 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:43.700256 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:43.700256 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:18:43.700256 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:18:43.700256 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:18:43.700256 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:18:43.701241 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:18:43.701241 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:18:43.701241 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:18:43.701241 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:18:43.701241 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:43.701241 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:43.701241 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:43.701241 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:43.701241 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:43.701241 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:43.701241 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:43.701241 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:43.701241 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:43.701241 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:43.701241 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:43.701241 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:43.702069 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:43.702069 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:43.702069 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:43.702069 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:43.702069 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:18:43.702069 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:18:43.702069 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:18:43.702069 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:18:43.702069 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:18:43.702069 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:18:43.702069 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 12 01:18:43.702069 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:18:43.702069 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 543/1092] 10.222.0.26 () {56 vars in 1120 bytes} [Fri Aug 12 01:18:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:18:43.707581 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0936b0ed-64f3-45d6-9284-b3ec57cfe989 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:43.768546 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:43.795253 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 550/1093] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 01:18:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 01:18:43.796189 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a308c6-b203-4159-978a-66d85e636a2d None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:43.808933 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0936b0ed-64f3-45d6-9284-b3ec57cfe989 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:43.822133 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:43.842638 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaeb4a3-7964-4387-a1de-5127c3ea5cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:43.843223 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaeb4a3-7964-4387-a1de-5127c3ea5cc7 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:43.843542 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaeb4a3-7964-4387-a1de-5127c3ea5cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:43.843813 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaeb4a3-7964-4387-a1de-5127c3ea5cc7 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:43.844470 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaeb4a3-7964-4387-a1de-5127c3ea5cc7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:43.844771 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaeb4a3-7964-4387-a1de-5127c3ea5cc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:43.846139 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaeb4a3-7964-4387-a1de-5127c3ea5cc7 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:43.858553 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 544/1094] 10.222.0.26 () {56 vars in 1115 bytes} [Fri Aug 12 01:18:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:43.859625 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaeb4a3-7964-4387-a1de-5127c3ea5cc7 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:43.895355 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a308c6-b203-4159-978a-66d85e636a2d None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:43.930357 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d7ca86-73d7-43c4-af30-c28d0e14cf1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:43.931034 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d7ca86-73d7-43c4-af30-c28d0e14cf1f None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:43.931306 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d7ca86-73d7-43c4-af30-c28d0e14cf1f None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:43.931625 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d7ca86-73d7-43c4-af30-c28d0e14cf1f None admin] PATH_INFO: `/v3/projects/6b5be7a0d45a4ab5a86e7356f266cbf5` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:43.932750 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d7ca86-73d7-43c4-af30-c28d0e14cf1f None admin] RBAC: Authorizing `identity:get_project(project_id=6b5be7a0d45a4ab5a86e7356f266cbf5)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:43.934200 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d7ca86-73d7-43c4-af30-c28d0e14cf1f None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:43.936019 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 551/1095] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 01:18:43 2022] GET /identity/v3/projects/6b5be7a0d45a4ab5a86e7356f266cbf5 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:18:43.942720 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d7ca86-73d7-43c4-af30-c28d0e14cf1f None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:43.965152 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaeb4a3-7964-4387-a1de-5127c3ea5cc7 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:43.988618 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:43.999177 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf18275a-9923-4b89-8a4b-9dfb1fb5a04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:43.999961 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18275a-9923-4b89-8a4b-9dfb1fb5a04c None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:44.000428 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18275a-9923-4b89-8a4b-9dfb1fb5a04c None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:44.000780 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18275a-9923-4b89-8a4b-9dfb1fb5a04c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:44.012226 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf18275a-9923-4b89-8a4b-9dfb1fb5a04c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:44.013665 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf18275a-9923-4b89-8a4b-9dfb1fb5a04c None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:44.028606 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-cf18275a-9923-4b89-8a4b-9dfb1fb5a04c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:18:44.028606 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:44.028606 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:44.028606 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:44.028606 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:44.028606 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:44.028606 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:44.028606 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:44.028606 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:44.028606 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:44.028606 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:44.028606 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:44.028606 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 01:18:44.028606 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 01:18:44.028606 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 01:18:44.028606 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 01:18:44.029606 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:44.029606 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:44.029606 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:44.029606 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:44.029606 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:44.029606 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:44.029606 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:44.029606 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:44.029606 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:44.029606 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:44.029606 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:44.029606 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:44.029606 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:44.029606 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:44.029606 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:44.029606 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:44.029606 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 01:18:44.030526 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 01:18:44.030526 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:18:44.030526 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:18:44.034485 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 545/1096] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:18:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:18:44.036371 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf18275a-9923-4b89-8a4b-9dfb1fb5a04c None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:44.041452 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:44.048773 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d7ca86-73d7-43c4-af30-c28d0e14cf1f None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:44.083337 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dfb9af-cc98-41c1-a8ee-62c71682f4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:44.084181 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dfb9af-cc98-41c1-a8ee-62c71682f4f5 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:44.084454 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dfb9af-cc98-41c1-a8ee-62c71682f4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:44.084727 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dfb9af-cc98-41c1-a8ee-62c71682f4f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:44.085473 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dfb9af-cc98-41c1-a8ee-62c71682f4f5 None admin] RBAC: Adding query filter params (role.id=fb48693810be495fb4b1893a79429b78, scope.project.id=6b5be7a0d45a4ab5a86e7356f266cbf5, user.id=c2ca22c53b054906888bff69ac4630f5) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:44.085762 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dfb9af-cc98-41c1-a8ee-62c71682f4f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:44.087248 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dfb9af-cc98-41c1-a8ee-62c71682f4f5 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:44.092908 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 552/1097] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 01:18:43 2022] GET /identity/v3/role_assignments?user.id=c2ca22c53b054906888bff69ac4630f5&scope.project.id=6b5be7a0d45a4ab5a86e7356f266cbf5&role.id=fb48693810be495fb4b1893a79429b78 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:18:44.147357 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf18275a-9923-4b89-8a4b-9dfb1fb5a04c None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:44.185540 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335e8610-caeb-48f7-ac2f-63ccc16a3dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:44.186213 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e8610-caeb-48f7-ac2f-63ccc16a3dd0 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:44.186488 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e8610-caeb-48f7-ac2f-63ccc16a3dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:44.186751 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e8610-caeb-48f7-ac2f-63ccc16a3dd0 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:44.187600 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335e8610-caeb-48f7-ac2f-63ccc16a3dd0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:44.187897 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335e8610-caeb-48f7-ac2f-63ccc16a3dd0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:44.189276 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335e8610-caeb-48f7-ac2f-63ccc16a3dd0 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:44.203010 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 546/1098] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 01:18:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:18:44.209027 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dfb9af-cc98-41c1-a8ee-62c71682f4f5 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:44.323912 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dfb9af-cc98-41c1-a8ee-62c71682f4f5 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:44.360799 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6fbe6b-016e-401b-a108-91a863194d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:44.361432 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6fbe6b-016e-401b-a108-91a863194d2c None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:44.361707 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6fbe6b-016e-401b-a108-91a863194d2c None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:44.361977 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6fbe6b-016e-401b-a108-91a863194d2c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:44.369603 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6fbe6b-016e-401b-a108-91a863194d2c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:44.371078 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6fbe6b-016e-401b-a108-91a863194d2c None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:44.382543 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-ca6fbe6b-016e-401b-a108-91a863194d2c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 12 01:18:44.382543 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:44.382543 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:44.382543 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:44.382543 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:44.382543 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:44.382543 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:44.382543 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:44.382543 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:44.382543 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:44.382543 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:44.382543 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:44.382543 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 01:18:44.382543 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 01:18:44.382543 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 01:18:44.382543 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 01:18:44.383496 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:44.383496 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:44.383496 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 01:18:44.383496 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 01:18:44.383496 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 01:18:44.383496 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 01:18:44.383496 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:44.383496 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:44.383496 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:44.383496 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:44.383496 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:44.383496 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:44.383496 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:44.383496 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:44.383496 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:44.383496 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:44.383496 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:44.383496 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:44.384447 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:44.384447 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:44.384447 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 01:18:44.384447 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 01:18:44.384447 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 01:18:44.384447 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 01:18:44.384447 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 01:18:44.384447 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 01:18:44.384447 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 12 01:18:44.384447 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:18:44.384447 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 553/1099] 10.222.0.26 () {56 vars in 1093 bytes} [Fri Aug 12 01:18:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:18:44.389584 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335e8610-caeb-48f7-ac2f-63ccc16a3dd0 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:44.426585 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:44.495047 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335e8610-caeb-48f7-ac2f-63ccc16a3dd0 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:44.530128 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21188335-7c95-46db-a333-80cb867b6571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:44.530755 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21188335-7c95-46db-a333-80cb867b6571 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:44.531231 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21188335-7c95-46db-a333-80cb867b6571 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:44.531899 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21188335-7c95-46db-a333-80cb867b6571 None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:44.532634 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21188335-7c95-46db-a333-80cb867b6571 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:44.532941 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21188335-7c95-46db-a333-80cb867b6571 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:44.534401 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21188335-7c95-46db-a333-80cb867b6571 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:44.552232 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 547/1100] 10.222.0.26 () {56 vars in 1133 bytes} [Fri Aug 12 01:18:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:44.557947 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6fbe6b-016e-401b-a108-91a863194d2c None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:44.583160 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:44.667167 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6fbe6b-016e-401b-a108-91a863194d2c None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:44.702673 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0599b7e-1ad0-442f-bd8d-a89472e67b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:44.703484 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0599b7e-1ad0-442f-bd8d-a89472e67b99 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:44.703572 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0599b7e-1ad0-442f-bd8d-a89472e67b99 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:44.703811 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0599b7e-1ad0-442f-bd8d-a89472e67b99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:44.773273 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0599b7e-1ad0-442f-bd8d-a89472e67b99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:44.774770 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0599b7e-1ad0-442f-bd8d-a89472e67b99 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:44.795583 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:44.874594 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 554/1101] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 01:18:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 01:18:44.880702 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21188335-7c95-46db-a333-80cb867b6571 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:44.979161 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:44.986153 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21188335-7c95-46db-a333-80cb867b6571 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:45.020582 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ff1992-4940-4f5e-892e-1d490de5f7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:45.021212 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff1992-4940-4f5e-892e-1d490de5f7d1 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:45.021489 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff1992-4940-4f5e-892e-1d490de5f7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:45.021751 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ff1992-4940-4f5e-892e-1d490de5f7d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:45.031951 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ff1992-4940-4f5e-892e-1d490de5f7d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:45.033393 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ff1992-4940-4f5e-892e-1d490de5f7d1 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:45.048162 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-47ff1992-4940-4f5e-892e-1d490de5f7d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:18:45.048162 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:45.048162 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:45.048162 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:45.048162 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:45.048162 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:45.048162 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:45.048162 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:45.048162 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:45.048162 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:45.048162 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:45.048162 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:45.048162 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 01:18:45.048162 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 01:18:45.048162 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 01:18:45.048162 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 01:18:45.049205 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:45.049205 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:45.049205 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:45.049205 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:45.049205 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:45.049205 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:45.049205 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:45.049205 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:45.049205 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:45.049205 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:45.049205 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:45.049205 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:45.049205 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:45.049205 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:45.049205 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:45.049205 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:45.049205 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 01:18:45.050079 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 01:18:45.050079 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:18:45.050079 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:18:45.050079 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 548/1102] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:18:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:18:45.055219 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0599b7e-1ad0-442f-bd8d-a89472e67b99 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:45.159688 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0599b7e-1ad0-442f-bd8d-a89472e67b99 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:45.180932 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:45.195773 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8092afd7-aad8-4f94-b148-ce92d8d0c08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:45.196385 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8092afd7-aad8-4f94-b148-ce92d8d0c08e None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:45.196654 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8092afd7-aad8-4f94-b148-ce92d8d0c08e None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:45.196916 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8092afd7-aad8-4f94-b148-ce92d8d0c08e None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:45.197553 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8092afd7-aad8-4f94-b148-ce92d8d0c08e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:45.197848 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8092afd7-aad8-4f94-b148-ce92d8d0c08e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:45.199264 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8092afd7-aad8-4f94-b148-ce92d8d0c08e None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:45.212657 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 555/1103] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 01:18:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:45.218524 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ff1992-4940-4f5e-892e-1d490de5f7d1 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:45.319697 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ff1992-4940-4f5e-892e-1d490de5f7d1 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:45.354203 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c83cbd2-269a-46bc-a344-811bcda249ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:45.354797 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c83cbd2-269a-46bc-a344-811bcda249ef None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:45.355080 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c83cbd2-269a-46bc-a344-811bcda249ef None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:45.355339 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c83cbd2-269a-46bc-a344-811bcda249ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:45.361866 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c83cbd2-269a-46bc-a344-811bcda249ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:45.363314 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c83cbd2-269a-46bc-a344-811bcda249ef None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:45.373950 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-4c83cbd2-269a-46bc-a344-811bcda249ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 01:18:45.373950 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:18:45.373950 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:18:45.373950 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:18:45.373950 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:18:45.373950 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:18:45.373950 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:18:45.373950 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:18:45.373950 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:18:45.373950 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:18:45.373950 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:18:45.373950 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:18:45.373950 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 01:18:45.373950 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 01:18:45.373950 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 01:18:45.374971 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 01:18:45.374971 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:18:45.374971 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:18:45.374971 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:18:45.374971 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:18:45.374971 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:18:45.374971 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:18:45.374971 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:18:45.374971 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:18:45.374971 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:18:45.374971 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:18:45.374971 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:18:45.374971 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:18:45.374971 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:18:45.374971 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:18:45.374971 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:18:45.374971 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:18:45.375870 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 01:18:45.375870 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 01:18:45.375870 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 01:18:45.375870 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 01:18:45.375870 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 01:18:45.375870 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 01:18:45.375870 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 01:18:45.375870 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:18:45.375870 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 549/1104] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 01:18:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:18:45.381271 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8092afd7-aad8-4f94-b148-ce92d8d0c08e None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:45.485084 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8092afd7-aad8-4f94-b148-ce92d8d0c08e None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:45.519668 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46871c2e-4178-4710-8d27-019b7e234945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:45.520278 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46871c2e-4178-4710-8d27-019b7e234945 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:45.520557 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46871c2e-4178-4710-8d27-019b7e234945 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:45.520825 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46871c2e-4178-4710-8d27-019b7e234945 None admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:45.521518 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46871c2e-4178-4710-8d27-019b7e234945 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:45.521810 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46871c2e-4178-4710-8d27-019b7e234945 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:45.523264 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46871c2e-4178-4710-8d27-019b7e234945 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:45.535603 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 556/1105] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Aug 12 01:18:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:45.542046 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c83cbd2-269a-46bc-a344-811bcda249ef None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:45.551448 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:45.643901 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c83cbd2-269a-46bc-a344-811bcda249ef None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:45.680097 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433a1804-162f-4a0b-9061-d312c7346373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:45.680690 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a1804-162f-4a0b-9061-d312c7346373 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:45.680964 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a1804-162f-4a0b-9061-d312c7346373 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:45.681229 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a1804-162f-4a0b-9061-d312c7346373 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:45.681945 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433a1804-162f-4a0b-9061-d312c7346373 None admin] RBAC: Adding query filter params (role.id=90822fc7f8cf4ded8bccf87f3036eb1a, scope.project.id=fa91143910a74c6b896ced5b51f9966a, user.id=fcd5e95467b44175be2478c2c7c89926) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:45.682279 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433a1804-162f-4a0b-9061-d312c7346373 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:45.683761 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433a1804-162f-4a0b-9061-d312c7346373 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:45.690050 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 550/1106] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 01:18:45 2022] GET /identity/v3/role_assignments?user.id=fcd5e95467b44175be2478c2c7c89926&scope.project.id=fa91143910a74c6b896ced5b51f9966a&role.id=90822fc7f8cf4ded8bccf87f3036eb1a => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:46.017617 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d9df2-d180-41e1-84c0-bd127e095565 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:46.018362 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d9df2-d180-41e1-84c0-bd127e095565 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:46.018362 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d9df2-d180-41e1-84c0-bd127e095565 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:46.019509 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 557/1107] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:18:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:18:46.025039 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c933ca71-1bfb-4212-a8de-2d4fd3d32f70 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:46.025498 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c933ca71-1bfb-4212-a8de-2d4fd3d32f70 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:46.025581 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c933ca71-1bfb-4212-a8de-2d4fd3d32f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:46.045181 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-c933ca71-1bfb-4212-a8de-2d4fd3d32f70 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:18:46.046623 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c933ca71-1bfb-4212-a8de-2d4fd3d32f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:18:46.111332 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:46.116716 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 551/1108] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:18:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 01:18:46.386602 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956d9df2-d180-41e1-84c0-bd127e095565 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:46.432383 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:46.493949 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956d9df2-d180-41e1-84c0-bd127e095565 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:46.535212 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95338981-9dde-4ce3-85c3-11010ab83230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:46.535842 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95338981-9dde-4ce3-85c3-11010ab83230 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:46.536122 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95338981-9dde-4ce3-85c3-11010ab83230 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:46.536389 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95338981-9dde-4ce3-85c3-11010ab83230 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:46.537475 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95338981-9dde-4ce3-85c3-11010ab83230 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:46.539244 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95338981-9dde-4ce3-85c3-11010ab83230 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:46.540828 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 558/1109] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:18:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:46.546909 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c933ca71-1bfb-4212-a8de-2d4fd3d32f70 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:46.654828 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c933ca71-1bfb-4212-a8de-2d4fd3d32f70 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:46.693336 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6b5772-aa86-483a-a83d-d081eb1bf300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:46.694354 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b5772-aa86-483a-a83d-d081eb1bf300 None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:46.694852 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b5772-aa86-483a-a83d-d081eb1bf300 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:46.695342 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b5772-aa86-483a-a83d-d081eb1bf300 None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:46.696420 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6b5772-aa86-483a-a83d-d081eb1bf300 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:46.698803 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6b5772-aa86-483a-a83d-d081eb1bf300 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:46.724211 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 552/1110] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Aug 12 01:18:46 2022] POST /identity/v3/users => generated 286 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:18:48.646064 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55ed973-69e8-4104-a601-eae770b5e111 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:48.646684 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55ed973-69e8-4104-a601-eae770b5e111 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:48.646684 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55ed973-69e8-4104-a601-eae770b5e111 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:48.648016 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 559/1111] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:18:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:18:48.654574 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0d5e0-fcd2-4255-94f4-f8ea8d7dcb48 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:48.655371 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0d5e0-fcd2-4255-94f4-f8ea8d7dcb48 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:48.655570 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0d5e0-fcd2-4255-94f4-f8ea8d7dcb48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:48.681073 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-c1f0d5e0-fcd2-4255-94f4-f8ea8d7dcb48 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:18:48.682301 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c1f0d5e0-fcd2-4255-94f4-f8ea8d7dcb48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:18:48.736927 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:48.757662 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 553/1112] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:18:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 01:18:49.024181 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55ed973-69e8-4104-a601-eae770b5e111 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:49.134243 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55ed973-69e8-4104-a601-eae770b5e111 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:49.143739 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:49.172645 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee82d3-c711-494e-a050-0951d3538e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:49.173376 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee82d3-c711-494e-a050-0951d3538e4c None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:49.173754 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee82d3-c711-494e-a050-0951d3538e4c None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:49.174077 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee82d3-c711-494e-a050-0951d3538e4c None admin] PATH_INFO: `/v3/roles/bab2af60c26640acbd0c4db2f9796cfb` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:49.175845 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ee82d3-c711-494e-a050-0951d3538e4c None admin] RBAC: Authorizing `identity:get_role(role_id=bab2af60c26640acbd0c4db2f9796cfb)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:49.177514 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ee82d3-c711-494e-a050-0951d3538e4c None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:49.179170 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 560/1113] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 01:18:49 2022] GET /identity/v3/roles/bab2af60c26640acbd0c4db2f9796cfb => generated 223 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:49.185998 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f0d5e0-fcd2-4255-94f4-f8ea8d7dcb48 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:49.290711 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f0d5e0-fcd2-4255-94f4-f8ea8d7dcb48 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:49.325344 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f737eaf-c714-41a3-ad10-edfd5bc207e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:49.325964 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f737eaf-c714-41a3-ad10-edfd5bc207e2 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:49.326264 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f737eaf-c714-41a3-ad10-edfd5bc207e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:49.326526 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f737eaf-c714-41a3-ad10-edfd5bc207e2 None admin] PATH_INFO: `/v3/users/2108ad92d2e3438b9bedc1dde2bef10f` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:49.341190 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f737eaf-c714-41a3-ad10-edfd5bc207e2 None admin] RBAC: Authorizing `identity:get_user(user_id=2108ad92d2e3438b9bedc1dde2bef10f)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:49.342664 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f737eaf-c714-41a3-ad10-edfd5bc207e2 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:49.344270 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 554/1114] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 01:18:49 2022] GET /identity/v3/users/2108ad92d2e3438b9bedc1dde2bef10f => generated 286 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:49.353476 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee82d3-c711-494e-a050-0951d3538e4c None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:49.460563 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee82d3-c711-494e-a050-0951d3538e4c None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:49.499342 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb72fb-055e-47c8-a102-a7bff1693185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:49.499973 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb72fb-055e-47c8-a102-a7bff1693185 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:49.500262 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb72fb-055e-47c8-a102-a7bff1693185 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:49.500526 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb72fb-055e-47c8-a102-a7bff1693185 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:49.552388 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:49.580845 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cb72fb-055e-47c8-a102-a7bff1693185 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:49.582342 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cb72fb-055e-47c8-a102-a7bff1693185 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:49.681070 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 561/1115] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 01:18:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 01:18:49.687563 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f737eaf-c714-41a3-ad10-edfd5bc207e2 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:49.734509 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:49.791013 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f737eaf-c714-41a3-ad10-edfd5bc207e2 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:49.825333 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97c631d-6ab3-4e3d-b871-5b83ccd49a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:49.825929 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c631d-6ab3-4e3d-b871-5b83ccd49a31 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:49.826231 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c631d-6ab3-4e3d-b871-5b83ccd49a31 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:49.826498 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c631d-6ab3-4e3d-b871-5b83ccd49a31 None admin] PATH_INFO: `/v3/projects/6b5be7a0d45a4ab5a86e7356f266cbf5` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:49.827655 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97c631d-6ab3-4e3d-b871-5b83ccd49a31 None admin] RBAC: Authorizing `identity:get_project(project_id=6b5be7a0d45a4ab5a86e7356f266cbf5)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:49.829080 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97c631d-6ab3-4e3d-b871-5b83ccd49a31 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:49.830724 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 555/1116] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 01:18:49 2022] GET /identity/v3/projects/6b5be7a0d45a4ab5a86e7356f266cbf5 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:49.837102 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb72fb-055e-47c8-a102-a7bff1693185 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:49.919284 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:49.946306 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb72fb-055e-47c8-a102-a7bff1693185 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:49.986270 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca7dc08-1651-4bc3-8a9b-62da67f6bdd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:49.986883 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca7dc08-1651-4bc3-8a9b-62da67f6bdd4 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:49.987153 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca7dc08-1651-4bc3-8a9b-62da67f6bdd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:49.987417 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca7dc08-1651-4bc3-8a9b-62da67f6bdd4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:49.988128 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca7dc08-1651-4bc3-8a9b-62da67f6bdd4 None admin] RBAC: Adding query filter params (role.id=bab2af60c26640acbd0c4db2f9796cfb, scope.project.id=6b5be7a0d45a4ab5a86e7356f266cbf5, user.id=2108ad92d2e3438b9bedc1dde2bef10f) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:49.988427 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca7dc08-1651-4bc3-8a9b-62da67f6bdd4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:49.989865 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca7dc08-1651-4bc3-8a9b-62da67f6bdd4 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:49.995924 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 562/1117] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 01:18:49 2022] GET /identity/v3/role_assignments?user.id=2108ad92d2e3438b9bedc1dde2bef10f&scope.project.id=6b5be7a0d45a4ab5a86e7356f266cbf5&role.id=bab2af60c26640acbd0c4db2f9796cfb => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:51.834315 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61180612-5a2d-4c39-ae7d-34989e0c2478 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:51.835132 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61180612-5a2d-4c39-ae7d-34989e0c2478 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:51.835132 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61180612-5a2d-4c39-ae7d-34989e0c2478 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:51.837140 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 556/1118] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:18:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:18:51.843412 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4e111-ea72-4900-a75f-c2065d6f78b0 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:51.844169 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4e111-ea72-4900-a75f-c2065d6f78b0 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:51.844323 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4e111-ea72-4900-a75f-c2065d6f78b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:51.868593 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-0ed4e111-ea72-4900-a75f-c2065d6f78b0 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:18:51.869781 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-0ed4e111-ea72-4900-a75f-c2065d6f78b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:18:51.943987 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 563/1119] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:18:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 01:18:52.216236 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61180612-5a2d-4c39-ae7d-34989e0c2478 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:52.336144 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61180612-5a2d-4c39-ae7d-34989e0c2478 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:52.349802 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:52.373948 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca3e1b-f8a4-4d6b-a4d1-95870a7352f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:52.374732 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca3e1b-f8a4-4d6b-a4d1-95870a7352f3 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:52.374978 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca3e1b-f8a4-4d6b-a4d1-95870a7352f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:52.375243 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca3e1b-f8a4-4d6b-a4d1-95870a7352f3 None admin] PATH_INFO: `/v3/roles/bab2af60c26640acbd0c4db2f9796cfb` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:52.376602 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeca3e1b-f8a4-4d6b-a4d1-95870a7352f3 None admin] RBAC: Authorizing `identity:get_role(role_id=bab2af60c26640acbd0c4db2f9796cfb)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:52.377965 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeca3e1b-f8a4-4d6b-a4d1-95870a7352f3 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:52.379322 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 557/1120] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 01:18:52 2022] GET /identity/v3/roles/bab2af60c26640acbd0c4db2f9796cfb => generated 223 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:52.386064 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed4e111-ea72-4900-a75f-c2065d6f78b0 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:52.456699 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:52.498248 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed4e111-ea72-4900-a75f-c2065d6f78b0 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:52.532727 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aad2e4-f498-4f4a-8aa2-7f8377c4bdf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:52.533349 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aad2e4-f498-4f4a-8aa2-7f8377c4bdf9 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:52.533619 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aad2e4-f498-4f4a-8aa2-7f8377c4bdf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:52.533885 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aad2e4-f498-4f4a-8aa2-7f8377c4bdf9 None admin] PATH_INFO: `/v3/users/2108ad92d2e3438b9bedc1dde2bef10f` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:52.535031 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aad2e4-f498-4f4a-8aa2-7f8377c4bdf9 None admin] RBAC: Authorizing `identity:get_user(user_id=2108ad92d2e3438b9bedc1dde2bef10f)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:52.536455 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aad2e4-f498-4f4a-8aa2-7f8377c4bdf9 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:52.538381 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 564/1121] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 01:18:52 2022] GET /identity/v3/users/2108ad92d2e3438b9bedc1dde2bef10f => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:52.545069 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca3e1b-f8a4-4d6b-a4d1-95870a7352f3 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:52.652006 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca3e1b-f8a4-4d6b-a4d1-95870a7352f3 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:52.689242 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e994dc-9ac8-47c3-a924-b3973016fb39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:52.689870 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e994dc-9ac8-47c3-a924-b3973016fb39 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:52.690147 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e994dc-9ac8-47c3-a924-b3973016fb39 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:52.690503 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e994dc-9ac8-47c3-a924-b3973016fb39 None admin] PATH_INFO: `/v3/projects/6b5be7a0d45a4ab5a86e7356f266cbf5` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:52.691653 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e994dc-9ac8-47c3-a924-b3973016fb39 None admin] RBAC: Authorizing `identity:get_project(project_id=6b5be7a0d45a4ab5a86e7356f266cbf5)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:52.693079 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e994dc-9ac8-47c3-a924-b3973016fb39 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:52.694744 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 558/1122] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 01:18:52 2022] GET /identity/v3/projects/6b5be7a0d45a4ab5a86e7356f266cbf5 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:52.701767 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aad2e4-f498-4f4a-8aa2-7f8377c4bdf9 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:52.816249 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aad2e4-f498-4f4a-8aa2-7f8377c4bdf9 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:52.859354 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80695cb-6134-4d06-843d-6415d436d526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:52.860265 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80695cb-6134-4d06-843d-6415d436d526 None admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:52.860562 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80695cb-6134-4d06-843d-6415d436d526 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:52.860830 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80695cb-6134-4d06-843d-6415d436d526 None admin] PATH_INFO: `/v3/projects/6b5be7a0d45a4ab5a86e7356f266cbf5/users/2108ad92d2e3438b9bedc1dde2bef10f/roles/bab2af60c26640acbd0c4db2f9796cfb` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:52.863406 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80695cb-6134-4d06-843d-6415d436d526 None admin] RBAC: Authorizing `identity:create_grant(project_id=6b5be7a0d45a4ab5a86e7356f266cbf5, user_id=2108ad92d2e3438b9bedc1dde2bef10f, role_id=bab2af60c26640acbd0c4db2f9796cfb)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:52.864838 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80695cb-6134-4d06-843d-6415d436d526 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:52.876994 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:52.885607 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 565/1123] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Aug 12 01:18:52 2022] PUT /identity/v3/projects/6b5be7a0d45a4ab5a86e7356f266cbf5/users/2108ad92d2e3438b9bedc1dde2bef10f/roles/bab2af60c26640acbd0c4db2f9796cfb => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:18:54.770562 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a406eb-b00c-4af2-babe-1a3b81ee38e0 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:54.771084 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a406eb-b00c-4af2-babe-1a3b81ee38e0 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:54.771084 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a406eb-b00c-4af2-babe-1a3b81ee38e0 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:54.772348 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 559/1124] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:18:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:18:54.778871 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec535414-8c55-43c4-8d5c-1feaeeca2ade None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:54.779595 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec535414-8c55-43c4-8d5c-1feaeeca2ade None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:54.779736 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec535414-8c55-43c4-8d5c-1feaeeca2ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:54.805681 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-ec535414-8c55-43c4-8d5c-1feaeeca2ade None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:18:54.806889 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-ec535414-8c55-43c4-8d5c-1feaeeca2ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:18:54.877976 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 566/1125] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:18:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 01:18:55.154286 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a406eb-b00c-4af2-babe-1a3b81ee38e0 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:55.220246 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:55.274950 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a406eb-b00c-4af2-babe-1a3b81ee38e0 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:55.312145 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d3a69-b719-4408-abcc-0e0e0bbe7ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:55.312780 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d3a69-b719-4408-abcc-0e0e0bbe7ee0 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:55.313049 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d3a69-b719-4408-abcc-0e0e0bbe7ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:55.313314 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d3a69-b719-4408-abcc-0e0e0bbe7ee0 None admin] PATH_INFO: `/v3/roles/bab2af60c26640acbd0c4db2f9796cfb` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:55.314776 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371d3a69-b719-4408-abcc-0e0e0bbe7ee0 None admin] RBAC: Authorizing `identity:get_role(role_id=bab2af60c26640acbd0c4db2f9796cfb)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:55.316154 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371d3a69-b719-4408-abcc-0e0e0bbe7ee0 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:55.317444 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 560/1126] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 01:18:55 2022] GET /identity/v3/roles/bab2af60c26640acbd0c4db2f9796cfb => generated 223 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:55.323561 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec535414-8c55-43c4-8d5c-1feaeeca2ade None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:55.430996 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec535414-8c55-43c4-8d5c-1feaeeca2ade None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:55.459084 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:55.468530 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cca424-f44f-41d1-980c-1ecea45697b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:55.469156 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cca424-f44f-41d1-980c-1ecea45697b8 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:55.469428 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cca424-f44f-41d1-980c-1ecea45697b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:55.469697 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cca424-f44f-41d1-980c-1ecea45697b8 None admin] PATH_INFO: `/v3/users/2108ad92d2e3438b9bedc1dde2bef10f` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:55.470857 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cca424-f44f-41d1-980c-1ecea45697b8 None admin] RBAC: Authorizing `identity:get_user(user_id=2108ad92d2e3438b9bedc1dde2bef10f)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:55.472278 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cca424-f44f-41d1-980c-1ecea45697b8 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:55.473855 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 567/1127] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 01:18:55 2022] GET /identity/v3/users/2108ad92d2e3438b9bedc1dde2bef10f => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:55.483023 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d3a69-b719-4408-abcc-0e0e0bbe7ee0 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:55.585985 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d3a69-b719-4408-abcc-0e0e0bbe7ee0 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:55.601778 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:55.620761 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a79d2-a531-4e36-b296-24f3a55adf5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:55.621355 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a79d2-a531-4e36-b296-24f3a55adf5f None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:55.621624 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a79d2-a531-4e36-b296-24f3a55adf5f None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:55.621891 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a79d2-a531-4e36-b296-24f3a55adf5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:55.689372 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5a79d2-a531-4e36-b296-24f3a55adf5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:55.690815 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5a79d2-a531-4e36-b296-24f3a55adf5f None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:55.788468 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 561/1128] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 01:18:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 01:18:55.795318 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cca424-f44f-41d1-980c-1ecea45697b8 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:55.913813 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cca424-f44f-41d1-980c-1ecea45697b8 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:55.951176 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94f837-900d-4f4a-b657-e3bc501a8c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:55.951721 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94f837-900d-4f4a-b657-e3bc501a8c41 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:55.952142 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94f837-900d-4f4a-b657-e3bc501a8c41 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:55.952517 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94f837-900d-4f4a-b657-e3bc501a8c41 None admin] PATH_INFO: `/v3/projects/6b5be7a0d45a4ab5a86e7356f266cbf5` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:55.953761 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f94f837-900d-4f4a-b657-e3bc501a8c41 None admin] RBAC: Authorizing `identity:get_project(project_id=6b5be7a0d45a4ab5a86e7356f266cbf5)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:55.955200 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f94f837-900d-4f4a-b657-e3bc501a8c41 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:55.956789 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 568/1129] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 01:18:55 2022] GET /identity/v3/projects/6b5be7a0d45a4ab5a86e7356f266cbf5 => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:55.963412 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a79d2-a531-4e36-b296-24f3a55adf5f None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:55.984438 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:56.068582 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a79d2-a531-4e36-b296-24f3a55adf5f None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:56.102872 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c8601-a451-4bab-907d-27b5c2e264ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:56.103455 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c8601-a451-4bab-907d-27b5c2e264ac None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:56.103725 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c8601-a451-4bab-907d-27b5c2e264ac None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:56.103985 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c8601-a451-4bab-907d-27b5c2e264ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:56.104695 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5c8601-a451-4bab-907d-27b5c2e264ac None admin] RBAC: Adding query filter params (role.id=bab2af60c26640acbd0c4db2f9796cfb, scope.project.id=6b5be7a0d45a4ab5a86e7356f266cbf5, user.id=2108ad92d2e3438b9bedc1dde2bef10f) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:18:56.104993 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5c8601-a451-4bab-907d-27b5c2e264ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:56.106513 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5c8601-a451-4bab-907d-27b5c2e264ac None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:56.112654 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 562/1130] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 01:18:55 2022] GET /identity/v3/role_assignments?user.id=2108ad92d2e3438b9bedc1dde2bef10f&scope.project.id=6b5be7a0d45a4ab5a86e7356f266cbf5&role.id=bab2af60c26640acbd0c4db2f9796cfb => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:58.058453 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7666069-88cc-4e24-93b7-2b297a9a4f6b None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:58.059015 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7666069-88cc-4e24-93b7-2b297a9a4f6b None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:58.059015 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7666069-88cc-4e24-93b7-2b297a9a4f6b None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:58.060364 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 569/1131] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:18:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:18:58.066804 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e88e49-f8ba-4042-a2dc-7d4bf6f933ac None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:58.067247 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e88e49-f8ba-4042-a2dc-7d4bf6f933ac None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:58.067335 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e88e49-f8ba-4042-a2dc-7d4bf6f933ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:58.092039 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-49e88e49-f8ba-4042-a2dc-7d4bf6f933ac None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:18:58.093498 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-49e88e49-f8ba-4042-a2dc-7d4bf6f933ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:18:58.163228 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 563/1132] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:18:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 01:18:58.434545 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7666069-88cc-4e24-93b7-2b297a9a4f6b None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:58.503117 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:58.547880 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7666069-88cc-4e24-93b7-2b297a9a4f6b None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:58.583911 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b5c855-9326-4fc1-a7b1-dc4979a6b631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:58.584613 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5c855-9326-4fc1-a7b1-dc4979a6b631 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:58.584888 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5c855-9326-4fc1-a7b1-dc4979a6b631 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:58.585151 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5c855-9326-4fc1-a7b1-dc4979a6b631 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:58.586330 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b5c855-9326-4fc1-a7b1-dc4979a6b631 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:58.587738 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b5c855-9326-4fc1-a7b1-dc4979a6b631 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:58.589295 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 570/1133] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:18:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:18:58.599480 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e88e49-f8ba-4042-a2dc-7d4bf6f933ac None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:18:58.612888 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:18:58.705025 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e88e49-f8ba-4042-a2dc-7d4bf6f933ac None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:18:58.740029 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044c33b4-83b6-4d68-816d-4169f9729a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:18:58.740634 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c33b4-83b6-4d68-816d-4169f9729a60 None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:18:58.740908 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c33b4-83b6-4d68-816d-4169f9729a60 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:18:58.741176 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c33b4-83b6-4d68-816d-4169f9729a60 None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:18:58.741818 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044c33b4-83b6-4d68-816d-4169f9729a60 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:18:58.743289 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044c33b4-83b6-4d68-816d-4169f9729a60 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:18:58.779606 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 564/1134] 10.222.0.26 () {60 vars in 1141 bytes} [Fri Aug 12 01:18:58 2022] POST /identity/v3/projects => generated 311 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:19:00.703982 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c9553f-bfc3-4e20-9aef-a283f554b583 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:19:00.704584 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c9553f-bfc3-4e20-9aef-a283f554b583 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:19:00.704584 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c9553f-bfc3-4e20-9aef-a283f554b583 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:19:00.705886 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 571/1135] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:19:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:19:00.712965 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e144b-05b1-43fd-b250-4df34e3d03b3 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:19:00.713703 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e144b-05b1-43fd-b250-4df34e3d03b3 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:19:00.713859 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e144b-05b1-43fd-b250-4df34e3d03b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:19:00.740567 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-4d4e144b-05b1-43fd-b250-4df34e3d03b3 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:19:00.741684 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-4d4e144b-05b1-43fd-b250-4df34e3d03b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:19:00.800570 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:19:00.819756 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 565/1136] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:19:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 01:19:01.086277 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c9553f-bfc3-4e20-9aef-a283f554b583 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:19:01.192151 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c9553f-bfc3-4e20-9aef-a283f554b583 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:19:01.224034 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:19:01.229800 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a686704-c10f-4bfe-9ebb-699e5e7df817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:19:01.230450 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a686704-c10f-4bfe-9ebb-699e5e7df817 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:19:01.230726 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a686704-c10f-4bfe-9ebb-699e5e7df817 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:19:01.231000 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a686704-c10f-4bfe-9ebb-699e5e7df817 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:19:01.232219 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a686704-c10f-4bfe-9ebb-699e5e7df817 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:19:01.233764 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a686704-c10f-4bfe-9ebb-699e5e7df817 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:19:01.235362 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 572/1137] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:19:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:19:01.244551 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4e144b-05b1-43fd-b250-4df34e3d03b3 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:19:01.350419 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4e144b-05b1-43fd-b250-4df34e3d03b3 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:19:01.385718 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873751fe-6ce4-4d8b-9bba-9b17e0ec0682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:19:01.386345 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873751fe-6ce4-4d8b-9bba-9b17e0ec0682 None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:19:01.386612 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873751fe-6ce4-4d8b-9bba-9b17e0ec0682 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:19:01.386873 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873751fe-6ce4-4d8b-9bba-9b17e0ec0682 None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:19:01.387498 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873751fe-6ce4-4d8b-9bba-9b17e0ec0682 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:19:01.388961 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873751fe-6ce4-4d8b-9bba-9b17e0ec0682 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:19:01.417169 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 566/1138] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Aug 12 01:19:01 2022] POST /identity/v3/users => generated 286 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:19:03.318335 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf01a85-a82b-4dbe-8787-e26474af4d19 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:19:03.319287 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf01a85-a82b-4dbe-8787-e26474af4d19 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:19:03.319287 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf01a85-a82b-4dbe-8787-e26474af4d19 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:19:03.321364 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 573/1139] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:19:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:19:03.326782 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cca408-f167-439f-8bd0-54930a685670 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:19:03.327196 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cca408-f167-439f-8bd0-54930a685670 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:19:03.327303 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cca408-f167-439f-8bd0-54930a685670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:19:03.346760 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-54cca408-f167-439f-8bd0-54930a685670 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:19:03.347914 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-54cca408-f167-439f-8bd0-54930a685670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:19:03.392359 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:19:03.418031 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 567/1140] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:19:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 01:19:03.708518 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf01a85-a82b-4dbe-8787-e26474af4d19 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:19:03.819379 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf01a85-a82b-4dbe-8787-e26474af4d19 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:19:03.867681 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5453a41-097a-4fb7-9cb8-b90bd2b35e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:19:03.868308 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5453a41-097a-4fb7-9cb8-b90bd2b35e87 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:19:03.868578 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5453a41-097a-4fb7-9cb8-b90bd2b35e87 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:19:03.868844 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5453a41-097a-4fb7-9cb8-b90bd2b35e87 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:19:03.881189 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5453a41-097a-4fb7-9cb8-b90bd2b35e87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:19:03.887373 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-c5453a41-097a-4fb7-9cb8-b90bd2b35e87 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 01:19:03.887373 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:19:03.887373 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:19:03.887373 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:19:03.887373 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:19:03.887373 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:19:03.887373 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:19:03.887373 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:19:03.887373 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:19:03.887373 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:19:03.887373 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:19:03.887373 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:19:03.887373 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:19:03.887373 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:19:03.887373 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:19:03.887373 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:19:03.888581 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:19:03.888581 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:19:03.888581 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:19:03.888581 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:19:03.888581 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:19:03.888581 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:19:03.888581 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:19:03.888581 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:19:03.888581 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:19:03.888581 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:19:03.888581 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:19:03.888581 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:19:03.888581 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:19:03.888581 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:19:03.888581 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:19:03.888581 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:19:03.889543 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:19:03.889543 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:19:03.889543 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:19:03.889543 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:19:03.889543 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:19:03.889543 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:19:03.889543 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:19:03.889543 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:19:03.889543 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:19:03.889543 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:19:03.889543 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 01:19:03.889543 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:19:03.889543 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 574/1141] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Aug 12 01:19:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:19:03.895849 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cca408-f167-439f-8bd0-54930a685670 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:19:03.996121 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cca408-f167-439f-8bd0-54930a685670 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:19:04.031834 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02281b1b-0dff-4e20-a18e-6cee65f3ea86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:19:04.032421 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02281b1b-0dff-4e20-a18e-6cee65f3ea86 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:19:04.032693 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02281b1b-0dff-4e20-a18e-6cee65f3ea86 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:19:04.032955 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02281b1b-0dff-4e20-a18e-6cee65f3ea86 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:19:04.033613 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02281b1b-0dff-4e20-a18e-6cee65f3ea86 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:19:04.033917 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02281b1b-0dff-4e20-a18e-6cee65f3ea86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:19:04.035317 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02281b1b-0dff-4e20-a18e-6cee65f3ea86 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:19:04.043691 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 568/1142] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 01:19:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:19:04.050176 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5453a41-097a-4fb7-9cb8-b90bd2b35e87 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:19:04.123735 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:19:04.166149 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5453a41-097a-4fb7-9cb8-b90bd2b35e87 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:19:04.200287 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89101ca0-a4ab-402b-aeaf-7b2e7842649b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:19:04.200987 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89101ca0-a4ab-402b-aeaf-7b2e7842649b None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:19:04.201382 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89101ca0-a4ab-402b-aeaf-7b2e7842649b None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:19:04.201577 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89101ca0-a4ab-402b-aeaf-7b2e7842649b None admin] PATH_INFO: `/v3/users/7ee4fe6e0c85443ca6dca486ff557574` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:19:04.215028 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89101ca0-a4ab-402b-aeaf-7b2e7842649b None admin] RBAC: Authorizing `identity:get_user(user_id=7ee4fe6e0c85443ca6dca486ff557574)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:19:04.216518 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89101ca0-a4ab-402b-aeaf-7b2e7842649b None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:19:04.218262 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 575/1143] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 01:19:04 2022] GET /identity/v3/users/7ee4fe6e0c85443ca6dca486ff557574 => generated 286 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:19:04.225285 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02281b1b-0dff-4e20-a18e-6cee65f3ea86 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:19:04.278628 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:19:04.342954 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02281b1b-0dff-4e20-a18e-6cee65f3ea86 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:19:04.381987 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc1714-a1b4-43ae-adb9-c87de14ac5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:19:04.382873 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc1714-a1b4-43ae-adb9-c87de14ac5c8 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:19:04.383253 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc1714-a1b4-43ae-adb9-c87de14ac5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:19:04.383584 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc1714-a1b4-43ae-adb9-c87de14ac5c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:19:04.459448 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfc1714-a1b4-43ae-adb9-c87de14ac5c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:19:04.460887 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfc1714-a1b4-43ae-adb9-c87de14ac5c8 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:19:04.507044 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:19:04.567506 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 569/1144] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 01:19:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 01:19:04.576701 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89101ca0-a4ab-402b-aeaf-7b2e7842649b None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:19:04.680230 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89101ca0-a4ab-402b-aeaf-7b2e7842649b None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:19:04.697546 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:19:04.715791 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d911273-3286-453e-bd8a-cb29d75d3176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:19:04.716492 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d911273-3286-453e-bd8a-cb29d75d3176 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:19:04.716658 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d911273-3286-453e-bd8a-cb29d75d3176 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:19:04.716955 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d911273-3286-453e-bd8a-cb29d75d3176 None admin] PATH_INFO: `/v3/projects/ccf369596b0c43d59e341d97c3283295` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:19:04.718101 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d911273-3286-453e-bd8a-cb29d75d3176 None admin] RBAC: Authorizing `identity:get_project(project_id=ccf369596b0c43d59e341d97c3283295)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:19:04.719545 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d911273-3286-453e-bd8a-cb29d75d3176 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:19:04.721157 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 576/1145] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 01:19:04 2022] GET /identity/v3/projects/ccf369596b0c43d59e341d97c3283295 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:19:04.727635 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc1714-a1b4-43ae-adb9-c87de14ac5c8 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:19:04.829114 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc1714-a1b4-43ae-adb9-c87de14ac5c8 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:19:04.865251 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff5a542-be09-4838-bfb1-d8f77d7c080d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:19:04.865844 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff5a542-be09-4838-bfb1-d8f77d7c080d None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:19:04.866138 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff5a542-be09-4838-bfb1-d8f77d7c080d None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:19:04.866422 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff5a542-be09-4838-bfb1-d8f77d7c080d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:19:04.867141 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff5a542-be09-4838-bfb1-d8f77d7c080d None admin] RBAC: Adding query filter params (role.id=fb48693810be495fb4b1893a79429b78, scope.project.id=ccf369596b0c43d59e341d97c3283295, user.id=7ee4fe6e0c85443ca6dca486ff557574) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:19:04.867444 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff5a542-be09-4838-bfb1-d8f77d7c080d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:19:04.868868 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff5a542-be09-4838-bfb1-d8f77d7c080d None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:19:04.874325 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 570/1146] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 01:19:04 2022] GET /identity/v3/role_assignments?user.id=7ee4fe6e0c85443ca6dca486ff557574&scope.project.id=ccf369596b0c43d59e341d97c3283295&role.id=fb48693810be495fb4b1893a79429b78 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:19:06.724108 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd09693-4497-49b8-8f8d-96e2a4f605e7 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:19:06.724928 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd09693-4497-49b8-8f8d-96e2a4f605e7 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:19:06.724928 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd09693-4497-49b8-8f8d-96e2a4f605e7 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:19:06.727133 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 577/1147] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:19:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:19:06.733712 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f45d6e-5664-4be4-a3a1-9b92fae33dc4 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:19:06.734460 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f45d6e-5664-4be4-a3a1-9b92fae33dc4 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:19:06.734656 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f45d6e-5664-4be4-a3a1-9b92fae33dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:19:06.747189 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:19:06.765690 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-64f45d6e-5664-4be4-a3a1-9b92fae33dc4 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:19:06.766916 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-64f45d6e-5664-4be4-a3a1-9b92fae33dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:19:06.838178 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 571/1148] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:19:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 01:19:07.101502 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd09693-4497-49b8-8f8d-96e2a4f605e7 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:19:07.224774 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd09693-4497-49b8-8f8d-96e2a4f605e7 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:19:07.269327 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beb168e-99ae-46c1-822c-2015641fe532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:19:07.269945 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb168e-99ae-46c1-822c-2015641fe532 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:19:07.270254 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb168e-99ae-46c1-822c-2015641fe532 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:19:07.270571 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb168e-99ae-46c1-822c-2015641fe532 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:19:07.281274 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beb168e-99ae-46c1-822c-2015641fe532 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:19:07.285866 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-8beb168e-99ae-46c1-822c-2015641fe532 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 01:19:07.285866 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:19:07.285866 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:19:07.285866 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:19:07.285866 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:19:07.285866 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:19:07.285866 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:19:07.285866 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:19:07.285866 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:19:07.285866 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:19:07.285866 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:19:07.285866 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:19:07.285866 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:19:07.285866 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:19:07.285866 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:19:07.285866 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:19:07.287158 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:19:07.287158 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:19:07.287158 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:19:07.287158 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:19:07.287158 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:19:07.287158 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:19:07.287158 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:19:07.287158 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:19:07.287158 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:19:07.287158 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:19:07.287158 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:19:07.287158 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:19:07.287158 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:19:07.287158 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:19:07.287158 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:19:07.287158 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:19:07.288120 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:19:07.288120 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:19:07.288120 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:19:07.288120 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:19:07.288120 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:19:07.288120 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:19:07.288120 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:19:07.288120 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:19:07.288120 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:19:07.288120 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:19:07.288120 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 01:19:07.288120 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:19:07.288120 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 578/1149] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Aug 12 01:19:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:19:07.294370 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f45d6e-5664-4be4-a3a1-9b92fae33dc4 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:19:07.400890 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f45d6e-5664-4be4-a3a1-9b92fae33dc4 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:19:07.435880 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c618c695-e2ae-498f-867b-44ce48ff8498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:19:07.436472 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618c695-e2ae-498f-867b-44ce48ff8498 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:19:07.436742 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618c695-e2ae-498f-867b-44ce48ff8498 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:19:07.437002 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618c695-e2ae-498f-867b-44ce48ff8498 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:19:07.437643 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c618c695-e2ae-498f-867b-44ce48ff8498 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:19:07.437940 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c618c695-e2ae-498f-867b-44ce48ff8498 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:19:07.439337 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c618c695-e2ae-498f-867b-44ce48ff8498 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:19:07.440711 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:19:07.448185 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 572/1150] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 01:19:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:19:07.455090 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beb168e-99ae-46c1-822c-2015641fe532 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:19:07.506706 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:19:07.559752 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beb168e-99ae-46c1-822c-2015641fe532 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:19:07.594665 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b91ffa-24f5-4670-bc26-24e62a41a1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:19:07.595282 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b91ffa-24f5-4670-bc26-24e62a41a1b0 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:19:07.595556 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b91ffa-24f5-4670-bc26-24e62a41a1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:19:07.595824 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b91ffa-24f5-4670-bc26-24e62a41a1b0 None admin] PATH_INFO: `/v3/users/7ee4fe6e0c85443ca6dca486ff557574` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:19:07.596978 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b91ffa-24f5-4670-bc26-24e62a41a1b0 None admin] RBAC: Authorizing `identity:get_user(user_id=7ee4fe6e0c85443ca6dca486ff557574)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:19:07.598429 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b91ffa-24f5-4670-bc26-24e62a41a1b0 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:19:07.600001 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 579/1151] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 01:19:07 2022] GET /identity/v3/users/7ee4fe6e0c85443ca6dca486ff557574 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:19:07.606939 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c618c695-e2ae-498f-867b-44ce48ff8498 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:19:07.715175 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c618c695-e2ae-498f-867b-44ce48ff8498 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:19:07.758407 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4037f7-998b-4655-a8f1-d907eac1da55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:19:07.759014 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4037f7-998b-4655-a8f1-d907eac1da55 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:19:07.759286 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4037f7-998b-4655-a8f1-d907eac1da55 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:19:07.759552 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4037f7-998b-4655-a8f1-d907eac1da55 None admin] PATH_INFO: `/v3/projects/ccf369596b0c43d59e341d97c3283295` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:19:07.760789 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4037f7-998b-4655-a8f1-d907eac1da55 None admin] RBAC: Authorizing `identity:get_project(project_id=ccf369596b0c43d59e341d97c3283295)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:19:07.762240 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4037f7-998b-4655-a8f1-d907eac1da55 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:19:07.763945 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 573/1152] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 01:19:07 2022] GET /identity/v3/projects/ccf369596b0c43d59e341d97c3283295 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:19:07.770220 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b91ffa-24f5-4670-bc26-24e62a41a1b0 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:19:07.880281 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b91ffa-24f5-4670-bc26-24e62a41a1b0 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:19:07.894871 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:19:07.915841 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c5be78-4f39-4691-ac39-29e2c7c3b0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:19:07.916479 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5be78-4f39-4691-ac39-29e2c7c3b0b2 None admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:19:07.916751 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5be78-4f39-4691-ac39-29e2c7c3b0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:19:07.917016 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5be78-4f39-4691-ac39-29e2c7c3b0b2 None admin] PATH_INFO: `/v3/projects/ccf369596b0c43d59e341d97c3283295/users/7ee4fe6e0c85443ca6dca486ff557574/roles/fb48693810be495fb4b1893a79429b78` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:19:07.918989 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c5be78-4f39-4691-ac39-29e2c7c3b0b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=ccf369596b0c43d59e341d97c3283295, user_id=7ee4fe6e0c85443ca6dca486ff557574, role_id=fb48693810be495fb4b1893a79429b78)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:19:07.920396 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c5be78-4f39-4691-ac39-29e2c7c3b0b2 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:19:07.934453 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 580/1153] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Aug 12 01:19:07 2022] PUT /identity/v3/projects/ccf369596b0c43d59e341d97c3283295/users/7ee4fe6e0c85443ca6dca486ff557574/roles/fb48693810be495fb4b1893a79429b78 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:19:09.802685 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6fd9b-1851-45da-83fe-b173a6716cf7 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:19:09.803524 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6fd9b-1851-45da-83fe-b173a6716cf7 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:19:09.803524 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6fd9b-1851-45da-83fe-b173a6716cf7 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:19:09.805468 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 574/1154] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:19:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:19:09.811812 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3528bbb-c657-4307-88f0-f13c8619ca71 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:19:09.812560 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3528bbb-c657-4307-88f0-f13c8619ca71 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:19:09.812703 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3528bbb-c657-4307-88f0-f13c8619ca71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:19:09.836058 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-f3528bbb-c657-4307-88f0-f13c8619ca71 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:19:09.837221 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-f3528bbb-c657-4307-88f0-f13c8619ca71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:19:09.910664 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 581/1155] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:19:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 01:19:10.177257 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef6fd9b-1851-45da-83fe-b173a6716cf7 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:19:10.253527 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:19:10.293391 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef6fd9b-1851-45da-83fe-b173a6716cf7 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:19:10.328252 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540af44d-0ee7-4cf7-8798-d0e8ef0e8d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:19:10.328866 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540af44d-0ee7-4cf7-8798-d0e8ef0e8d51 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:19:10.329134 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540af44d-0ee7-4cf7-8798-d0e8ef0e8d51 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:19:10.329391 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540af44d-0ee7-4cf7-8798-d0e8ef0e8d51 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:19:10.339345 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540af44d-0ee7-4cf7-8798-d0e8ef0e8d51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:19:10.344055 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-540af44d-0ee7-4cf7-8798-d0e8ef0e8d51 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 01:19:10.344055 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:19:10.344055 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:19:10.344055 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:19:10.344055 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:19:10.344055 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:19:10.344055 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:19:10.344055 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:19:10.344055 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:19:10.344055 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:19:10.344055 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:19:10.344055 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:19:10.344055 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:19:10.344055 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:19:10.344055 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:19:10.344055 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:19:10.345061 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:19:10.345061 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:19:10.345061 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:19:10.345061 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:19:10.345061 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:19:10.345061 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:19:10.345061 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:19:10.345061 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:19:10.345061 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:19:10.345061 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:19:10.345061 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:19:10.345061 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:19:10.345061 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:19:10.345061 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:19:10.345061 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:19:10.345061 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:19:10.345987 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:19:10.345987 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:19:10.345987 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:19:10.345987 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:19:10.345987 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:19:10.345987 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:19:10.345987 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:19:10.345987 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:19:10.345987 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:19:10.345987 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:19:10.345987 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 01:19:10.345987 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:19:10.345987 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 575/1156] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Aug 12 01:19:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:19:10.354343 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3528bbb-c657-4307-88f0-f13c8619ca71 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:19:10.462163 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3528bbb-c657-4307-88f0-f13c8619ca71 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:19:10.464687 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:19:10.505659 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a98e22-3518-49e5-93ef-3c47e58413c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:19:10.506300 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a98e22-3518-49e5-93ef-3c47e58413c6 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:19:10.506566 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a98e22-3518-49e5-93ef-3c47e58413c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:19:10.506830 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a98e22-3518-49e5-93ef-3c47e58413c6 None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:19:10.507486 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a98e22-3518-49e5-93ef-3c47e58413c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:19:10.507780 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a98e22-3518-49e5-93ef-3c47e58413c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:19:10.509153 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a98e22-3518-49e5-93ef-3c47e58413c6 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:19:10.517743 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 582/1157] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 01:19:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:19:10.524028 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540af44d-0ee7-4cf7-8798-d0e8ef0e8d51 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:19:10.630449 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540af44d-0ee7-4cf7-8798-d0e8ef0e8d51 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:19:10.654994 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:19:10.668334 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aed9a7-bd4b-470f-a800-7ed98ad46de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:19:10.669030 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aed9a7-bd4b-470f-a800-7ed98ad46de1 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:19:10.669388 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aed9a7-bd4b-470f-a800-7ed98ad46de1 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:19:10.669759 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aed9a7-bd4b-470f-a800-7ed98ad46de1 None admin] PATH_INFO: `/v3/users/7ee4fe6e0c85443ca6dca486ff557574` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:19:10.671889 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aed9a7-bd4b-470f-a800-7ed98ad46de1 None admin] RBAC: Authorizing `identity:get_user(user_id=7ee4fe6e0c85443ca6dca486ff557574)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:19:10.673321 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aed9a7-bd4b-470f-a800-7ed98ad46de1 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:19:10.674944 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 576/1158] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 01:19:10 2022] GET /identity/v3/users/7ee4fe6e0c85443ca6dca486ff557574 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:19:10.681984 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a98e22-3518-49e5-93ef-3c47e58413c6 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:19:10.793671 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a98e22-3518-49e5-93ef-3c47e58413c6 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:19:10.828294 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3172a1cc-1dae-4ae3-8133-1a05bd921055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:19:10.828991 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3172a1cc-1dae-4ae3-8133-1a05bd921055 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:19:10.829110 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3172a1cc-1dae-4ae3-8133-1a05bd921055 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:19:10.829394 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3172a1cc-1dae-4ae3-8133-1a05bd921055 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:19:10.864691 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:19:10.901153 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3172a1cc-1dae-4ae3-8133-1a05bd921055 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:19:10.902619 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3172a1cc-1dae-4ae3-8133-1a05bd921055 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:19:11.001645 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 583/1159] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 01:19:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 01:19:11.011274 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aed9a7-bd4b-470f-a800-7ed98ad46de1 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:19:11.124164 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aed9a7-bd4b-470f-a800-7ed98ad46de1 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:19:11.158496 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9297308c-cd56-4ad6-81f0-b054a1b0d189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:19:11.159111 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297308c-cd56-4ad6-81f0-b054a1b0d189 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:19:11.159386 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297308c-cd56-4ad6-81f0-b054a1b0d189 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:19:11.159652 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297308c-cd56-4ad6-81f0-b054a1b0d189 None admin] PATH_INFO: `/v3/projects/ccf369596b0c43d59e341d97c3283295` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:19:11.161198 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9297308c-cd56-4ad6-81f0-b054a1b0d189 None admin] RBAC: Authorizing `identity:get_project(project_id=ccf369596b0c43d59e341d97c3283295)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:19:11.162659 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9297308c-cd56-4ad6-81f0-b054a1b0d189 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:19:11.164257 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 577/1160] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 01:19:11 2022] GET /identity/v3/projects/ccf369596b0c43d59e341d97c3283295 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:19:11.172853 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3172a1cc-1dae-4ae3-8133-1a05bd921055 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:19:11.238937 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:19:11.274446 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3172a1cc-1dae-4ae3-8133-1a05bd921055 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:19:11.309860 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8587ed-8016-4720-9c45-70716147a724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:19:11.310563 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8587ed-8016-4720-9c45-70716147a724 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:19:11.310842 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8587ed-8016-4720-9c45-70716147a724 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:19:11.311112 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8587ed-8016-4720-9c45-70716147a724 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:19:11.311835 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8587ed-8016-4720-9c45-70716147a724 None admin] RBAC: Adding query filter params (role.id=fb48693810be495fb4b1893a79429b78, scope.project.id=ccf369596b0c43d59e341d97c3283295, user.id=7ee4fe6e0c85443ca6dca486ff557574) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:19:11.312143 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8587ed-8016-4720-9c45-70716147a724 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:19:11.313573 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8587ed-8016-4720-9c45-70716147a724 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:19:11.319501 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 584/1161] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 01:19:11 2022] GET /identity/v3/role_assignments?user.id=7ee4fe6e0c85443ca6dca486ff557574&scope.project.id=ccf369596b0c43d59e341d97c3283295&role.id=fb48693810be495fb4b1893a79429b78 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:19:13.199939 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11be86f-9cbe-495b-8058-92d32b1077a4 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:19:13.200788 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11be86f-9cbe-495b-8058-92d32b1077a4 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:19:13.200936 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11be86f-9cbe-495b-8058-92d32b1077a4 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:19:13.203067 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 578/1162] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:19:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:19:13.208776 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa776b5-684b-4759-a4a3-e0ad158983a2 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:19:13.209199 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa776b5-684b-4759-a4a3-e0ad158983a2 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:19:13.209285 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa776b5-684b-4759-a4a3-e0ad158983a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:19:13.228985 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-5fa776b5-684b-4759-a4a3-e0ad158983a2 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:19:13.230159 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-5fa776b5-684b-4759-a4a3-e0ad158983a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:19:13.305211 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 585/1163] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:19:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 01:19:13.586686 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11be86f-9cbe-495b-8058-92d32b1077a4 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:19:13.650975 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:19:13.702023 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11be86f-9cbe-495b-8058-92d32b1077a4 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:19:13.737315 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6bad5a-1564-4ba0-b8c9-85b0b15ea5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:19:13.737915 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6bad5a-1564-4ba0-b8c9-85b0b15ea5b1 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:19:13.738215 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6bad5a-1564-4ba0-b8c9-85b0b15ea5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:19:13.738484 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6bad5a-1564-4ba0-b8c9-85b0b15ea5b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:19:13.806394 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6bad5a-1564-4ba0-b8c9-85b0b15ea5b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:19:13.807770 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6bad5a-1564-4ba0-b8c9-85b0b15ea5b1 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:19:13.875885 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:19:13.930152 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 579/1164] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 01:19:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 01:19:13.937148 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa776b5-684b-4759-a4a3-e0ad158983a2 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:19:14.005241 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:19:14.057008 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa776b5-684b-4759-a4a3-e0ad158983a2 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:19:14.093954 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd8b740-7d86-4e8a-9cd2-6e57ba1d0bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:19:14.094568 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd8b740-7d86-4e8a-9cd2-6e57ba1d0bbc None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:19:14.094883 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd8b740-7d86-4e8a-9cd2-6e57ba1d0bbc None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:19:14.095148 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd8b740-7d86-4e8a-9cd2-6e57ba1d0bbc None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:19:14.102247 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd8b740-7d86-4e8a-9cd2-6e57ba1d0bbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:19:14.103692 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd8b740-7d86-4e8a-9cd2-6e57ba1d0bbc None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:19:14.115389 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-6bd8b740-7d86-4e8a-9cd2-6e57ba1d0bbc None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 12 01:19:14.115389 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:19:14.115389 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 12 01:19:14.115389 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 12 01:19:14.115389 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 01:19:14.115389 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 01:19:14.115389 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 01:19:14.115389 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 01:19:14.115389 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 12 01:19:14.115389 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:19:14.115389 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 01:19:14.115389 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:19:14.115389 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:19:14.115389 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:19:14.115389 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:19:14.115389 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:19:14.115389 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:19:14.116521 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:19:14.116521 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:19:14.116521 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:19:14.116521 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:19:14.116521 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:19:14.116521 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:19:14.116521 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 01:19:14.116521 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 01:19:14.116521 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 01:19:14.116521 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 01:19:14.116521 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:19:14.116521 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:19:14.116521 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:19:14.116521 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:19:14.116521 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:19:14.116521 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:19:14.117520 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:19:14.117520 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:19:14.117520 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:19:14.117520 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:19:14.117520 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:19:14.117520 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:19:14.117520 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:19:14.117520 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:19:14.117520 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:19:14.117520 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:19:14.117520 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 12 01:19:14.117520 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 01:19:14.117520 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 12 01:19:14.117520 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:19:14.117520 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 586/1165] 10.222.0.26 () {56 vars in 1117 bytes} [Fri Aug 12 01:19:13 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:19:14.122950 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6bad5a-1564-4ba0-b8c9-85b0b15ea5b1 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:19:14.228846 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6bad5a-1564-4ba0-b8c9-85b0b15ea5b1 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:19:14.263551 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234b4119-c7e1-4723-a631-bf1d3484904a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:19:14.264138 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b4119-c7e1-4723-a631-bf1d3484904a None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:19:14.264410 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b4119-c7e1-4723-a631-bf1d3484904a None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:19:14.264674 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b4119-c7e1-4723-a631-bf1d3484904a None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:19:14.265300 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234b4119-c7e1-4723-a631-bf1d3484904a None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:19:14.265596 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234b4119-c7e1-4723-a631-bf1d3484904a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:19:14.266980 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234b4119-c7e1-4723-a631-bf1d3484904a None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:19:14.273992 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 580/1166] 10.222.0.26 () {56 vars in 1115 bytes} [Fri Aug 12 01:19:14 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:19:16.186361 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc481f0c-4d00-4082-b3e9-0f893759802e None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:19:16.186914 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc481f0c-4d00-4082-b3e9-0f893759802e None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:19:16.186914 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc481f0c-4d00-4082-b3e9-0f893759802e None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:19:16.188257 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 587/1167] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:19:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:19:16.194851 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f23ed8-ca8c-443d-b28e-769c164f954a None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:19:16.195550 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f23ed8-ca8c-443d-b28e-769c164f954a None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:19:16.195694 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f23ed8-ca8c-443d-b28e-769c164f954a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:19:16.222493 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-e4f23ed8-ca8c-443d-b28e-769c164f954a None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:19:16.223677 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-e4f23ed8-ca8c-443d-b28e-769c164f954a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:19:16.242355 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:19:16.308837 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 581/1168] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:19:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 01:19:16.571290 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc481f0c-4d00-4082-b3e9-0f893759802e None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:19:16.682352 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc481f0c-4d00-4082-b3e9-0f893759802e None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:19:16.702649 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:19:16.727161 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d51e5b-3b3d-4cbd-8831-c87f966151a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:19:16.728034 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d51e5b-3b3d-4cbd-8831-c87f966151a9 None admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:19:16.728409 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d51e5b-3b3d-4cbd-8831-c87f966151a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:19:16.728770 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d51e5b-3b3d-4cbd-8831-c87f966151a9 None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:19:16.729773 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d51e5b-3b3d-4cbd-8831-c87f966151a9 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:19:16.731995 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d51e5b-3b3d-4cbd-8831-c87f966151a9 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:19:16.751378 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 588/1169] 10.222.0.26 () {60 vars in 1138 bytes} [Fri Aug 12 01:19:16 2022] POST /identity/v3/domains => generated 267 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:19:18.689592 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63faae8c-c7c5-45e5-b281-14ffdcbe8b7e None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:19:18.690512 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63faae8c-c7c5-45e5-b281-14ffdcbe8b7e None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:19:18.690512 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63faae8c-c7c5-45e5-b281-14ffdcbe8b7e None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:19:18.692558 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 582/1170] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:19:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:19:18.700751 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a16fe45-e193-4769-a2c0-594698682e85 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:19:18.701209 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a16fe45-e193-4769-a2c0-594698682e85 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:19:18.701301 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a16fe45-e193-4769-a2c0-594698682e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:19:18.721016 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-5a16fe45-e193-4769-a2c0-594698682e85 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:19:18.722214 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-5a16fe45-e193-4769-a2c0-594698682e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:19:18.794797 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 589/1171] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:19:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 01:19:19.061053 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63faae8c-c7c5-45e5-b281-14ffdcbe8b7e None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:19:19.192854 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63faae8c-c7c5-45e5-b281-14ffdcbe8b7e None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:19:19.228087 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6262ef46-ddf2-4d03-877c-c3451ff84363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:19:19.228706 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262ef46-ddf2-4d03-877c-c3451ff84363 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:19:19.228985 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262ef46-ddf2-4d03-877c-c3451ff84363 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:19:19.229252 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262ef46-ddf2-4d03-877c-c3451ff84363 None admin] PATH_INFO: `/v3/domains/cdaccb43218443dfa75700a567b7a224` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:19:19.240990 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6262ef46-ddf2-4d03-877c-c3451ff84363 None admin] RBAC: Authorizing `identity:get_domain(domain_id=cdaccb43218443dfa75700a567b7a224)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:19:19.242478 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6262ef46-ddf2-4d03-877c-c3451ff84363 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:19:19.244058 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 583/1172] 10.222.0.26 () {56 vars in 1183 bytes} [Fri Aug 12 01:19:19 2022] GET /identity/v3/domains/cdaccb43218443dfa75700a567b7a224 => generated 267 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:19:19.251612 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a16fe45-e193-4769-a2c0-594698682e85 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:19:19.371621 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a16fe45-e193-4769-a2c0-594698682e85 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:19:19.382279 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:19:19.407695 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df551c25-29be-41aa-ae30-543a2bdf76fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:19:19.408292 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df551c25-29be-41aa-ae30-543a2bdf76fc None admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:19:19.408570 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df551c25-29be-41aa-ae30-543a2bdf76fc None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:19:19.408844 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df551c25-29be-41aa-ae30-543a2bdf76fc None admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:19:19.409480 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df551c25-29be-41aa-ae30-543a2bdf76fc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:19:19.411249 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df551c25-29be-41aa-ae30-543a2bdf76fc None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:19:19.440079 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 590/1173] 10.222.0.26 () {60 vars in 1141 bytes} [Fri Aug 12 01:19:19 2022] POST /identity/v3/projects => generated 361 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:19:21.367841 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aac27c-a357-42ff-93be-eafc180dbcca None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:19:21.368415 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aac27c-a357-42ff-93be-eafc180dbcca None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:19:21.368415 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aac27c-a357-42ff-93be-eafc180dbcca None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:19:21.370422 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 584/1174] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:19:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:19:21.376083 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291cb05-4416-4ebf-9739-fb0960a546ee None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:19:21.376531 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291cb05-4416-4ebf-9739-fb0960a546ee None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:19:21.376623 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291cb05-4416-4ebf-9739-fb0960a546ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:19:21.395028 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-b291cb05-4416-4ebf-9739-fb0960a546ee None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:19:21.396200 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-b291cb05-4416-4ebf-9739-fb0960a546ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:19:21.466305 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 591/1175] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:19:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 01:19:21.739268 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aac27c-a357-42ff-93be-eafc180dbcca None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:19:21.757866 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:19:21.869132 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aac27c-a357-42ff-93be-eafc180dbcca None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:19:21.912623 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1193800-e492-4b2b-b3e5-31795c1f0f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:19:21.913870 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1193800-e492-4b2b-b3e5-31795c1f0f06 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:19:21.914236 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1193800-e492-4b2b-b3e5-31795c1f0f06 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:19:21.914572 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1193800-e492-4b2b-b3e5-31795c1f0f06 None admin] PATH_INFO: `/v3/domains/cdaccb43218443dfa75700a567b7a224` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:19:21.916282 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1193800-e492-4b2b-b3e5-31795c1f0f06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=cdaccb43218443dfa75700a567b7a224)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:19:21.917723 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1193800-e492-4b2b-b3e5-31795c1f0f06 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:19:21.919429 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 585/1176] 10.222.0.26 () {56 vars in 1183 bytes} [Fri Aug 12 01:19:21 2022] GET /identity/v3/domains/cdaccb43218443dfa75700a567b7a224 => generated 267 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:19:21.926016 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b291cb05-4416-4ebf-9739-fb0960a546ee None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:19:22.053811 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:19:22.068242 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b291cb05-4416-4ebf-9739-fb0960a546ee None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:19:22.108118 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fc4fd3-fad2-40ba-95a4-c631baf778b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:19:22.108716 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc4fd3-fad2-40ba-95a4-c631baf778b3 None admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:19:22.108982 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc4fd3-fad2-40ba-95a4-c631baf778b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:19:22.109247 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc4fd3-fad2-40ba-95a4-c631baf778b3 None admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:19:22.109884 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fc4fd3-fad2-40ba-95a4-c631baf778b3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:19:22.111329 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fc4fd3-fad2-40ba-95a4-c631baf778b3 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:19:22.142870 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 592/1177] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Aug 12 01:19:21 2022] POST /identity/v3/users => generated 311 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:19:24.119929 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c2067-25bb-4c31-b74a-6d1c563c16ae None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:19:24.120506 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c2067-25bb-4c31-b74a-6d1c563c16ae None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:19:24.120506 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c2067-25bb-4c31-b74a-6d1c563c16ae None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:19:24.121834 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 586/1178] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:19:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:19:24.128229 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b435468b-16a8-4dea-92f4-14ab6c44dbd7 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:19:24.128934 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b435468b-16a8-4dea-92f4-14ab6c44dbd7 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:19:24.129093 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b435468b-16a8-4dea-92f4-14ab6c44dbd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:19:24.151870 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-b435468b-16a8-4dea-92f4-14ab6c44dbd7 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:19:24.153317 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-b435468b-16a8-4dea-92f4-14ab6c44dbd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:19:24.237578 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 593/1179] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:19:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 01:19:24.503185 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208c2067-25bb-4c31-b74a-6d1c563c16ae None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:19:24.590107 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:19:24.610498 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208c2067-25bb-4c31-b74a-6d1c563c16ae None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:19:24.646329 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb29d8f-ec83-479e-8ec9-8ea42568dccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:19:24.646954 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb29d8f-ec83-479e-8ec9-8ea42568dccf None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:19:24.647226 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb29d8f-ec83-479e-8ec9-8ea42568dccf None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:19:24.647493 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb29d8f-ec83-479e-8ec9-8ea42568dccf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:19:24.657643 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb29d8f-ec83-479e-8ec9-8ea42568dccf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:19:24.662648 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-4cb29d8f-ec83-479e-8ec9-8ea42568dccf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 01:19:24.662648 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:19:24.662648 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:19:24.662648 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:19:24.662648 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:19:24.662648 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:19:24.662648 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:19:24.662648 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:19:24.662648 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:19:24.662648 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:19:24.662648 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:19:24.662648 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:19:24.662648 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:19:24.662648 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:19:24.662648 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:19:24.662648 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:19:24.663751 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:19:24.663751 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:19:24.663751 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:19:24.663751 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:19:24.663751 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:19:24.663751 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:19:24.663751 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:19:24.663751 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:19:24.663751 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:19:24.663751 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:19:24.663751 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:19:24.663751 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:19:24.663751 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:19:24.663751 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:19:24.663751 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:19:24.663751 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:19:24.664844 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:19:24.664844 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:19:24.664844 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:19:24.664844 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:19:24.664844 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:19:24.664844 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:19:24.664844 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:19:24.664844 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:19:24.664844 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:19:24.664844 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:19:24.664844 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 01:19:24.664844 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:19:24.666305 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 587/1180] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Aug 12 01:19:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:19:24.669964 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b435468b-16a8-4dea-92f4-14ab6c44dbd7 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:19:24.756558 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:19:24.781352 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b435468b-16a8-4dea-92f4-14ab6c44dbd7 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:19:24.817558 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d07184-a7f2-41e5-82dc-e11f0113da0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:19:24.818161 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d07184-a7f2-41e5-82dc-e11f0113da0e None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:19:24.818461 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d07184-a7f2-41e5-82dc-e11f0113da0e None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:19:24.818735 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d07184-a7f2-41e5-82dc-e11f0113da0e None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:19:24.819395 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d07184-a7f2-41e5-82dc-e11f0113da0e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:19:24.819701 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d07184-a7f2-41e5-82dc-e11f0113da0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:19:24.821061 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d07184-a7f2-41e5-82dc-e11f0113da0e None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:19:24.829186 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 594/1181] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 01:19:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:19:24.835908 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb29d8f-ec83-479e-8ec9-8ea42568dccf None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:19:24.947069 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb29d8f-ec83-479e-8ec9-8ea42568dccf None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:19:24.981988 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36df34f6-3f58-4d40-96f4-5da6788ce0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:19:24.982634 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df34f6-3f58-4d40-96f4-5da6788ce0a4 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:19:24.982912 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df34f6-3f58-4d40-96f4-5da6788ce0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:19:24.983186 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df34f6-3f58-4d40-96f4-5da6788ce0a4 None admin] PATH_INFO: `/v3/users/d059cafc990f42b783516a6e5a05cb64` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:19:24.994573 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:19:24.997497 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36df34f6-3f58-4d40-96f4-5da6788ce0a4 None admin] RBAC: Authorizing `identity:get_user(user_id=d059cafc990f42b783516a6e5a05cb64)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:19:24.999281 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36df34f6-3f58-4d40-96f4-5da6788ce0a4 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:19:25.000888 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 588/1182] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 01:19:24 2022] GET /identity/v3/users/d059cafc990f42b783516a6e5a05cb64 => generated 311 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:19:25.007770 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d07184-a7f2-41e5-82dc-e11f0113da0e None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:19:25.118181 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d07184-a7f2-41e5-82dc-e11f0113da0e None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:19:25.155825 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012723be-06d1-4f28-97dc-92933ee52945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:19:25.156422 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012723be-06d1-4f28-97dc-92933ee52945 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:19:25.156691 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012723be-06d1-4f28-97dc-92933ee52945 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:19:25.156960 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012723be-06d1-4f28-97dc-92933ee52945 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:19:25.167696 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:19:25.232613 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012723be-06d1-4f28-97dc-92933ee52945 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:19:25.234055 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012723be-06d1-4f28-97dc-92933ee52945 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:19:25.352380 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 595/1183] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 01:19:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 01:19:25.358696 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36df34f6-3f58-4d40-96f4-5da6788ce0a4 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:19:25.461189 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36df34f6-3f58-4d40-96f4-5da6788ce0a4 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:19:25.499625 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e18144-3a0f-4735-aa86-8db47b1d8af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:19:25.500255 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e18144-3a0f-4735-aa86-8db47b1d8af5 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:19:25.500532 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e18144-3a0f-4735-aa86-8db47b1d8af5 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:19:25.500799 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e18144-3a0f-4735-aa86-8db47b1d8af5 None admin] PATH_INFO: `/v3/projects/a86c6c59c2794df19fbd7e27c719e4b0` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:19:25.501916 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e18144-3a0f-4735-aa86-8db47b1d8af5 None admin] RBAC: Authorizing `identity:get_project(project_id=a86c6c59c2794df19fbd7e27c719e4b0)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:19:25.503394 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e18144-3a0f-4735-aa86-8db47b1d8af5 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:19:25.505038 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 589/1184] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 01:19:25 2022] GET /identity/v3/projects/a86c6c59c2794df19fbd7e27c719e4b0 => generated 361 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:19:25.513777 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012723be-06d1-4f28-97dc-92933ee52945 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:19:25.559637 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:19:25.618747 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012723be-06d1-4f28-97dc-92933ee52945 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:19:25.653504 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc087b6b-f665-434a-952f-3e8433152746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:19:25.654098 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc087b6b-f665-434a-952f-3e8433152746 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:19:25.654405 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc087b6b-f665-434a-952f-3e8433152746 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:19:25.654668 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc087b6b-f665-434a-952f-3e8433152746 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:19:25.655386 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc087b6b-f665-434a-952f-3e8433152746 None admin] RBAC: Adding query filter params (role.id=fb48693810be495fb4b1893a79429b78, scope.project.id=a86c6c59c2794df19fbd7e27c719e4b0, user.id=d059cafc990f42b783516a6e5a05cb64) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:19:25.655688 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc087b6b-f665-434a-952f-3e8433152746 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:19:25.657115 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc087b6b-f665-434a-952f-3e8433152746 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:19:25.662854 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 596/1185] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 01:19:25 2022] GET /identity/v3/role_assignments?user.id=d059cafc990f42b783516a6e5a05cb64&scope.project.id=a86c6c59c2794df19fbd7e27c719e4b0&role.id=fb48693810be495fb4b1893a79429b78 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:19:27.524067 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b855ca7d-d1ad-45dc-a9b6-1f75a337f594 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:19:27.524546 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b855ca7d-d1ad-45dc-a9b6-1f75a337f594 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:19:27.524546 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b855ca7d-d1ad-45dc-a9b6-1f75a337f594 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:19:27.525928 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 590/1186] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:19:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:19:27.532261 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e43c1-f2ad-4c24-a178-d0670aab6d86 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:19:27.532967 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e43c1-f2ad-4c24-a178-d0670aab6d86 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:19:27.533122 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e43c1-f2ad-4c24-a178-d0670aab6d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:19:27.562132 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-c82e43c1-f2ad-4c24-a178-d0670aab6d86 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:19:27.563338 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-c82e43c1-f2ad-4c24-a178-d0670aab6d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:19:27.632058 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 597/1187] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:19:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 01:19:27.899088 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b855ca7d-d1ad-45dc-a9b6-1f75a337f594 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:19:27.977871 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:19:28.013396 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b855ca7d-d1ad-45dc-a9b6-1f75a337f594 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:19:28.052169 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af9eb8a-b035-49be-b292-3128b873983e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:19:28.052786 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af9eb8a-b035-49be-b292-3128b873983e None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:19:28.053063 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af9eb8a-b035-49be-b292-3128b873983e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:19:28.053326 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af9eb8a-b035-49be-b292-3128b873983e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:19:28.067321 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af9eb8a-b035-49be-b292-3128b873983e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:19:28.071929 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-7af9eb8a-b035-49be-b292-3128b873983e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 01:19:28.071929 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:19:28.071929 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:19:28.071929 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:19:28.071929 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:19:28.071929 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:19:28.071929 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:19:28.071929 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:19:28.071929 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:19:28.071929 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:19:28.071929 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:19:28.071929 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:19:28.071929 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:19:28.071929 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:19:28.071929 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:19:28.071929 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:19:28.073047 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:19:28.073047 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:19:28.073047 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:19:28.073047 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:19:28.073047 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:19:28.073047 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:19:28.073047 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:19:28.073047 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:19:28.073047 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:19:28.073047 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:19:28.073047 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:19:28.073047 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:19:28.073047 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:19:28.073047 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:19:28.073047 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:19:28.073047 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:19:28.073926 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:19:28.073926 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:19:28.073926 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:19:28.073926 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:19:28.073926 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:19:28.073926 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:19:28.073926 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:19:28.073926 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:19:28.073926 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:19:28.073926 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:19:28.073926 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 01:19:28.073926 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:19:28.073926 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 591/1188] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Aug 12 01:19:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:19:28.079341 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82e43c1-f2ad-4c24-a178-d0670aab6d86 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:19:28.116108 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:19:28.185690 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82e43c1-f2ad-4c24-a178-d0670aab6d86 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:19:28.224387 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05974e4-14ad-4307-9a13-974e4708dc1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:19:28.224983 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05974e4-14ad-4307-9a13-974e4708dc1e None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:19:28.225255 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05974e4-14ad-4307-9a13-974e4708dc1e None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:19:28.225519 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05974e4-14ad-4307-9a13-974e4708dc1e None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:19:28.226178 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05974e4-14ad-4307-9a13-974e4708dc1e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:19:28.226494 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05974e4-14ad-4307-9a13-974e4708dc1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:19:28.227855 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05974e4-14ad-4307-9a13-974e4708dc1e None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:19:28.236062 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 598/1189] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 01:19:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:19:28.242559 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af9eb8a-b035-49be-b292-3128b873983e None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:19:28.348217 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af9eb8a-b035-49be-b292-3128b873983e None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:19:28.375597 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:19:28.384441 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92539dd4-40f9-43c3-be7b-1b85d4347ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:19:28.385056 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92539dd4-40f9-43c3-be7b-1b85d4347ff1 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:19:28.385330 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92539dd4-40f9-43c3-be7b-1b85d4347ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:19:28.385596 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92539dd4-40f9-43c3-be7b-1b85d4347ff1 None admin] PATH_INFO: `/v3/users/d059cafc990f42b783516a6e5a05cb64` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:19:28.387189 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92539dd4-40f9-43c3-be7b-1b85d4347ff1 None admin] RBAC: Authorizing `identity:get_user(user_id=d059cafc990f42b783516a6e5a05cb64)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:19:28.388611 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92539dd4-40f9-43c3-be7b-1b85d4347ff1 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:19:28.390154 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 592/1190] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 01:19:28 2022] GET /identity/v3/users/d059cafc990f42b783516a6e5a05cb64 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:19:28.396788 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05974e4-14ad-4307-9a13-974e4708dc1e None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:19:28.503604 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:19:28.510028 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05974e4-14ad-4307-9a13-974e4708dc1e None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:19:28.547748 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9846299-9cde-4053-a9b5-d82858548ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:19:28.548378 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9846299-9cde-4053-a9b5-d82858548ae9 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:19:28.548630 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9846299-9cde-4053-a9b5-d82858548ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:19:28.548904 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9846299-9cde-4053-a9b5-d82858548ae9 None admin] PATH_INFO: `/v3/projects/a86c6c59c2794df19fbd7e27c719e4b0` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:19:28.550154 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9846299-9cde-4053-a9b5-d82858548ae9 None admin] RBAC: Authorizing `identity:get_project(project_id=a86c6c59c2794df19fbd7e27c719e4b0)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:19:28.551588 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9846299-9cde-4053-a9b5-d82858548ae9 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:19:28.553226 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 599/1191] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 01:19:28 2022] GET /identity/v3/projects/a86c6c59c2794df19fbd7e27c719e4b0 => generated 361 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:19:28.560012 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92539dd4-40f9-43c3-be7b-1b85d4347ff1 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:19:28.663799 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92539dd4-40f9-43c3-be7b-1b85d4347ff1 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:19:28.698464 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5033b7a1-98ca-4391-b709-8b6dd6106cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:19:28.699161 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5033b7a1-98ca-4391-b709-8b6dd6106cef None admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:19:28.699438 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5033b7a1-98ca-4391-b709-8b6dd6106cef None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:19:28.699710 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5033b7a1-98ca-4391-b709-8b6dd6106cef None admin] PATH_INFO: `/v3/projects/a86c6c59c2794df19fbd7e27c719e4b0/users/d059cafc990f42b783516a6e5a05cb64/roles/fb48693810be495fb4b1893a79429b78` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:19:28.701689 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5033b7a1-98ca-4391-b709-8b6dd6106cef None admin] RBAC: Authorizing `identity:create_grant(project_id=a86c6c59c2794df19fbd7e27c719e4b0, user_id=d059cafc990f42b783516a6e5a05cb64, role_id=fb48693810be495fb4b1893a79429b78)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:19:28.703135 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5033b7a1-98ca-4391-b709-8b6dd6106cef None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:19:28.724422 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 593/1192] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Aug 12 01:19:28 2022] PUT /identity/v3/projects/a86c6c59c2794df19fbd7e27c719e4b0/users/d059cafc990f42b783516a6e5a05cb64/roles/fb48693810be495fb4b1893a79429b78 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:19:30.556282 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78601adf-d46a-4aa7-a5c7-9be42e0994b7 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:19:30.557091 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78601adf-d46a-4aa7-a5c7-9be42e0994b7 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:19:30.557091 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78601adf-d46a-4aa7-a5c7-9be42e0994b7 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:19:30.558697 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 600/1193] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:19:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:19:30.564254 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26091ef4-c6d5-49af-b549-f76ff45fbd65 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:19:30.564698 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26091ef4-c6d5-49af-b549-f76ff45fbd65 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:19:30.564795 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26091ef4-c6d5-49af-b549-f76ff45fbd65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:19:30.583648 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-26091ef4-c6d5-49af-b549-f76ff45fbd65 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:19:30.584803 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-26091ef4-c6d5-49af-b549-f76ff45fbd65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:19:30.639332 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:19:30.660155 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 594/1194] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:19:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 12 01:19:30.928140 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78601adf-d46a-4aa7-a5c7-9be42e0994b7 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:19:31.036745 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78601adf-d46a-4aa7-a5c7-9be42e0994b7 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:19:31.072972 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8de06b-879a-4c04-9c6a-6ad7f9065420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:19:31.073803 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8de06b-879a-4c04-9c6a-6ad7f9065420 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:19:31.074081 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8de06b-879a-4c04-9c6a-6ad7f9065420 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:19:31.074390 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8de06b-879a-4c04-9c6a-6ad7f9065420 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:19:31.086727 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8de06b-879a-4c04-9c6a-6ad7f9065420 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:19:31.091439 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-3e8de06b-879a-4c04-9c6a-6ad7f9065420 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 01:19:31.091439 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:19:31.091439 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:19:31.091439 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:19:31.091439 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:19:31.091439 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:19:31.091439 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:19:31.091439 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:19:31.091439 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:19:31.091439 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:19:31.091439 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:19:31.091439 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:19:31.091439 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:19:31.091439 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:19:31.091439 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:19:31.091439 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:19:31.092598 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:19:31.092598 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:19:31.092598 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:19:31.092598 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:19:31.092598 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:19:31.092598 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:19:31.092598 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:19:31.092598 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:19:31.092598 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:19:31.092598 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:19:31.092598 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:19:31.092598 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:19:31.092598 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:19:31.092598 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:19:31.092598 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:19:31.092598 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:19:31.093543 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:19:31.093543 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:19:31.093543 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:19:31.093543 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:19:31.093543 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:19:31.093543 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:19:31.093543 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:19:31.093543 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:19:31.093543 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:19:31.093543 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:19:31.093543 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 01:19:31.093543 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:19:31.097494 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 601/1195] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Aug 12 01:19:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:19:31.098712 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26091ef4-c6d5-49af-b549-f76ff45fbd65 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:19:31.217816 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26091ef4-c6d5-49af-b549-f76ff45fbd65 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:19:31.254769 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1044f7-8875-4d11-a668-401780e74dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:19:31.255376 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1044f7-8875-4d11-a668-401780e74dd5 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:19:31.255653 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1044f7-8875-4d11-a668-401780e74dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:19:31.255921 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1044f7-8875-4d11-a668-401780e74dd5 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:19:31.256580 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1044f7-8875-4d11-a668-401780e74dd5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:19:31.256882 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1044f7-8875-4d11-a668-401780e74dd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:19:31.258282 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1044f7-8875-4d11-a668-401780e74dd5 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:19:31.267114 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 595/1196] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 01:19:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:19:31.275971 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8de06b-879a-4c04-9c6a-6ad7f9065420 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:19:31.306717 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:19:31.399905 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8de06b-879a-4c04-9c6a-6ad7f9065420 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:19:31.440447 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3de08d3-91f2-4fb6-9bcb-365af165cbfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:19:31.441074 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de08d3-91f2-4fb6-9bcb-365af165cbfd None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:19:31.441351 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de08d3-91f2-4fb6-9bcb-365af165cbfd None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:19:31.441620 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de08d3-91f2-4fb6-9bcb-365af165cbfd None admin] PATH_INFO: `/v3/users/d059cafc990f42b783516a6e5a05cb64` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:19:31.443506 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3de08d3-91f2-4fb6-9bcb-365af165cbfd None admin] RBAC: Authorizing `identity:get_user(user_id=d059cafc990f42b783516a6e5a05cb64)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:19:31.445900 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3de08d3-91f2-4fb6-9bcb-365af165cbfd None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:19:31.448477 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 602/1197] 10.222.0.26 () {56 vars in 1177 bytes} [Fri Aug 12 01:19:31 2022] GET /identity/v3/users/d059cafc990f42b783516a6e5a05cb64 => generated 311 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:19:31.454621 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1044f7-8875-4d11-a668-401780e74dd5 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:19:31.507193 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:19:31.562696 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1044f7-8875-4d11-a668-401780e74dd5 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:19:31.597497 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc29725-e535-4c25-ad33-f392bfa935d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:19:31.598077 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc29725-e535-4c25-ad33-f392bfa935d1 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:19:31.598447 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc29725-e535-4c25-ad33-f392bfa935d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:19:31.598714 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc29725-e535-4c25-ad33-f392bfa935d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:19:31.669615 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc29725-e535-4c25-ad33-f392bfa935d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:19:31.671075 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc29725-e535-4c25-ad33-f392bfa935d1 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:19:31.730837 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:19:31.785012 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 596/1198] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 01:19:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 01:19:31.791656 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3de08d3-91f2-4fb6-9bcb-365af165cbfd None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:19:31.887714 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:19:31.898657 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3de08d3-91f2-4fb6-9bcb-365af165cbfd None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:19:31.936965 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ecaf0-3db5-4b6b-bcf9-939868b29be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:19:31.937578 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ecaf0-3db5-4b6b-bcf9-939868b29be4 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:19:31.937849 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ecaf0-3db5-4b6b-bcf9-939868b29be4 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:19:31.938149 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ecaf0-3db5-4b6b-bcf9-939868b29be4 None admin] PATH_INFO: `/v3/projects/a86c6c59c2794df19fbd7e27c719e4b0` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:19:31.939349 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117ecaf0-3db5-4b6b-bcf9-939868b29be4 None admin] RBAC: Authorizing `identity:get_project(project_id=a86c6c59c2794df19fbd7e27c719e4b0)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:19:31.940770 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117ecaf0-3db5-4b6b-bcf9-939868b29be4 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:19:31.942422 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 603/1199] 10.222.0.26 () {56 vars in 1186 bytes} [Fri Aug 12 01:19:31 2022] GET /identity/v3/projects/a86c6c59c2794df19fbd7e27c719e4b0 => generated 361 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:19:31.948868 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc29725-e535-4c25-ad33-f392bfa935d1 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:19:32.050230 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc29725-e535-4c25-ad33-f392bfa935d1 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:19:32.084656 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e088391a-ecb9-48e5-b300-09fc464978c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:19:32.085248 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e088391a-ecb9-48e5-b300-09fc464978c5 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:19:32.085513 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e088391a-ecb9-48e5-b300-09fc464978c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:19:32.085777 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e088391a-ecb9-48e5-b300-09fc464978c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:19:32.086512 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e088391a-ecb9-48e5-b300-09fc464978c5 None admin] RBAC: Adding query filter params (role.id=fb48693810be495fb4b1893a79429b78, scope.project.id=a86c6c59c2794df19fbd7e27c719e4b0, user.id=d059cafc990f42b783516a6e5a05cb64) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:19:32.086806 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e088391a-ecb9-48e5-b300-09fc464978c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:19:32.088207 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e088391a-ecb9-48e5-b300-09fc464978c5 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:19:32.093983 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 597/1200] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 01:19:31 2022] GET /identity/v3/role_assignments?user.id=d059cafc990f42b783516a6e5a05cb64&scope.project.id=a86c6c59c2794df19fbd7e27c719e4b0&role.id=fb48693810be495fb4b1893a79429b78 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:19:41.931716 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=20 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:19:42.091417 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=94 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:20:27.335107 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb586f-60f1-4099-b036-1996cdf451bc None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:27.335726 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb586f-60f1-4099-b036-1996cdf451bc None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:27.335726 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb586f-60f1-4099-b036-1996cdf451bc None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:27.337375 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 604/1201] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:20:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:20:27.343469 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01899605-cb6c-4e4a-8847-2be6b0da25a8 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:27.343959 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01899605-cb6c-4e4a-8847-2be6b0da25a8 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:27.344261 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01899605-cb6c-4e4a-8847-2be6b0da25a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:27.367049 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-01899605-cb6c-4e4a-8847-2be6b0da25a8 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:20:27.370135 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-01899605-cb6c-4e4a-8847-2be6b0da25a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:20:27.457709 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 598/1202] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:20:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 01:20:27.738701 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbb586f-60f1-4099-b036-1996cdf451bc None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:20:27.859784 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbb586f-60f1-4099-b036-1996cdf451bc None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:20:27.898409 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13966932-f581-4e71-81c8-b4d833db26cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:20:27.899623 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13966932-f581-4e71-81c8-b4d833db26cd None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:27.900037 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13966932-f581-4e71-81c8-b4d833db26cd None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:27.900416 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13966932-f581-4e71-81c8-b4d833db26cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:27.917214 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13966932-f581-4e71-81c8-b4d833db26cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:20:27.918769 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13966932-f581-4e71-81c8-b4d833db26cd None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:20:27.936233 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-13966932-f581-4e71-81c8-b4d833db26cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:20:27.936233 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:20:27.936233 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:20:27.936233 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:20:27.936233 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:20:27.936233 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:20:27.936233 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:20:27.936233 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:20:27.936233 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:20:27.936233 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:20:27.936233 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:20:27.936233 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:20:27.936233 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 01:20:27.936233 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 01:20:27.936233 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 01:20:27.936233 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 01:20:27.937358 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:20:27.937358 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:20:27.937358 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:20:27.937358 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:20:27.937358 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:20:27.937358 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:20:27.937358 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:20:27.937358 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:20:27.937358 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:20:27.937358 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:20:27.937358 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:20:27.937358 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:20:27.937358 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:20:27.937358 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:20:27.937358 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:20:27.937358 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:20:27.937358 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 01:20:27.938433 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 01:20:27.938433 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:20:27.938433 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:20:27.938433 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 605/1203] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:20:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 01:20:27.944303 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01899605-cb6c-4e4a-8847-2be6b0da25a8 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:20:28.085624 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01899605-cb6c-4e4a-8847-2be6b0da25a8 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:20:28.121148 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:20:28.128578 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27beee3-e894-4a09-bf56-06191417fd32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:20:28.129465 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27beee3-e894-4a09-bf56-06191417fd32 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:28.129771 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27beee3-e894-4a09-bf56-06191417fd32 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:28.130070 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27beee3-e894-4a09-bf56-06191417fd32 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:28.130804 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27beee3-e894-4a09-bf56-06191417fd32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:20:28.131124 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27beee3-e894-4a09-bf56-06191417fd32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:20:28.132860 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27beee3-e894-4a09-bf56-06191417fd32 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:20:28.150201 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 599/1204] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 01:20:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:20:28.156567 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13966932-f581-4e71-81c8-b4d833db26cd None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:20:28.227357 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:20:28.283669 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13966932-f581-4e71-81c8-b4d833db26cd None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:20:28.330249 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c02a903-18ad-4139-b39c-8adf47aeee01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:20:28.331022 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02a903-18ad-4139-b39c-8adf47aeee01 None admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:28.331538 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02a903-18ad-4139-b39c-8adf47aeee01 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:28.331875 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02a903-18ad-4139-b39c-8adf47aeee01 None admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:28.333452 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c02a903-18ad-4139-b39c-8adf47aeee01 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:20:28.338159 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c02a903-18ad-4139-b39c-8adf47aeee01 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:20:28.366680 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 606/1205] 10.222.0.26 () {60 vars in 1132 bytes} [Fri Aug 12 01:20:28 2022] POST /identity/v3/users => generated 251 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:20:30.488531 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4405993-9823-40e9-9c67-dda8bbb9c5e2 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:30.489683 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4405993-9823-40e9-9c67-dda8bbb9c5e2 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:30.489683 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4405993-9823-40e9-9c67-dda8bbb9c5e2 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:30.491184 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 600/1206] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:20:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:20:30.496245 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a75e6-b001-4d6a-bae7-844914a98f27 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:30.496677 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a75e6-b001-4d6a-bae7-844914a98f27 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:30.496843 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a75e6-b001-4d6a-bae7-844914a98f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:30.517502 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-2b6a75e6-b001-4d6a-bae7-844914a98f27 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:20:30.518742 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-2b6a75e6-b001-4d6a-bae7-844914a98f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:20:30.598334 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 607/1207] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:20:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 01:20:30.867139 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4405993-9823-40e9-9c67-dda8bbb9c5e2 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:20:30.980474 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4405993-9823-40e9-9c67-dda8bbb9c5e2 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:20:31.027585 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8719d1f1-6a42-4b37-9071-b762b6aad156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:20:31.028361 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8719d1f1-6a42-4b37-9071-b762b6aad156 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:31.028721 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8719d1f1-6a42-4b37-9071-b762b6aad156 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:31.029293 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8719d1f1-6a42-4b37-9071-b762b6aad156 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:31.041422 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8719d1f1-6a42-4b37-9071-b762b6aad156 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:20:31.046925 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-8719d1f1-6a42-4b37-9071-b762b6aad156 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 01:20:31.046925 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:20:31.046925 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:20:31.046925 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:20:31.046925 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:20:31.046925 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:20:31.046925 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:20:31.046925 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:20:31.046925 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:20:31.046925 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:20:31.046925 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:20:31.046925 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:20:31.046925 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:20:31.046925 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:20:31.046925 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:20:31.046925 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:20:31.047964 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:20:31.047964 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:20:31.047964 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:20:31.047964 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:20:31.047964 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:20:31.047964 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:20:31.047964 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:20:31.047964 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:20:31.047964 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:20:31.047964 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:20:31.047964 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:20:31.047964 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:20:31.047964 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:20:31.047964 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:20:31.047964 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:20:31.047964 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:20:31.048833 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:20:31.048833 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:20:31.048833 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:20:31.048833 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:20:31.048833 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:20:31.048833 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:20:31.048833 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:20:31.048833 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:20:31.048833 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:20:31.048833 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:20:31.048833 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 01:20:31.048833 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:20:31.048833 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 601/1208] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Aug 12 01:20:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:20:31.056649 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6a75e6-b001-4d6a-bae7-844914a98f27 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:20:31.096980 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:20:31.176654 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6a75e6-b001-4d6a-bae7-844914a98f27 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:20:31.224403 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba280e6c-dfa3-4b78-a38a-d0d08d3f8af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:20:31.225024 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba280e6c-dfa3-4b78-a38a-d0d08d3f8af5 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:31.225301 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba280e6c-dfa3-4b78-a38a-d0d08d3f8af5 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:31.225573 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba280e6c-dfa3-4b78-a38a-d0d08d3f8af5 None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:31.226342 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba280e6c-dfa3-4b78-a38a-d0d08d3f8af5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:20:31.226717 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba280e6c-dfa3-4b78-a38a-d0d08d3f8af5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:20:31.228307 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba280e6c-dfa3-4b78-a38a-d0d08d3f8af5 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:20:31.238764 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 608/1209] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Aug 12 01:20:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:20:31.245935 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8719d1f1-6a42-4b37-9071-b762b6aad156 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:20:31.312328 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:20:31.380443 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8719d1f1-6a42-4b37-9071-b762b6aad156 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:20:31.428060 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9a8718-07d8-455a-88be-0534e96d734e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:20:31.428625 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a8718-07d8-455a-88be-0534e96d734e None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:31.428901 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a8718-07d8-455a-88be-0534e96d734e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:31.429170 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a8718-07d8-455a-88be-0534e96d734e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:31.443778 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9a8718-07d8-455a-88be-0534e96d734e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:20:31.445277 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9a8718-07d8-455a-88be-0534e96d734e None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:20:31.461044 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-6c9a8718-07d8-455a-88be-0534e96d734e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:20:31.461044 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:20:31.461044 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:20:31.461044 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:20:31.461044 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:20:31.461044 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:20:31.461044 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:20:31.461044 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:20:31.461044 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:20:31.461044 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:20:31.461044 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:20:31.461044 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:20:31.461044 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 01:20:31.461044 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 01:20:31.461044 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 01:20:31.461044 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 01:20:31.462050 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:20:31.462050 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:20:31.462050 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:20:31.462050 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:20:31.462050 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:20:31.462050 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:20:31.462050 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:20:31.462050 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:20:31.462050 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:20:31.462050 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:20:31.462050 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:20:31.462050 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:20:31.462050 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:20:31.462050 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:20:31.462050 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:20:31.462050 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:20:31.462050 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 01:20:31.462965 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 01:20:31.462965 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:20:31.462965 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:20:31.462965 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 602/1210] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:20:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:20:31.467549 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba280e6c-dfa3-4b78-a38a-d0d08d3f8af5 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:20:31.588046 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:20:31.591610 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba280e6c-dfa3-4b78-a38a-d0d08d3f8af5 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:20:31.635210 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dfa964-919b-402d-b8bf-0a04a4182ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:20:31.635964 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dfa964-919b-402d-b8bf-0a04a4182ad6 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:31.636244 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dfa964-919b-402d-b8bf-0a04a4182ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:31.636551 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dfa964-919b-402d-b8bf-0a04a4182ad6 None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:31.637308 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dfa964-919b-402d-b8bf-0a04a4182ad6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:20:31.637677 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dfa964-919b-402d-b8bf-0a04a4182ad6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:20:31.639170 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dfa964-919b-402d-b8bf-0a04a4182ad6 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:20:31.652569 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 609/1211] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 01:20:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:20:31.658657 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9a8718-07d8-455a-88be-0534e96d734e None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:20:31.785147 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9a8718-07d8-455a-88be-0534e96d734e None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:20:31.786795 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:20:31.825859 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdba135-7a4d-4ea0-93c3-79fb7a038065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:20:31.826559 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdba135-7a4d-4ea0-93c3-79fb7a038065 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:31.826834 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdba135-7a4d-4ea0-93c3-79fb7a038065 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:31.827109 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdba135-7a4d-4ea0-93c3-79fb7a038065 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:31.835669 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdba135-7a4d-4ea0-93c3-79fb7a038065 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:20:31.837254 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdba135-7a4d-4ea0-93c3-79fb7a038065 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:20:31.855078 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-8fdba135-7a4d-4ea0-93c3-79fb7a038065 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 12 01:20:31.855078 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:20:31.855078 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:20:31.855078 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:20:31.855078 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:20:31.855078 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:20:31.855078 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:20:31.855078 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:20:31.855078 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:20:31.855078 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:20:31.855078 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:20:31.855078 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:20:31.855078 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 01:20:31.855078 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 01:20:31.855078 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 01:20:31.855078 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 01:20:31.856115 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:20:31.856115 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:20:31.856115 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 01:20:31.856115 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 01:20:31.856115 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 01:20:31.856115 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 01:20:31.856115 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:20:31.856115 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:20:31.856115 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:20:31.856115 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:20:31.856115 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:20:31.856115 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:20:31.856115 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:20:31.856115 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:20:31.856115 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:20:31.856115 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:20:31.856115 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:20:31.856115 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:20:31.857102 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:20:31.857102 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:20:31.857102 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 01:20:31.857102 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 01:20:31.857102 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 01:20:31.857102 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 01:20:31.857102 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 01:20:31.857102 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 01:20:31.857102 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 12 01:20:31.857102 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:20:31.857102 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 603/1212] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:20:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 01:20:31.857733 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dfa964-919b-402d-b8bf-0a04a4182ad6 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:20:31.972502 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dfa964-919b-402d-b8bf-0a04a4182ad6 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:20:32.013493 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d14517-2682-44ba-b9b8-5e374c0d136a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:20:32.014133 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d14517-2682-44ba-b9b8-5e374c0d136a None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:32.014416 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d14517-2682-44ba-b9b8-5e374c0d136a None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:32.014897 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d14517-2682-44ba-b9b8-5e374c0d136a None admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:32.015618 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d14517-2682-44ba-b9b8-5e374c0d136a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:20:32.016016 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d14517-2682-44ba-b9b8-5e374c0d136a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:20:32.017460 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d14517-2682-44ba-b9b8-5e374c0d136a None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:20:32.038028 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 610/1213] 10.222.0.26 () {56 vars in 1143 bytes} [Fri Aug 12 01:20:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:20:32.045817 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdba135-7a4d-4ea0-93c3-79fb7a038065 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:20:32.167750 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdba135-7a4d-4ea0-93c3-79fb7a038065 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:20:32.211683 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856b696c-3c75-4d42-a5d7-94a4931fbc5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:20:32.212315 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856b696c-3c75-4d42-a5d7-94a4931fbc5f None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:32.212586 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856b696c-3c75-4d42-a5d7-94a4931fbc5f None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:32.212848 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856b696c-3c75-4d42-a5d7-94a4931fbc5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:32.248551 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:20:32.296619 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856b696c-3c75-4d42-a5d7-94a4931fbc5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:20:32.298604 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856b696c-3c75-4d42-a5d7-94a4931fbc5f None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:20:32.443146 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 604/1214] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 01:20:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 01:20:32.448946 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d14517-2682-44ba-b9b8-5e374c0d136a None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:20:32.472149 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:20:32.586230 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d14517-2682-44ba-b9b8-5e374c0d136a None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:20:32.625875 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3977f1c9-d849-4655-908a-14d5d2e94658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:20:32.626662 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3977f1c9-d849-4655-908a-14d5d2e94658 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:32.626867 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3977f1c9-d849-4655-908a-14d5d2e94658 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:32.627081 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3977f1c9-d849-4655-908a-14d5d2e94658 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:32.638869 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3977f1c9-d849-4655-908a-14d5d2e94658 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:20:32.640652 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3977f1c9-d849-4655-908a-14d5d2e94658 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:20:32.657549 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-3977f1c9-d849-4655-908a-14d5d2e94658 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:20:32.657549 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:20:32.657549 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:20:32.657549 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:20:32.657549 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:20:32.657549 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:20:32.657549 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:20:32.657549 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:20:32.657549 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:20:32.657549 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:20:32.657549 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:20:32.657549 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:20:32.657549 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 01:20:32.657549 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 01:20:32.657549 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 01:20:32.657549 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 01:20:32.658721 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:20:32.658721 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:20:32.658721 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:20:32.658721 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:20:32.658721 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:20:32.658721 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:20:32.658721 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:20:32.658721 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:20:32.658721 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:20:32.658721 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:20:32.658721 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:20:32.658721 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:20:32.658721 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:20:32.658721 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:20:32.658721 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:20:32.658721 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:20:32.658721 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 01:20:32.659746 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 01:20:32.659746 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:20:32.659746 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:20:32.659746 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 611/1215] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:20:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 01:20:32.664492 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856b696c-3c75-4d42-a5d7-94a4931fbc5f None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:20:32.727546 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:20:32.772372 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856b696c-3c75-4d42-a5d7-94a4931fbc5f None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:20:32.809892 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc6ad29-c5e9-4491-b944-f0c937746c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:20:32.810608 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6ad29-c5e9-4491-b944-f0c937746c53 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:32.810894 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6ad29-c5e9-4491-b944-f0c937746c53 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:32.811145 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6ad29-c5e9-4491-b944-f0c937746c53 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:32.811850 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc6ad29-c5e9-4491-b944-f0c937746c53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:20:32.812166 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc6ad29-c5e9-4491-b944-f0c937746c53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:20:32.813535 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc6ad29-c5e9-4491-b944-f0c937746c53 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:20:32.826147 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 605/1216] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 01:20:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:20:32.831837 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3977f1c9-d849-4655-908a-14d5d2e94658 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:20:32.919517 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:20:32.953256 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3977f1c9-d849-4655-908a-14d5d2e94658 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:20:32.987591 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b1cca4-d156-4e97-b046-b64b67436fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:20:32.988363 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b1cca4-d156-4e97-b046-b64b67436fc8 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:32.988728 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b1cca4-d156-4e97-b046-b64b67436fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:32.989012 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b1cca4-d156-4e97-b046-b64b67436fc8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:32.996332 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b1cca4-d156-4e97-b046-b64b67436fc8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:20:32.997852 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b1cca4-d156-4e97-b046-b64b67436fc8 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:20:33.009956 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-26b1cca4-d156-4e97-b046-b64b67436fc8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 01:20:33.009956 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:20:33.009956 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:20:33.009956 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:20:33.009956 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:20:33.009956 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:20:33.009956 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:20:33.009956 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:20:33.009956 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:20:33.009956 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:20:33.009956 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:20:33.009956 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:20:33.009956 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 01:20:33.009956 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 01:20:33.009956 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 01:20:33.011022 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 01:20:33.011022 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:20:33.011022 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:20:33.011022 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:20:33.011022 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:20:33.011022 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:20:33.011022 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:20:33.011022 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:20:33.011022 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:20:33.011022 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:20:33.011022 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:20:33.011022 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:20:33.011022 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:20:33.011022 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:20:33.011022 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:20:33.011022 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:20:33.011022 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:20:33.012279 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 01:20:33.012279 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 01:20:33.012279 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 01:20:33.012279 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 01:20:33.012279 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 01:20:33.012279 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 01:20:33.012279 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 01:20:33.012279 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:20:33.012279 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 612/1217] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 01:20:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 01:20:33.017168 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc6ad29-c5e9-4491-b944-f0c937746c53 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:20:33.122442 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc6ad29-c5e9-4491-b944-f0c937746c53 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:20:33.146657 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:20:33.160257 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0d38e7-ac88-44eb-9a2d-dace7902217e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:20:33.161142 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d38e7-ac88-44eb-9a2d-dace7902217e None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:33.161487 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d38e7-ac88-44eb-9a2d-dace7902217e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:33.161777 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d38e7-ac88-44eb-9a2d-dace7902217e None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:33.162503 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0d38e7-ac88-44eb-9a2d-dace7902217e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:20:33.162804 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0d38e7-ac88-44eb-9a2d-dace7902217e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:20:33.164341 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0d38e7-ac88-44eb-9a2d-dace7902217e None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:20:33.178874 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 606/1218] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Aug 12 01:20:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:20:33.185904 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b1cca4-d156-4e97-b046-b64b67436fc8 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:20:33.312777 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b1cca4-d156-4e97-b046-b64b67436fc8 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:20:33.345798 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:20:33.352250 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a7446-60ff-41c9-a33a-4dbde7074183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:20:33.352884 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a7446-60ff-41c9-a33a-4dbde7074183 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:33.353154 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a7446-60ff-41c9-a33a-4dbde7074183 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:33.353421 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a7446-60ff-41c9-a33a-4dbde7074183 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:33.354160 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16a7446-60ff-41c9-a33a-4dbde7074183 None admin] RBAC: Adding query filter params (role.id=90d1ca7df8de4b03a689afc664d0cc3f, scope.project.id=fa91143910a74c6b896ced5b51f9966a, user.id=06dccf61c686414d904bdf1ecf19d53d) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:20:33.354464 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16a7446-60ff-41c9-a33a-4dbde7074183 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:20:33.355886 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16a7446-60ff-41c9-a33a-4dbde7074183 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:20:33.361991 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 613/1219] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 01:20:33 2022] GET /identity/v3/role_assignments?user.id=06dccf61c686414d904bdf1ecf19d53d&scope.project.id=fa91143910a74c6b896ced5b51f9966a&role.id=90d1ca7df8de4b03a689afc664d0cc3f => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:20:35.368416 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b318f6a-4f41-4bdc-9b1a-fd5239667d51 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:35.368959 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b318f6a-4f41-4bdc-9b1a-fd5239667d51 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:35.368959 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b318f6a-4f41-4bdc-9b1a-fd5239667d51 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:35.370307 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 607/1220] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:20:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:20:35.375904 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b844350a-6913-4afb-a986-2c607754dbb6 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:35.376418 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b844350a-6913-4afb-a986-2c607754dbb6 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:35.376418 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b844350a-6913-4afb-a986-2c607754dbb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:35.395215 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-b844350a-6913-4afb-a986-2c607754dbb6 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:20:35.396453 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-b844350a-6913-4afb-a986-2c607754dbb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:20:35.470209 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 614/1221] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:20:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 01:20:35.742262 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b318f6a-4f41-4bdc-9b1a-fd5239667d51 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:20:35.858012 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b318f6a-4f41-4bdc-9b1a-fd5239667d51 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:20:35.894307 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400e2681-299d-40ec-b052-71e17df1394e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:20:35.894948 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e2681-299d-40ec-b052-71e17df1394e None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:35.895157 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e2681-299d-40ec-b052-71e17df1394e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:35.895426 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e2681-299d-40ec-b052-71e17df1394e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:35.905833 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400e2681-299d-40ec-b052-71e17df1394e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:20:35.910957 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-400e2681-299d-40ec-b052-71e17df1394e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 01:20:35.910957 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:20:35.910957 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:20:35.910957 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:20:35.910957 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:20:35.910957 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:20:35.910957 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:20:35.910957 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:20:35.910957 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:20:35.910957 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:20:35.910957 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:20:35.910957 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:20:35.910957 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:20:35.910957 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:20:35.910957 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:20:35.910957 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:20:35.912200 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:20:35.912200 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:20:35.912200 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:20:35.912200 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:20:35.912200 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:20:35.912200 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:20:35.912200 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:20:35.912200 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:20:35.912200 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:20:35.912200 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:20:35.912200 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:20:35.912200 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:20:35.912200 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:20:35.912200 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:20:35.912200 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:20:35.912200 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:20:35.913368 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:20:35.913368 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:20:35.913368 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:20:35.913368 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:20:35.913368 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:20:35.913368 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:20:35.913368 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:20:35.913368 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:20:35.913368 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:20:35.913368 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:20:35.913368 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 01:20:35.913368 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:20:35.913368 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 608/1222] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Aug 12 01:20:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:20:35.918401 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b844350a-6913-4afb-a986-2c607754dbb6 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:20:36.021844 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b844350a-6913-4afb-a986-2c607754dbb6 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:20:36.047219 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:20:36.059988 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e282200d-8448-4bf6-9ebe-c69839197940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:20:36.060616 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282200d-8448-4bf6-9ebe-c69839197940 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:36.060896 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282200d-8448-4bf6-9ebe-c69839197940 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:36.061168 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282200d-8448-4bf6-9ebe-c69839197940 None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:36.061872 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e282200d-8448-4bf6-9ebe-c69839197940 None admin] RBAC: Adding query filter params (name=service) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:20:36.062206 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e282200d-8448-4bf6-9ebe-c69839197940 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:20:36.063576 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e282200d-8448-4bf6-9ebe-c69839197940 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:20:36.072042 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 615/1223] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Aug 12 01:20:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:20:36.077916 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400e2681-299d-40ec-b052-71e17df1394e None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:20:36.126889 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:20:36.188167 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400e2681-299d-40ec-b052-71e17df1394e None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:20:36.226368 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34249fa8-d8cd-459a-9f47-d55d2e9815c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:20:36.227214 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34249fa8-d8cd-459a-9f47-d55d2e9815c7 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:36.227644 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34249fa8-d8cd-459a-9f47-d55d2e9815c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:36.228034 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34249fa8-d8cd-459a-9f47-d55d2e9815c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:36.239253 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34249fa8-d8cd-459a-9f47-d55d2e9815c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:20:36.240872 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34249fa8-d8cd-459a-9f47-d55d2e9815c7 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:20:36.257594 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-34249fa8-d8cd-459a-9f47-d55d2e9815c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:20:36.257594 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:20:36.257594 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:20:36.257594 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:20:36.257594 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:20:36.257594 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:20:36.257594 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:20:36.257594 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:20:36.257594 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:20:36.257594 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:20:36.257594 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:20:36.257594 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:20:36.257594 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 01:20:36.257594 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 01:20:36.257594 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 01:20:36.257594 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 01:20:36.258825 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:20:36.258825 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:20:36.258825 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:20:36.258825 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:20:36.258825 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:20:36.258825 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:20:36.258825 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:20:36.258825 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:20:36.258825 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:20:36.258825 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:20:36.258825 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:20:36.258825 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:20:36.258825 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:20:36.258825 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:20:36.258825 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:20:36.258825 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:20:36.258825 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 01:20:36.260165 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 01:20:36.260165 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:20:36.260165 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:20:36.260165 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 609/1224] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:20:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:20:36.264635 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e282200d-8448-4bf6-9ebe-c69839197940 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:20:36.369699 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e282200d-8448-4bf6-9ebe-c69839197940 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:20:36.405459 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9963676f-7c46-4f80-8af6-0651224f17bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:20:36.406244 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963676f-7c46-4f80-8af6-0651224f17bd None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:36.406619 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963676f-7c46-4f80-8af6-0651224f17bd None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:36.406989 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963676f-7c46-4f80-8af6-0651224f17bd None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:36.407665 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9963676f-7c46-4f80-8af6-0651224f17bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:20:36.407997 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9963676f-7c46-4f80-8af6-0651224f17bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:20:36.409435 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9963676f-7c46-4f80-8af6-0651224f17bd None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:20:36.421982 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 616/1225] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 01:20:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:20:36.428005 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34249fa8-d8cd-459a-9f47-d55d2e9815c7 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:20:36.525858 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:20:36.534864 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34249fa8-d8cd-459a-9f47-d55d2e9815c7 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:20:36.576668 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8da8afd-5c84-4580-a0ae-c44fc6547857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:20:36.577433 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8da8afd-5c84-4580-a0ae-c44fc6547857 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:36.577735 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8da8afd-5c84-4580-a0ae-c44fc6547857 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:36.578147 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8da8afd-5c84-4580-a0ae-c44fc6547857 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:36.587722 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8da8afd-5c84-4580-a0ae-c44fc6547857 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:20:36.589478 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8da8afd-5c84-4580-a0ae-c44fc6547857 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:20:36.601725 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-d8da8afd-5c84-4580-a0ae-c44fc6547857 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 12 01:20:36.601725 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:20:36.601725 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:20:36.601725 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:20:36.601725 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:20:36.601725 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:20:36.601725 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:20:36.601725 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:20:36.601725 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:20:36.601725 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:20:36.601725 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:20:36.601725 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:20:36.601725 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 01:20:36.601725 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 01:20:36.601725 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 01:20:36.601725 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 01:20:36.602945 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:20:36.602945 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:20:36.602945 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 01:20:36.602945 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 01:20:36.602945 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 01:20:36.602945 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 01:20:36.602945 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:20:36.602945 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:20:36.602945 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:20:36.602945 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:20:36.602945 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:20:36.602945 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:20:36.602945 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:20:36.602945 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:20:36.602945 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:20:36.602945 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:20:36.602945 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:20:36.602945 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:20:36.604093 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:20:36.604093 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:20:36.604093 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 01:20:36.604093 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 01:20:36.604093 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 01:20:36.604093 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 01:20:36.604093 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 01:20:36.604093 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 01:20:36.604093 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 12 01:20:36.604093 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:20:36.604093 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 610/1226] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:20:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:20:36.609021 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9963676f-7c46-4f80-8af6-0651224f17bd None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:20:36.657049 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:20:36.713136 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9963676f-7c46-4f80-8af6-0651224f17bd None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:20:36.748454 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903f9703-05c0-4808-90ea-3d1b0d0a215b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:20:36.749146 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f9703-05c0-4808-90ea-3d1b0d0a215b None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:36.749499 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f9703-05c0-4808-90ea-3d1b0d0a215b None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:36.749799 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f9703-05c0-4808-90ea-3d1b0d0a215b None admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:36.750638 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903f9703-05c0-4808-90ea-3d1b0d0a215b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:20:36.750940 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903f9703-05c0-4808-90ea-3d1b0d0a215b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:20:36.752351 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903f9703-05c0-4808-90ea-3d1b0d0a215b None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:20:36.769595 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 617/1227] 10.222.0.26 () {56 vars in 1143 bytes} [Fri Aug 12 01:20:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:20:36.775511 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8da8afd-5c84-4580-a0ae-c44fc6547857 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:20:36.887701 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8da8afd-5c84-4580-a0ae-c44fc6547857 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:20:36.922966 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60cea70-8011-4ce3-9c06-b5ec9ddcc5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:20:36.923539 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60cea70-8011-4ce3-9c06-b5ec9ddcc5f1 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:36.923811 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60cea70-8011-4ce3-9c06-b5ec9ddcc5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:36.924071 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60cea70-8011-4ce3-9c06-b5ec9ddcc5f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:36.935065 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60cea70-8011-4ce3-9c06-b5ec9ddcc5f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:20:36.936722 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60cea70-8011-4ce3-9c06-b5ec9ddcc5f1 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:20:36.952638 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-c60cea70-8011-4ce3-9c06-b5ec9ddcc5f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:20:36.952638 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:20:36.952638 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:20:36.952638 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:20:36.952638 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:20:36.952638 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:20:36.952638 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:20:36.952638 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:20:36.952638 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:20:36.952638 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:20:36.952638 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:20:36.952638 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:20:36.952638 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 01:20:36.952638 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 01:20:36.952638 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 01:20:36.952638 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 01:20:36.953821 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:20:36.953821 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:20:36.953821 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:20:36.953821 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:20:36.953821 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:20:36.953821 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:20:36.953821 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:20:36.953821 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:20:36.953821 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:20:36.953821 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:20:36.953821 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:20:36.953821 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:20:36.953821 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:20:36.953821 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:20:36.953821 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:20:36.953821 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:20:36.953821 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 01:20:36.954983 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 01:20:36.954983 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:20:36.954983 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:20:36.954983 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 611/1228] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:20:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:20:36.960523 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903f9703-05c0-4808-90ea-3d1b0d0a215b None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:20:37.069645 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903f9703-05c0-4808-90ea-3d1b0d0a215b None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:20:37.072128 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:20:37.105385 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb1f01b-5995-4fc3-8c5e-4d661ff7aa0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:20:37.106045 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb1f01b-5995-4fc3-8c5e-4d661ff7aa0a None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:37.106365 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb1f01b-5995-4fc3-8c5e-4d661ff7aa0a None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:37.106648 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb1f01b-5995-4fc3-8c5e-4d661ff7aa0a None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:37.107311 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb1f01b-5995-4fc3-8c5e-4d661ff7aa0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:20:37.107657 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb1f01b-5995-4fc3-8c5e-4d661ff7aa0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:20:37.109064 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb1f01b-5995-4fc3-8c5e-4d661ff7aa0a None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:20:37.121580 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 618/1229] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 01:20:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:20:37.127578 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60cea70-8011-4ce3-9c06-b5ec9ddcc5f1 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:20:37.138352 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:20:37.243952 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60cea70-8011-4ce3-9c06-b5ec9ddcc5f1 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:20:37.290375 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f2734b-77a3-496a-8d1a-7edf1a3058b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:20:37.291173 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f2734b-77a3-496a-8d1a-7edf1a3058b5 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:37.291473 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f2734b-77a3-496a-8d1a-7edf1a3058b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:37.291798 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f2734b-77a3-496a-8d1a-7edf1a3058b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:37.300684 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f2734b-77a3-496a-8d1a-7edf1a3058b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:20:37.301996 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f2734b-77a3-496a-8d1a-7edf1a3058b5 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:20:37.313065 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-04f2734b-77a3-496a-8d1a-7edf1a3058b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 01:20:37.313065 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:20:37.313065 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:20:37.313065 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:20:37.313065 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:20:37.313065 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:20:37.313065 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:20:37.313065 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:20:37.313065 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:20:37.313065 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:20:37.313065 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:20:37.313065 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:20:37.313065 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 01:20:37.313065 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 01:20:37.313065 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 01:20:37.314223 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 01:20:37.314223 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:20:37.314223 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:20:37.314223 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:20:37.314223 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:20:37.314223 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:20:37.314223 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:20:37.314223 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:20:37.314223 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:20:37.314223 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:20:37.314223 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:20:37.314223 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:20:37.314223 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:20:37.314223 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:20:37.314223 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:20:37.314223 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:20:37.314223 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:20:37.315327 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 01:20:37.315327 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 01:20:37.315327 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 01:20:37.315327 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 01:20:37.315327 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 01:20:37.315327 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 01:20:37.315327 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 01:20:37.315327 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:20:37.315327 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 612/1230] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 01:20:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:20:37.322531 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb1f01b-5995-4fc3-8c5e-4d661ff7aa0a None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:20:37.436542 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb1f01b-5995-4fc3-8c5e-4d661ff7aa0a None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:20:37.475097 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4805cf97-d93b-4a8f-a692-c143652e3ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:20:37.475706 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4805cf97-d93b-4a8f-a692-c143652e3ce8 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:37.476014 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4805cf97-d93b-4a8f-a692-c143652e3ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:37.476270 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4805cf97-d93b-4a8f-a692-c143652e3ce8 None admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:37.476977 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4805cf97-d93b-4a8f-a692-c143652e3ce8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:20:37.477280 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4805cf97-d93b-4a8f-a692-c143652e3ce8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:20:37.478742 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4805cf97-d93b-4a8f-a692-c143652e3ce8 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:20:37.495364 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 619/1231] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Aug 12 01:20:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:20:37.501604 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f2734b-77a3-496a-8d1a-7edf1a3058b5 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:20:37.571288 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:20:37.612041 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f2734b-77a3-496a-8d1a-7edf1a3058b5 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:20:37.647179 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2397de74-753d-48f0-b5e8-faf0140190fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:20:37.647857 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2397de74-753d-48f0-b5e8-faf0140190fb None admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:37.648128 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2397de74-753d-48f0-b5e8-faf0140190fb None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:37.648452 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2397de74-753d-48f0-b5e8-faf0140190fb None admin] PATH_INFO: `/v3/projects/fa91143910a74c6b896ced5b51f9966a/users/06dccf61c686414d904bdf1ecf19d53d/roles/90d1ca7df8de4b03a689afc664d0cc3f` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:37.664837 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2397de74-753d-48f0-b5e8-faf0140190fb None admin] RBAC: Authorizing `identity:create_grant(project_id=fa91143910a74c6b896ced5b51f9966a, user_id=06dccf61c686414d904bdf1ecf19d53d, role_id=90d1ca7df8de4b03a689afc664d0cc3f)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:20:37.666332 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2397de74-753d-48f0-b5e8-faf0140190fb None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:20:37.681029 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 613/1232] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Aug 12 01:20:37 2022] PUT /identity/v3/projects/fa91143910a74c6b896ced5b51f9966a/users/06dccf61c686414d904bdf1ecf19d53d/roles/90d1ca7df8de4b03a689afc664d0cc3f => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:20:39.783828 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36947d-1ce8-4370-a2b3-8229201a8a0a None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:39.784494 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36947d-1ce8-4370-a2b3-8229201a8a0a None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:39.784494 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36947d-1ce8-4370-a2b3-8229201a8a0a None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:39.786283 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 620/1233] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:20:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:20:39.792591 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66198986-c422-431e-8155-fa38cbce94b4 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:39.793022 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66198986-c422-431e-8155-fa38cbce94b4 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:39.793289 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66198986-c422-431e-8155-fa38cbce94b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:39.813857 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-66198986-c422-431e-8155-fa38cbce94b4 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:20:39.815088 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-66198986-c422-431e-8155-fa38cbce94b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:20:39.888364 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 614/1234] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:20:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 01:20:40.177497 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af36947d-1ce8-4370-a2b3-8229201a8a0a None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:20:40.207365 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:20:40.296980 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af36947d-1ce8-4370-a2b3-8229201a8a0a None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:20:40.335347 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae72a4-1499-43ff-86f4-8edd9f2ee755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:20:40.336058 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae72a4-1499-43ff-86f4-8edd9f2ee755 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:40.336352 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae72a4-1499-43ff-86f4-8edd9f2ee755 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:40.336675 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae72a4-1499-43ff-86f4-8edd9f2ee755 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:40.347657 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ae72a4-1499-43ff-86f4-8edd9f2ee755 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:20:40.352257 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-77ae72a4-1499-43ff-86f4-8edd9f2ee755 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 12 01:20:40.352257 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:20:40.352257 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:20:40.352257 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:20:40.352257 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:20:40.352257 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:20:40.352257 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:20:40.352257 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:20:40.352257 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:20:40.352257 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:20:40.352257 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:20:40.352257 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:20:40.352257 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:20:40.352257 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:20:40.352257 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:20:40.352257 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:20:40.353442 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:20:40.353442 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:20:40.353442 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:20:40.353442 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:20:40.353442 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:20:40.353442 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:20:40.353442 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:20:40.353442 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:20:40.353442 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:20:40.353442 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:20:40.353442 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:20:40.353442 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:20:40.353442 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:20:40.353442 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:20:40.353442 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:20:40.353442 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:20:40.354484 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:20:40.354484 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:20:40.354484 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:20:40.354484 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:20:40.354484 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:20:40.354484 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:20:40.354484 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:20:40.354484 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:20:40.354484 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:20:40.354484 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:20:40.354484 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 12 01:20:40.354484 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:20:40.354484 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 621/1235] 10.222.0.26 () {56 vars in 1102 bytes} [Fri Aug 12 01:20:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 01:20:40.359520 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66198986-c422-431e-8155-fa38cbce94b4 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:20:40.409235 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:20:40.468578 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66198986-c422-431e-8155-fa38cbce94b4 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:20:40.506886 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d346d538-1e0a-42f3-aa32-fb90adc8b8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:20:40.507607 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d346d538-1e0a-42f3-aa32-fb90adc8b8ae None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:40.507853 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d346d538-1e0a-42f3-aa32-fb90adc8b8ae None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:40.508139 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d346d538-1e0a-42f3-aa32-fb90adc8b8ae None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:40.508777 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d346d538-1e0a-42f3-aa32-fb90adc8b8ae None admin] RBAC: Adding query filter params (name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:20:40.509075 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d346d538-1e0a-42f3-aa32-fb90adc8b8ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:20:40.510499 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d346d538-1e0a-42f3-aa32-fb90adc8b8ae None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:20:40.521158 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 615/1236] 10.222.0.26 () {56 vars in 1103 bytes} [Fri Aug 12 01:20:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:20:40.527173 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae72a4-1499-43ff-86f4-8edd9f2ee755 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:20:40.617266 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:20:40.635384 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae72a4-1499-43ff-86f4-8edd9f2ee755 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:20:40.669852 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c41b69-9a82-4926-b737-bc21f9ea7eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:20:40.670515 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c41b69-9a82-4926-b737-bc21f9ea7eca None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:40.670793 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c41b69-9a82-4926-b737-bc21f9ea7eca None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:40.671063 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c41b69-9a82-4926-b737-bc21f9ea7eca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:40.681219 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c41b69-9a82-4926-b737-bc21f9ea7eca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:20:40.682750 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c41b69-9a82-4926-b737-bc21f9ea7eca None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:20:40.697433 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-08c41b69-9a82-4926-b737-bc21f9ea7eca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:20:40.697433 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:20:40.697433 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:20:40.697433 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:20:40.697433 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:20:40.697433 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:20:40.697433 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:20:40.697433 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:20:40.697433 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:20:40.697433 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:20:40.697433 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:20:40.697433 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:20:40.697433 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 01:20:40.697433 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 01:20:40.697433 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 01:20:40.697433 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 01:20:40.698596 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:20:40.698596 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:20:40.698596 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:20:40.698596 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:20:40.698596 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:20:40.698596 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:20:40.698596 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:20:40.698596 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:20:40.698596 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:20:40.698596 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:20:40.698596 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:20:40.698596 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:20:40.698596 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:20:40.698596 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:20:40.698596 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:20:40.698596 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:20:40.698596 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 01:20:40.699480 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 01:20:40.699480 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:20:40.699480 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:20:40.699480 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 622/1237] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:20:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:20:40.705317 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d346d538-1e0a-42f3-aa32-fb90adc8b8ae None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:20:40.808537 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d346d538-1e0a-42f3-aa32-fb90adc8b8ae None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:20:40.818009 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:20:40.846756 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593e0c99-f0d4-4899-be19-166a882a0cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:20:40.847621 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593e0c99-f0d4-4899-be19-166a882a0cc6 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:40.847903 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593e0c99-f0d4-4899-be19-166a882a0cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:40.848257 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593e0c99-f0d4-4899-be19-166a882a0cc6 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:40.848966 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593e0c99-f0d4-4899-be19-166a882a0cc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:20:40.849338 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593e0c99-f0d4-4899-be19-166a882a0cc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:20:40.850913 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593e0c99-f0d4-4899-be19-166a882a0cc6 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:20:40.865195 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 616/1238] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 01:20:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:20:40.871362 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c41b69-9a82-4926-b737-bc21f9ea7eca None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:20:40.998499 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c41b69-9a82-4926-b737-bc21f9ea7eca None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:20:41.036783 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e99b2c-1cfb-4347-980d-abd13e1d10ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:20:41.037434 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e99b2c-1cfb-4347-980d-abd13e1d10ea None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:41.037699 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e99b2c-1cfb-4347-980d-abd13e1d10ea None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:41.038000 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e99b2c-1cfb-4347-980d-abd13e1d10ea None admin] PATH_INFO: `/v3/users/placement` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:41.041401 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:20:41.047194 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e99b2c-1cfb-4347-980d-abd13e1d10ea None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:20:41.048778 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e99b2c-1cfb-4347-980d-abd13e1d10ea None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:20:41.060609 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-c8e99b2c-1cfb-4347-980d-abd13e1d10ea None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 12 01:20:41.060609 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:20:41.060609 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:20:41.060609 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:20:41.060609 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:20:41.060609 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:20:41.060609 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:20:41.060609 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:20:41.060609 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:20:41.060609 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:20:41.060609 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:20:41.060609 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:20:41.060609 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 01:20:41.060609 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 01:20:41.060609 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 01:20:41.060609 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 01:20:41.061670 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:20:41.061670 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:20:41.061670 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 01:20:41.061670 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 01:20:41.061670 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 01:20:41.061670 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 01:20:41.061670 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:20:41.061670 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:20:41.061670 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:20:41.061670 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:20:41.061670 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:20:41.061670 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:20:41.061670 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:20:41.061670 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:20:41.061670 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:20:41.061670 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:20:41.061670 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:20:41.061670 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:20:41.062662 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:20:41.062662 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:20:41.062662 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 01:20:41.062662 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 01:20:41.062662 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 01:20:41.062662 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 01:20:41.062662 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 01:20:41.062662 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 01:20:41.062662 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 12 01:20:41.062662 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:20:41.062662 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 623/1239] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:20:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:20:41.068149 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593e0c99-f0d4-4899-be19-166a882a0cc6 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:20:41.174174 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593e0c99-f0d4-4899-be19-166a882a0cc6 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:20:41.212620 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e04437-774a-4722-a3bb-02ea37e9d89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:20:41.213264 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e04437-774a-4722-a3bb-02ea37e9d89a None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:41.213528 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e04437-774a-4722-a3bb-02ea37e9d89a None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:41.213783 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e04437-774a-4722-a3bb-02ea37e9d89a None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:41.214616 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e04437-774a-4722-a3bb-02ea37e9d89a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:20:41.214955 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e04437-774a-4722-a3bb-02ea37e9d89a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:20:41.216425 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e04437-774a-4722-a3bb-02ea37e9d89a None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:20:41.235882 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 617/1240] 10.222.0.26 () {56 vars in 1143 bytes} [Fri Aug 12 01:20:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:20:41.242025 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e99b2c-1cfb-4347-980d-abd13e1d10ea None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:20:41.379755 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e99b2c-1cfb-4347-980d-abd13e1d10ea None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:20:41.419507 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8766611a-18cc-4d4d-9837-22c19d5ad01a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:20:41.420203 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8766611a-18cc-4d4d-9837-22c19d5ad01a None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:41.420481 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8766611a-18cc-4d4d-9837-22c19d5ad01a None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:41.420749 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8766611a-18cc-4d4d-9837-22c19d5ad01a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:41.489045 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:20:41.496764 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8766611a-18cc-4d4d-9837-22c19d5ad01a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:20:41.498380 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8766611a-18cc-4d4d-9837-22c19d5ad01a None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:20:41.605822 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 624/1241] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 01:20:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 01:20:41.612653 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e04437-774a-4722-a3bb-02ea37e9d89a None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:20:41.642607 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:20:41.722263 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e04437-774a-4722-a3bb-02ea37e9d89a None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:20:41.759727 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14173da-5d5e-40cb-a006-e4635fb4444e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:20:41.760326 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14173da-5d5e-40cb-a006-e4635fb4444e None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:41.760572 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14173da-5d5e-40cb-a006-e4635fb4444e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:41.760824 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14173da-5d5e-40cb-a006-e4635fb4444e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:41.772015 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14173da-5d5e-40cb-a006-e4635fb4444e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:20:41.773612 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14173da-5d5e-40cb-a006-e4635fb4444e None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:20:41.789307 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-f14173da-5d5e-40cb-a006-e4635fb4444e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:20:41.789307 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:20:41.789307 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:20:41.789307 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:20:41.789307 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:20:41.789307 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:20:41.789307 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:20:41.789307 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:20:41.789307 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:20:41.789307 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:20:41.789307 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:20:41.789307 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:20:41.789307 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 01:20:41.789307 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 01:20:41.789307 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 01:20:41.789307 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 01:20:41.795192 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:20:41.795192 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:20:41.795192 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:20:41.795192 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:20:41.795192 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:20:41.795192 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:20:41.795192 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:20:41.795192 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:20:41.795192 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:20:41.795192 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:20:41.795192 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:20:41.795192 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:20:41.795192 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:20:41.795192 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:20:41.795192 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:20:41.795192 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:20:41.795192 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 01:20:41.796437 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 01:20:41.796437 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:20:41.796437 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:20:41.796437 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 618/1242] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:20:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 01:20:41.797782 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8766611a-18cc-4d4d-9837-22c19d5ad01a None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:20:41.904671 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:20:41.911981 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8766611a-18cc-4d4d-9837-22c19d5ad01a None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:20:41.950706 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7ea8da-3fc8-447a-96e0-21062b2840fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:20:41.951417 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ea8da-3fc8-447a-96e0-21062b2840fc None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:41.951704 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ea8da-3fc8-447a-96e0-21062b2840fc None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:41.952007 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ea8da-3fc8-447a-96e0-21062b2840fc None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:41.952749 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7ea8da-3fc8-447a-96e0-21062b2840fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:20:41.953074 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7ea8da-3fc8-447a-96e0-21062b2840fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:20:41.954587 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7ea8da-3fc8-447a-96e0-21062b2840fc None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:20:41.967038 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 625/1243] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 01:20:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:20:41.973158 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14173da-5d5e-40cb-a006-e4635fb4444e None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:20:42.058152 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:20:42.085022 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14173da-5d5e-40cb-a006-e4635fb4444e None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:20:42.122778 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabfcb67-673f-4aec-96ef-10776d4d269a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:20:42.123408 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabfcb67-673f-4aec-96ef-10776d4d269a None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:42.123755 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabfcb67-673f-4aec-96ef-10776d4d269a None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:42.124044 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabfcb67-673f-4aec-96ef-10776d4d269a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:42.131037 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabfcb67-673f-4aec-96ef-10776d4d269a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:20:42.132483 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabfcb67-673f-4aec-96ef-10776d4d269a None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:20:42.143620 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-aabfcb67-673f-4aec-96ef-10776d4d269a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 01:20:42.143620 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:20:42.143620 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:20:42.143620 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:20:42.143620 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:20:42.143620 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:20:42.143620 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:20:42.143620 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:20:42.143620 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:20:42.143620 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:20:42.143620 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:20:42.143620 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:20:42.143620 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 01:20:42.143620 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 01:20:42.143620 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 01:20:42.144590 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 01:20:42.144590 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:20:42.144590 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:20:42.144590 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:20:42.144590 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:20:42.144590 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:20:42.144590 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:20:42.144590 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:20:42.144590 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:20:42.144590 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:20:42.144590 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:20:42.144590 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:20:42.144590 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:20:42.144590 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:20:42.144590 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:20:42.144590 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:20:42.144590 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:20:42.145620 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 01:20:42.145620 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 01:20:42.145620 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 01:20:42.145620 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 01:20:42.145620 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 01:20:42.145620 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 01:20:42.145620 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 01:20:42.145620 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:20:42.145620 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 619/1244] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 01:20:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:20:42.151350 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7ea8da-3fc8-447a-96e0-21062b2840fc None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:20:42.266667 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7ea8da-3fc8-447a-96e0-21062b2840fc None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:20:42.308629 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9478ee01-4965-4e4e-a9c0-151bc058773b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:20:42.309275 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478ee01-4965-4e4e-a9c0-151bc058773b None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:42.309539 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478ee01-4965-4e4e-a9c0-151bc058773b None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:42.309810 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478ee01-4965-4e4e-a9c0-151bc058773b None admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:42.310600 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9478ee01-4965-4e4e-a9c0-151bc058773b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:20:42.310904 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9478ee01-4965-4e4e-a9c0-151bc058773b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:20:42.312350 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9478ee01-4965-4e4e-a9c0-151bc058773b None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:20:42.325541 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 626/1245] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Aug 12 01:20:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:20:42.332180 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabfcb67-673f-4aec-96ef-10776d4d269a None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:20:42.448144 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabfcb67-673f-4aec-96ef-10776d4d269a None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:20:42.486081 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70533130-2c06-4909-8d7f-66047c8c2284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:20:42.486731 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70533130-2c06-4909-8d7f-66047c8c2284 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:42.487107 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70533130-2c06-4909-8d7f-66047c8c2284 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:42.487473 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70533130-2c06-4909-8d7f-66047c8c2284 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:42.488394 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70533130-2c06-4909-8d7f-66047c8c2284 None admin] RBAC: Adding query filter params (role.id=90d1ca7df8de4b03a689afc664d0cc3f, scope.project.id=fa91143910a74c6b896ced5b51f9966a, user.id=06dccf61c686414d904bdf1ecf19d53d) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:20:42.488843 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70533130-2c06-4909-8d7f-66047c8c2284 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:20:42.490602 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70533130-2c06-4909-8d7f-66047c8c2284 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:20:42.498993 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 620/1246] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 01:20:42 2022] GET /identity/v3/role_assignments?user.id=06dccf61c686414d904bdf1ecf19d53d&scope.project.id=fa91143910a74c6b896ced5b51f9966a&role.id=90d1ca7df8de4b03a689afc664d0cc3f => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:20:44.523184 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0c741-382c-4e74-bc10-45588630ed67 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:44.523722 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0c741-382c-4e74-bc10-45588630ed67 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:44.523722 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0c741-382c-4e74-bc10-45588630ed67 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:44.525273 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 627/1247] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:20:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:20:44.530978 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd042f36-610b-4cae-bb2b-d99d23d37c13 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:44.531525 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd042f36-610b-4cae-bb2b-d99d23d37c13 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:44.531525 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd042f36-610b-4cae-bb2b-d99d23d37c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:44.538978 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:20:44.552239 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-bd042f36-610b-4cae-bb2b-d99d23d37c13 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:20:44.553447 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-bd042f36-610b-4cae-bb2b-d99d23d37c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:20:44.631040 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 621/1248] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:20:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 01:20:44.894169 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf0c741-382c-4e74-bc10-45588630ed67 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:20:44.914566 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:20:45.017340 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf0c741-382c-4e74-bc10-45588630ed67 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:20:45.055835 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faaba49-fe4f-4fb9-aa97-a00dda1e5064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:20:45.056454 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faaba49-fe4f-4fb9-aa97-a00dda1e5064 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:45.056727 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faaba49-fe4f-4fb9-aa97-a00dda1e5064 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:45.057006 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faaba49-fe4f-4fb9-aa97-a00dda1e5064 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:45.067487 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faaba49-fe4f-4fb9-aa97-a00dda1e5064 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:20:45.072174 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-1faaba49-fe4f-4fb9-aa97-a00dda1e5064 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 01:20:45.072174 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:20:45.072174 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:20:45.072174 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:20:45.072174 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:20:45.072174 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:20:45.072174 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:20:45.072174 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:20:45.072174 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:20:45.072174 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:20:45.072174 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:20:45.072174 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:20:45.072174 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:20:45.072174 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:20:45.072174 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:20:45.072174 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:20:45.073132 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:20:45.073132 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:20:45.073132 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:20:45.073132 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:20:45.073132 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:20:45.073132 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:20:45.073132 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:20:45.073132 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:20:45.073132 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:20:45.073132 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:20:45.073132 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:20:45.073132 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:20:45.073132 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:20:45.073132 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:20:45.073132 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:20:45.073132 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:20:45.073960 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:20:45.073960 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:20:45.073960 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:20:45.073960 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:20:45.073960 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:20:45.073960 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:20:45.073960 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:20:45.073960 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:20:45.073960 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:20:45.073960 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:20:45.073960 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 01:20:45.073960 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:20:45.073960 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 628/1249] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Aug 12 01:20:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:20:45.079545 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd042f36-610b-4cae-bb2b-d99d23d37c13 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:20:45.189048 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd042f36-610b-4cae-bb2b-d99d23d37c13 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:20:45.224423 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:20:45.230199 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad3409c-03ad-4214-87d5-d8cccacca4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:20:45.230891 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad3409c-03ad-4214-87d5-d8cccacca4a3 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:45.231168 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad3409c-03ad-4214-87d5-d8cccacca4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:45.231436 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad3409c-03ad-4214-87d5-d8cccacca4a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:45.232109 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad3409c-03ad-4214-87d5-d8cccacca4a3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:20:45.232412 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad3409c-03ad-4214-87d5-d8cccacca4a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:20:45.233800 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad3409c-03ad-4214-87d5-d8cccacca4a3 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:20:45.242803 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 622/1250] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 01:20:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:20:45.248795 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faaba49-fe4f-4fb9-aa97-a00dda1e5064 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:20:45.338215 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:20:45.366409 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faaba49-fe4f-4fb9-aa97-a00dda1e5064 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:20:45.405454 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f682ce-2e01-41fe-a38c-5a831da82944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:20:45.406157 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f682ce-2e01-41fe-a38c-5a831da82944 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:45.406374 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f682ce-2e01-41fe-a38c-5a831da82944 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:45.406641 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f682ce-2e01-41fe-a38c-5a831da82944 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:45.418058 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f682ce-2e01-41fe-a38c-5a831da82944 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:20:45.419519 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f682ce-2e01-41fe-a38c-5a831da82944 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:20:45.436029 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-c2f682ce-2e01-41fe-a38c-5a831da82944 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:20:45.436029 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:20:45.436029 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:20:45.436029 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:20:45.436029 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:20:45.436029 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:20:45.436029 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:20:45.436029 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:20:45.436029 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:20:45.436029 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:20:45.436029 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:20:45.436029 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:20:45.436029 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 01:20:45.436029 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 01:20:45.436029 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 01:20:45.436029 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 01:20:45.437106 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:20:45.437106 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:20:45.437106 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:20:45.437106 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:20:45.437106 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:20:45.437106 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:20:45.437106 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:20:45.437106 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:20:45.437106 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:20:45.437106 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:20:45.437106 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:20:45.437106 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:20:45.437106 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:20:45.437106 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:20:45.437106 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:20:45.437106 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:20:45.437106 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 01:20:45.438006 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 01:20:45.438006 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:20:45.438006 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:20:45.438006 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 629/1251] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:20:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 01:20:45.444600 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad3409c-03ad-4214-87d5-d8cccacca4a3 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:20:45.560655 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad3409c-03ad-4214-87d5-d8cccacca4a3 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:20:45.596070 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0d7cb0-48a9-4b14-8f40-94696df1bd40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:20:45.596868 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d7cb0-48a9-4b14-8f40-94696df1bd40 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:45.597168 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d7cb0-48a9-4b14-8f40-94696df1bd40 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:45.597410 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d7cb0-48a9-4b14-8f40-94696df1bd40 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:45.598216 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0d7cb0-48a9-4b14-8f40-94696df1bd40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:20:45.598514 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0d7cb0-48a9-4b14-8f40-94696df1bd40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:20:45.599900 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0d7cb0-48a9-4b14-8f40-94696df1bd40 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:20:45.613601 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 623/1252] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 01:20:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:20:45.619324 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f682ce-2e01-41fe-a38c-5a831da82944 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:20:45.733558 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f682ce-2e01-41fe-a38c-5a831da82944 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:20:45.765433 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:20:45.774159 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8c6a94-7960-41c0-9cc1-41589f3ae0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:20:45.774795 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c6a94-7960-41c0-9cc1-41589f3ae0fe None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:45.775071 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c6a94-7960-41c0-9cc1-41589f3ae0fe None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:45.775341 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c6a94-7960-41c0-9cc1-41589f3ae0fe None admin] PATH_INFO: `/v3/users/placement` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:45.784970 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8c6a94-7960-41c0-9cc1-41589f3ae0fe None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:20:45.786444 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8c6a94-7960-41c0-9cc1-41589f3ae0fe None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:20:45.797846 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-cb8c6a94-7960-41c0-9cc1-41589f3ae0fe None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 12 01:20:45.797846 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:20:45.797846 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:20:45.797846 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:20:45.797846 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:20:45.797846 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:20:45.797846 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:20:45.797846 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:20:45.797846 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:20:45.797846 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:20:45.797846 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:20:45.797846 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:20:45.797846 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 01:20:45.797846 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 01:20:45.797846 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 01:20:45.797846 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 01:20:45.799611 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:20:45.799611 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:20:45.799611 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 01:20:45.799611 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 01:20:45.799611 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 01:20:45.799611 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 01:20:45.799611 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:20:45.799611 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:20:45.799611 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:20:45.799611 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:20:45.799611 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:20:45.799611 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:20:45.799611 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:20:45.799611 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:20:45.799611 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:20:45.799611 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:20:45.799611 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:20:45.799611 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:20:45.801137 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:20:45.801137 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:20:45.801137 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 01:20:45.801137 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 01:20:45.801137 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 01:20:45.801137 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 01:20:45.801137 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 01:20:45.801137 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 01:20:45.801137 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 12 01:20:45.801137 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:20:45.801137 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 630/1253] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:20:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 01:20:45.805189 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0d7cb0-48a9-4b14-8f40-94696df1bd40 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:20:45.865223 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:20:45.917891 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0d7cb0-48a9-4b14-8f40-94696df1bd40 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:20:45.955796 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d03b8-ce94-4930-8e60-bc08131afac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:20:45.956857 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d03b8-ce94-4930-8e60-bc08131afac6 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:45.957186 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d03b8-ce94-4930-8e60-bc08131afac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:45.957475 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d03b8-ce94-4930-8e60-bc08131afac6 None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:45.958376 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09d03b8-ce94-4930-8e60-bc08131afac6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:20:45.958757 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09d03b8-ce94-4930-8e60-bc08131afac6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:20:45.960495 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09d03b8-ce94-4930-8e60-bc08131afac6 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:20:45.979180 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 624/1254] 10.222.0.26 () {56 vars in 1143 bytes} [Fri Aug 12 01:20:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:20:45.984932 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8c6a94-7960-41c0-9cc1-41589f3ae0fe None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:20:46.099057 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8c6a94-7960-41c0-9cc1-41589f3ae0fe None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:20:46.140869 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5182f51-a58f-4f88-8163-a769e84a80d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:20:46.141532 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5182f51-a58f-4f88-8163-a769e84a80d9 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:46.141841 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5182f51-a58f-4f88-8163-a769e84a80d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:46.142201 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5182f51-a58f-4f88-8163-a769e84a80d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:46.209383 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:20:46.223210 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5182f51-a58f-4f88-8163-a769e84a80d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:20:46.224924 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5182f51-a58f-4f88-8163-a769e84a80d9 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:20:46.332869 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 631/1255] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 01:20:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 01:20:46.338750 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d03b8-ce94-4930-8e60-bc08131afac6 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:20:46.449344 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d03b8-ce94-4930-8e60-bc08131afac6 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:20:46.463778 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:20:46.493393 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7300c5a6-626d-4d18-b3df-f837808f26e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:20:46.494041 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7300c5a6-626d-4d18-b3df-f837808f26e8 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:46.494347 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7300c5a6-626d-4d18-b3df-f837808f26e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:46.494616 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7300c5a6-626d-4d18-b3df-f837808f26e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:46.507652 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7300c5a6-626d-4d18-b3df-f837808f26e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:20:46.509198 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7300c5a6-626d-4d18-b3df-f837808f26e8 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:20:46.527298 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-7300c5a6-626d-4d18-b3df-f837808f26e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:20:46.527298 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:20:46.527298 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:20:46.527298 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:20:46.527298 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:20:46.527298 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:20:46.527298 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:20:46.527298 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:20:46.527298 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:20:46.527298 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:20:46.527298 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:20:46.527298 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:20:46.527298 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 01:20:46.527298 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 01:20:46.527298 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 01:20:46.527298 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 01:20:46.528741 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:20:46.528741 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:20:46.528741 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:20:46.528741 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:20:46.528741 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:20:46.528741 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:20:46.528741 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:20:46.528741 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:20:46.528741 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:20:46.528741 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:20:46.528741 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:20:46.528741 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:20:46.528741 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:20:46.528741 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:20:46.528741 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:20:46.528741 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:20:46.528741 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 01:20:46.529835 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 01:20:46.529835 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:20:46.529835 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:20:46.529835 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 625/1256] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:20:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 01:20:46.535566 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5182f51-a58f-4f88-8163-a769e84a80d9 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:20:46.633978 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:20:46.650434 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5182f51-a58f-4f88-8163-a769e84a80d9 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:20:46.689797 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39d13da-9e0c-4ebb-90e6-d26be4b0fb05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:20:46.690817 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d13da-9e0c-4ebb-90e6-d26be4b0fb05 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:46.691103 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d13da-9e0c-4ebb-90e6-d26be4b0fb05 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:46.691370 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d13da-9e0c-4ebb-90e6-d26be4b0fb05 None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:46.692013 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39d13da-9e0c-4ebb-90e6-d26be4b0fb05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:20:46.692327 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39d13da-9e0c-4ebb-90e6-d26be4b0fb05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:20:46.693669 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39d13da-9e0c-4ebb-90e6-d26be4b0fb05 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:20:46.710854 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 632/1257] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 01:20:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:20:46.712136 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7300c5a6-626d-4d18-b3df-f837808f26e8 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:20:46.815725 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7300c5a6-626d-4d18-b3df-f837808f26e8 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:20:46.851630 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d30d94a-efcc-4065-8488-c147a26d6865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:20:46.852355 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30d94a-efcc-4065-8488-c147a26d6865 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:46.852563 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30d94a-efcc-4065-8488-c147a26d6865 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:46.852808 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30d94a-efcc-4065-8488-c147a26d6865 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:46.859504 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d30d94a-efcc-4065-8488-c147a26d6865 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:20:46.860966 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d30d94a-efcc-4065-8488-c147a26d6865 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:20:46.872519 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-3d30d94a-efcc-4065-8488-c147a26d6865 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 01:20:46.872519 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:20:46.872519 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:20:46.872519 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:20:46.872519 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:20:46.872519 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:20:46.872519 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:20:46.872519 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:20:46.872519 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:20:46.872519 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:20:46.872519 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:20:46.872519 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:20:46.872519 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 01:20:46.872519 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 01:20:46.872519 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 01:20:46.873675 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 01:20:46.873675 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:20:46.873675 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:20:46.873675 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:20:46.873675 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:20:46.873675 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:20:46.873675 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:20:46.873675 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:20:46.873675 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:20:46.873675 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:20:46.873675 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:20:46.873675 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:20:46.873675 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:20:46.873675 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:20:46.873675 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:20:46.873675 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:20:46.873675 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:20:46.874868 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 01:20:46.874868 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 01:20:46.874868 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 01:20:46.874868 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 01:20:46.874868 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 01:20:46.874868 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 01:20:46.874868 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 01:20:46.874868 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:20:46.874868 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 626/1258] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 01:20:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:20:46.880666 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39d13da-9e0c-4ebb-90e6-d26be4b0fb05 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:20:46.994073 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39d13da-9e0c-4ebb-90e6-d26be4b0fb05 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:20:47.031773 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e870832-98ed-4086-8827-ff2ad53af563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:20:47.032415 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e870832-98ed-4086-8827-ff2ad53af563 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:47.032688 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e870832-98ed-4086-8827-ff2ad53af563 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:47.032953 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e870832-98ed-4086-8827-ff2ad53af563 None admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:47.034001 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e870832-98ed-4086-8827-ff2ad53af563 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:20:47.034286 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e870832-98ed-4086-8827-ff2ad53af563 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:20:47.035719 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e870832-98ed-4086-8827-ff2ad53af563 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:20:47.048139 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 633/1259] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Aug 12 01:20:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:20:47.054673 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d30d94a-efcc-4065-8488-c147a26d6865 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:20:47.081327 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:20:47.166450 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d30d94a-efcc-4065-8488-c147a26d6865 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:20:47.206078 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c6e77e-7709-41dc-ae4c-af254dce4ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:20:47.206953 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c6e77e-7709-41dc-ae4c-af254dce4ebb None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:47.207335 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c6e77e-7709-41dc-ae4c-af254dce4ebb None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:47.207680 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c6e77e-7709-41dc-ae4c-af254dce4ebb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:47.208621 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c6e77e-7709-41dc-ae4c-af254dce4ebb None admin] RBAC: Adding query filter params (role.id=fb48693810be495fb4b1893a79429b78, scope.project.id=fa91143910a74c6b896ced5b51f9966a, user.id=06dccf61c686414d904bdf1ecf19d53d) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:20:47.209090 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c6e77e-7709-41dc-ae4c-af254dce4ebb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:20:47.211167 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c6e77e-7709-41dc-ae4c-af254dce4ebb None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:20:47.230149 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 627/1260] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 01:20:47 2022] GET /identity/v3/role_assignments?user.id=06dccf61c686414d904bdf1ecf19d53d&scope.project.id=fa91143910a74c6b896ced5b51f9966a&role.id=fb48693810be495fb4b1893a79429b78 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:20:49.112518 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b715f0b-5229-4190-bd4a-fa9f2b1164b1 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:49.113512 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b715f0b-5229-4190-bd4a-fa9f2b1164b1 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:49.113512 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b715f0b-5229-4190-bd4a-fa9f2b1164b1 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:49.115479 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 634/1261] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:20:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:20:49.120761 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35793d22-cf83-4b99-a129-0eb634a9e9f7 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:49.121195 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35793d22-cf83-4b99-a129-0eb634a9e9f7 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:49.121290 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35793d22-cf83-4b99-a129-0eb634a9e9f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:49.141145 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-35793d22-cf83-4b99-a129-0eb634a9e9f7 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:20:49.142355 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-35793d22-cf83-4b99-a129-0eb634a9e9f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:20:49.220447 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 628/1262] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:20:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 01:20:49.485138 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b715f0b-5229-4190-bd4a-fa9f2b1164b1 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:20:49.500352 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:20:49.594162 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b715f0b-5229-4190-bd4a-fa9f2b1164b1 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:20:49.629289 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0670c497-9407-4bcc-aadb-cd2681807183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:20:49.629906 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670c497-9407-4bcc-aadb-cd2681807183 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:49.630208 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670c497-9407-4bcc-aadb-cd2681807183 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:49.630486 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670c497-9407-4bcc-aadb-cd2681807183 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:49.641107 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0670c497-9407-4bcc-aadb-cd2681807183 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:20:49.645778 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-0670c497-9407-4bcc-aadb-cd2681807183 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 01:20:49.645778 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:20:49.645778 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:20:49.645778 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:20:49.645778 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:20:49.645778 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:20:49.645778 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:20:49.645778 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:20:49.645778 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:20:49.645778 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:20:49.645778 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:20:49.645778 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:20:49.645778 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:20:49.645778 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:20:49.645778 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:20:49.645778 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:20:49.646966 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:20:49.646966 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:20:49.646966 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:20:49.646966 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:20:49.646966 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:20:49.646966 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:20:49.646966 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:20:49.646966 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:20:49.646966 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:20:49.646966 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:20:49.646966 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:20:49.646966 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:20:49.646966 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:20:49.646966 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:20:49.646966 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:20:49.646966 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:20:49.648792 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:20:49.648792 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:20:49.648792 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:20:49.648792 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:20:49.648792 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:20:49.648792 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:20:49.648792 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:20:49.648792 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:20:49.648792 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:20:49.648792 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:20:49.648792 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 01:20:49.648792 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:20:49.648792 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 635/1263] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Aug 12 01:20:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:20:49.656835 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35793d22-cf83-4b99-a129-0eb634a9e9f7 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:20:49.677069 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:20:49.763060 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35793d22-cf83-4b99-a129-0eb634a9e9f7 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:20:49.799895 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ca5b9f-66c9-4a30-83ca-fb10080dc053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:20:49.800491 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca5b9f-66c9-4a30-83ca-fb10080dc053 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:49.800764 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca5b9f-66c9-4a30-83ca-fb10080dc053 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:49.801036 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca5b9f-66c9-4a30-83ca-fb10080dc053 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:49.801690 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ca5b9f-66c9-4a30-83ca-fb10080dc053 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:20:49.801994 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ca5b9f-66c9-4a30-83ca-fb10080dc053 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:20:49.803387 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ca5b9f-66c9-4a30-83ca-fb10080dc053 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:20:49.811435 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 629/1264] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 01:20:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:20:49.818708 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0670c497-9407-4bcc-aadb-cd2681807183 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:20:49.892265 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:20:49.930978 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0670c497-9407-4bcc-aadb-cd2681807183 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:20:49.965266 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890bbc77-6f27-4749-a717-dec4b62db45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:20:49.965882 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890bbc77-6f27-4749-a717-dec4b62db45e None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:49.966148 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890bbc77-6f27-4749-a717-dec4b62db45e None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:49.966512 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890bbc77-6f27-4749-a717-dec4b62db45e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:49.977064 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890bbc77-6f27-4749-a717-dec4b62db45e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:20:49.978547 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890bbc77-6f27-4749-a717-dec4b62db45e None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:20:49.994719 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-890bbc77-6f27-4749-a717-dec4b62db45e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:20:49.994719 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:20:49.994719 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:20:49.994719 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:20:49.994719 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:20:49.994719 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:20:49.994719 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:20:49.994719 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:20:49.994719 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:20:49.994719 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:20:49.994719 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:20:49.994719 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:20:49.994719 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 01:20:49.994719 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 01:20:49.994719 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 01:20:49.994719 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 01:20:49.995702 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:20:49.995702 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:20:49.995702 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:20:49.995702 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:20:49.995702 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:20:49.995702 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:20:49.995702 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:20:49.995702 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:20:49.995702 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:20:49.995702 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:20:49.995702 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:20:49.995702 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:20:49.995702 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:20:49.995702 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:20:49.995702 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:20:49.995702 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:20:49.995702 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 01:20:49.996701 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 01:20:49.996701 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:20:49.996701 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:20:49.996701 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 636/1265] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:20:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:20:50.002484 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ca5b9f-66c9-4a30-83ca-fb10080dc053 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:20:50.091689 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:20:50.110728 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ca5b9f-66c9-4a30-83ca-fb10080dc053 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:20:50.157850 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b435e-8f9a-4134-83a5-43cdd99ba07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:20:50.158600 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b435e-8f9a-4134-83a5-43cdd99ba07d None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:50.158938 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b435e-8f9a-4134-83a5-43cdd99ba07d None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:50.159193 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b435e-8f9a-4134-83a5-43cdd99ba07d None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:50.159826 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68b435e-8f9a-4134-83a5-43cdd99ba07d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:20:50.160132 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68b435e-8f9a-4134-83a5-43cdd99ba07d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:20:50.161491 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68b435e-8f9a-4134-83a5-43cdd99ba07d None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:20:50.173198 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 630/1266] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 01:20:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:20:50.179453 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890bbc77-6f27-4749-a717-dec4b62db45e None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:20:50.291458 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890bbc77-6f27-4749-a717-dec4b62db45e None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:20:50.310688 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:20:50.325440 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ce65a-3b3c-4c5e-85c8-54ba743f809c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:20:50.326058 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ce65a-3b3c-4c5e-85c8-54ba743f809c None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:50.326357 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ce65a-3b3c-4c5e-85c8-54ba743f809c None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:50.326617 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ce65a-3b3c-4c5e-85c8-54ba743f809c None admin] PATH_INFO: `/v3/users/placement` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:50.333875 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542ce65a-3b3c-4c5e-85c8-54ba743f809c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:20:50.335356 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542ce65a-3b3c-4c5e-85c8-54ba743f809c None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:20:50.346180 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-542ce65a-3b3c-4c5e-85c8-54ba743f809c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 12 01:20:50.346180 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:20:50.346180 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:20:50.346180 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:20:50.346180 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:20:50.346180 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:20:50.346180 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:20:50.346180 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:20:50.346180 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:20:50.346180 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:20:50.346180 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:20:50.346180 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:20:50.346180 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 01:20:50.346180 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 01:20:50.346180 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 01:20:50.346180 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 01:20:50.347213 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:20:50.347213 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:20:50.347213 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 01:20:50.347213 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 01:20:50.347213 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 01:20:50.347213 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 01:20:50.347213 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:20:50.347213 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:20:50.347213 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:20:50.347213 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:20:50.347213 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:20:50.347213 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:20:50.347213 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:20:50.347213 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:20:50.347213 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:20:50.347213 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:20:50.347213 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:20:50.347213 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:20:50.348426 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:20:50.348426 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:20:50.348426 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 01:20:50.348426 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 01:20:50.348426 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 01:20:50.348426 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 01:20:50.348426 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 01:20:50.348426 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 01:20:50.348426 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 12 01:20:50.348426 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:20:50.348426 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 637/1267] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:20:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 12 01:20:50.353743 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b435e-8f9a-4134-83a5-43cdd99ba07d None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:20:50.463773 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b435e-8f9a-4134-83a5-43cdd99ba07d None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:20:50.499370 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d98495-f065-457c-993a-db0c25bb0b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:20:50.499984 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d98495-f065-457c-993a-db0c25bb0b2f None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:50.500255 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d98495-f065-457c-993a-db0c25bb0b2f None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:50.500523 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d98495-f065-457c-993a-db0c25bb0b2f None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:50.501255 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d98495-f065-457c-993a-db0c25bb0b2f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:20:50.501552 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d98495-f065-457c-993a-db0c25bb0b2f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:20:50.503076 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d98495-f065-457c-993a-db0c25bb0b2f None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:20:50.511873 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:20:50.520499 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 631/1268] 10.222.0.26 () {56 vars in 1143 bytes} [Fri Aug 12 01:20:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:20:50.526437 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ce65a-3b3c-4c5e-85c8-54ba743f809c None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:20:50.636258 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ce65a-3b3c-4c5e-85c8-54ba743f809c None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:20:50.671123 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59503afc-5dc9-4fcf-bf8f-777737a66aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:20:50.671724 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59503afc-5dc9-4fcf-bf8f-777737a66aa0 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:50.671997 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59503afc-5dc9-4fcf-bf8f-777737a66aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:50.672261 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59503afc-5dc9-4fcf-bf8f-777737a66aa0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:50.683022 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59503afc-5dc9-4fcf-bf8f-777737a66aa0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:20:50.684435 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59503afc-5dc9-4fcf-bf8f-777737a66aa0 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:20:50.698596 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-59503afc-5dc9-4fcf-bf8f-777737a66aa0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:20:50.698596 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:20:50.698596 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:20:50.698596 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:20:50.698596 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:20:50.698596 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:20:50.698596 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:20:50.698596 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:20:50.698596 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:20:50.698596 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:20:50.698596 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:20:50.698596 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:20:50.698596 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 01:20:50.698596 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 01:20:50.698596 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 01:20:50.698596 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 01:20:50.699680 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:20:50.699680 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:20:50.699680 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:20:50.699680 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:20:50.699680 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:20:50.699680 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:20:50.699680 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:20:50.699680 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:20:50.699680 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:20:50.699680 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:20:50.699680 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:20:50.699680 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:20:50.699680 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:20:50.699680 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:20:50.699680 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:20:50.699680 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:20:50.699680 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 01:20:50.700742 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 01:20:50.700742 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:20:50.700742 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:20:50.700742 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 638/1269] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:20:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:20:50.708725 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d98495-f065-457c-993a-db0c25bb0b2f None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:20:50.817918 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d98495-f065-457c-993a-db0c25bb0b2f None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:20:50.853993 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b27e073-534c-433a-87df-909aa3d9e8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:20:50.854614 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b27e073-534c-433a-87df-909aa3d9e8e1 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:50.854892 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b27e073-534c-433a-87df-909aa3d9e8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:50.855155 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b27e073-534c-433a-87df-909aa3d9e8e1 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:50.855788 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b27e073-534c-433a-87df-909aa3d9e8e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:20:50.856086 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b27e073-534c-433a-87df-909aa3d9e8e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:20:50.857457 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b27e073-534c-433a-87df-909aa3d9e8e1 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:20:50.868697 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 632/1270] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 01:20:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:20:50.874833 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59503afc-5dc9-4fcf-bf8f-777737a66aa0 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:20:50.913637 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:20:50.984791 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59503afc-5dc9-4fcf-bf8f-777737a66aa0 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:20:51.022620 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da34a01f-f314-4fe5-ba3d-317f73b8871f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:20:51.023225 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da34a01f-f314-4fe5-ba3d-317f73b8871f None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:51.023497 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da34a01f-f314-4fe5-ba3d-317f73b8871f None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:51.023760 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da34a01f-f314-4fe5-ba3d-317f73b8871f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:51.031049 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da34a01f-f314-4fe5-ba3d-317f73b8871f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:20:51.032471 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da34a01f-f314-4fe5-ba3d-317f73b8871f None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:20:51.043753 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-da34a01f-f314-4fe5-ba3d-317f73b8871f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 01:20:51.043753 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:20:51.043753 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:20:51.043753 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:20:51.043753 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:20:51.043753 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:20:51.043753 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:20:51.043753 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:20:51.043753 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:20:51.043753 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:20:51.043753 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:20:51.043753 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:20:51.043753 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 01:20:51.043753 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 01:20:51.043753 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 01:20:51.044792 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 01:20:51.044792 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:20:51.044792 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:20:51.044792 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:20:51.044792 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:20:51.044792 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:20:51.044792 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:20:51.044792 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:20:51.044792 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:20:51.044792 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:20:51.044792 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:20:51.044792 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:20:51.044792 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:20:51.044792 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:20:51.044792 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:20:51.044792 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:20:51.044792 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:20:51.046297 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 01:20:51.046297 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 01:20:51.046297 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 01:20:51.046297 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 01:20:51.046297 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 01:20:51.046297 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 01:20:51.046297 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 01:20:51.046297 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:20:51.046297 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 639/1271] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 01:20:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:20:51.053896 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b27e073-534c-433a-87df-909aa3d9e8e1 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:20:51.117769 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:20:51.165303 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b27e073-534c-433a-87df-909aa3d9e8e1 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:20:51.203812 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebc4ce0-2eed-481a-9847-e07e04a118c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:20:51.204552 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebc4ce0-2eed-481a-9847-e07e04a118c0 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:51.204888 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebc4ce0-2eed-481a-9847-e07e04a118c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:51.205272 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebc4ce0-2eed-481a-9847-e07e04a118c0 None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:51.206217 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebc4ce0-2eed-481a-9847-e07e04a118c0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:20:51.206617 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebc4ce0-2eed-481a-9847-e07e04a118c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:20:51.208388 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebc4ce0-2eed-481a-9847-e07e04a118c0 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:20:51.224181 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 633/1272] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Aug 12 01:20:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:20:51.230424 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da34a01f-f314-4fe5-ba3d-317f73b8871f None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:20:51.327586 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:20:51.338307 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da34a01f-f314-4fe5-ba3d-317f73b8871f None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:20:51.373739 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb659618-a251-4daa-aca8-d464a668be6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:20:51.374423 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb659618-a251-4daa-aca8-d464a668be6c None admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:51.374701 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb659618-a251-4daa-aca8-d464a668be6c None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:51.374971 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb659618-a251-4daa-aca8-d464a668be6c None admin] PATH_INFO: `/v3/projects/fa91143910a74c6b896ced5b51f9966a/users/06dccf61c686414d904bdf1ecf19d53d/roles/fb48693810be495fb4b1893a79429b78` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:51.376964 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb659618-a251-4daa-aca8-d464a668be6c None admin] RBAC: Authorizing `identity:create_grant(project_id=fa91143910a74c6b896ced5b51f9966a, user_id=06dccf61c686414d904bdf1ecf19d53d, role_id=fb48693810be495fb4b1893a79429b78)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:20:51.378435 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb659618-a251-4daa-aca8-d464a668be6c None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:20:51.395607 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 640/1273] 10.222.0.26 () {58 vars in 1439 bytes} [Fri Aug 12 01:20:51 2022] PUT /identity/v3/projects/fa91143910a74c6b896ced5b51f9966a/users/06dccf61c686414d904bdf1ecf19d53d/roles/fb48693810be495fb4b1893a79429b78 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:20:53.230172 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b340a-2ea4-4b36-8e91-856bccf37ddd None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:53.230725 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b340a-2ea4-4b36-8e91-856bccf37ddd None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:53.230725 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b340a-2ea4-4b36-8e91-856bccf37ddd None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:53.232760 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 634/1274] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:20:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:20:53.241690 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74cc49b-b48d-4c54-aa53-fc3c30aa956b None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:53.242093 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74cc49b-b48d-4c54-aa53-fc3c30aa956b None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:53.242315 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74cc49b-b48d-4c54-aa53-fc3c30aa956b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:53.266469 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-a74cc49b-b48d-4c54-aa53-fc3c30aa956b None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:20:53.267947 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-a74cc49b-b48d-4c54-aa53-fc3c30aa956b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:20:53.347007 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 641/1275] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:20:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 01:20:53.614160 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4b340a-2ea4-4b36-8e91-856bccf37ddd None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:20:53.731487 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4b340a-2ea4-4b36-8e91-856bccf37ddd None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:20:53.748821 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:20:53.768835 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c609e3-9356-4aa5-83e8-ed325a50b345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:20:53.769447 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c609e3-9356-4aa5-83e8-ed325a50b345 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:53.769718 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c609e3-9356-4aa5-83e8-ed325a50b345 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:53.769989 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c609e3-9356-4aa5-83e8-ed325a50b345 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:53.780765 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c609e3-9356-4aa5-83e8-ed325a50b345 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 12 01:20:53.785373 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-15c609e3-9356-4aa5-83e8-ed325a50b345 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 01:20:53.785373 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:20:53.785373 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:20:53.785373 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:20:53.785373 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:20:53.785373 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:20:53.785373 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:20:53.785373 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:20:53.785373 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:20:53.785373 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:20:53.785373 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:20:53.785373 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:20:53.785373 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 12 01:20:53.785373 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 12 01:20:53.785373 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 12 01:20:53.785373 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 12 01:20:53.786474 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 12 01:20:53.786474 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 12 01:20:53.786474 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 12 01:20:53.786474 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 12 01:20:53.786474 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:20:53.786474 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:20:53.786474 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:20:53.786474 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:20:53.786474 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:20:53.786474 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:20:53.786474 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:20:53.786474 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:20:53.786474 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:20:53.786474 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:20:53.786474 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:20:53.786474 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:20:53.787312 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:20:53.787312 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:20:53.787312 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:20:53.787312 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:20:53.787312 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 12 01:20:53.787312 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 12 01:20:53.787312 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 12 01:20:53.787312 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 12 01:20:53.787312 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 12 01:20:53.787312 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 12 01:20:53.787312 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 12 01:20:53.787312 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:20:53.787312 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 635/1276] 10.222.0.26 () {56 vars in 1096 bytes} [Fri Aug 12 01:20:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:20:53.792630 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74cc49b-b48d-4c54-aa53-fc3c30aa956b None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:20:53.878355 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:20:53.910512 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74cc49b-b48d-4c54-aa53-fc3c30aa956b None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:20:53.946415 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37db432-d8f4-4f57-a29a-c9bcfd37b5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:20:53.947015 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37db432-d8f4-4f57-a29a-c9bcfd37b5ed None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:53.947288 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37db432-d8f4-4f57-a29a-c9bcfd37b5ed None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:53.947557 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37db432-d8f4-4f57-a29a-c9bcfd37b5ed None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:53.948223 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37db432-d8f4-4f57-a29a-c9bcfd37b5ed None admin] RBAC: Adding query filter params (name=admin) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:20:53.948522 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37db432-d8f4-4f57-a29a-c9bcfd37b5ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:20:53.949876 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37db432-d8f4-4f57-a29a-c9bcfd37b5ed None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:20:53.958008 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 642/1277] 10.222.0.26 () {56 vars in 1099 bytes} [Fri Aug 12 01:20:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:20:53.964070 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c609e3-9356-4aa5-83e8-ed325a50b345 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:20:54.068519 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c609e3-9356-4aa5-83e8-ed325a50b345 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:20:54.102916 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbcbc7e-8c60-4a7e-91a2-b07ca2e8cedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:20:54.103519 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbcbc7e-8c60-4a7e-91a2-b07ca2e8cedd None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:54.103785 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbcbc7e-8c60-4a7e-91a2-b07ca2e8cedd None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:54.104046 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbcbc7e-8c60-4a7e-91a2-b07ca2e8cedd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:54.114347 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbcbc7e-8c60-4a7e-91a2-b07ca2e8cedd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:20:54.115773 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbcbc7e-8c60-4a7e-91a2-b07ca2e8cedd None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:20:54.130165 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-4cbcbc7e-8c60-4a7e-91a2-b07ca2e8cedd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:20:54.130165 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:20:54.130165 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:20:54.130165 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:20:54.130165 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:20:54.130165 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:20:54.130165 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:20:54.130165 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:20:54.130165 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:20:54.130165 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:20:54.130165 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:20:54.130165 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:20:54.130165 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 01:20:54.130165 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 01:20:54.130165 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 01:20:54.130165 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 01:20:54.131258 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:20:54.131258 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:20:54.131258 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:20:54.131258 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:20:54.131258 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:20:54.131258 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:20:54.131258 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:20:54.131258 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:20:54.131258 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:20:54.131258 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:20:54.131258 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:20:54.131258 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:20:54.131258 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:20:54.131258 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:20:54.131258 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:20:54.131258 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:20:54.131258 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 01:20:54.132331 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 01:20:54.132331 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:20:54.132331 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:20:54.134290 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 636/1278] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:20:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:20:54.137589 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37db432-d8f4-4f57-a29a-c9bcfd37b5ed None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:20:54.258439 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37db432-d8f4-4f57-a29a-c9bcfd37b5ed None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:20:54.293332 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af45d20-0035-42a6-9747-6f5d38736cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:20:54.293925 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af45d20-0035-42a6-9747-6f5d38736cd3 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:54.294221 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af45d20-0035-42a6-9747-6f5d38736cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:54.294487 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af45d20-0035-42a6-9747-6f5d38736cd3 None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:54.295116 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af45d20-0035-42a6-9747-6f5d38736cd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:20:54.295411 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af45d20-0035-42a6-9747-6f5d38736cd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:20:54.296763 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af45d20-0035-42a6-9747-6f5d38736cd3 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:20:54.308017 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 643/1279] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 01:20:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:20:54.314614 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbcbc7e-8c60-4a7e-91a2-b07ca2e8cedd None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:20:54.354251 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:20:54.432865 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbcbc7e-8c60-4a7e-91a2-b07ca2e8cedd None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:20:54.471447 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e0854e-9e90-4139-8038-c0a66dee3097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:20:54.472067 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e0854e-9e90-4139-8038-c0a66dee3097 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:54.472343 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e0854e-9e90-4139-8038-c0a66dee3097 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:54.472614 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e0854e-9e90-4139-8038-c0a66dee3097 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:54.481048 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e0854e-9e90-4139-8038-c0a66dee3097 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:20:54.482543 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e0854e-9e90-4139-8038-c0a66dee3097 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:20:54.498333 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-26e0854e-9e90-4139-8038-c0a66dee3097 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 12 01:20:54.498333 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:20:54.498333 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:20:54.498333 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:20:54.498333 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:20:54.498333 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:20:54.498333 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:20:54.498333 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:20:54.498333 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:20:54.498333 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:20:54.498333 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:20:54.498333 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:20:54.498333 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 12 01:20:54.498333 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 12 01:20:54.498333 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 12 01:20:54.498333 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 12 01:20:54.499431 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:20:54.499431 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:20:54.499431 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 12 01:20:54.499431 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 01:20:54.499431 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 12 01:20:54.499431 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 12 01:20:54.499431 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:20:54.499431 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:20:54.499431 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:20:54.499431 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:20:54.499431 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:20:54.499431 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:20:54.499431 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:20:54.499431 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:20:54.499431 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:20:54.499431 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:20:54.499431 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:20:54.499431 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:20:54.500682 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:20:54.500682 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:20:54.500682 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 12 01:20:54.500682 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 12 01:20:54.500682 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 12 01:20:54.500682 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 12 01:20:54.500682 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 12 01:20:54.500682 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 12 01:20:54.500682 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 12 01:20:54.500682 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:20:54.500682 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 637/1280] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:20:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:20:54.508001 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af45d20-0035-42a6-9747-6f5d38736cd3 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:20:54.514022 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:20:54.612650 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af45d20-0035-42a6-9747-6f5d38736cd3 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:20:54.647413 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdc528e-2972-4229-91c8-263b9315d667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:20:54.648000 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc528e-2972-4229-91c8-263b9315d667 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:54.648266 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc528e-2972-4229-91c8-263b9315d667 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:54.648503 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc528e-2972-4229-91c8-263b9315d667 None admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:54.649235 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdc528e-2972-4229-91c8-263b9315d667 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:20:54.649526 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdc528e-2972-4229-91c8-263b9315d667 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:20:54.650966 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdc528e-2972-4229-91c8-263b9315d667 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:20:54.668015 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 644/1281] 10.222.0.26 () {56 vars in 1143 bytes} [Fri Aug 12 01:20:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:20:54.674087 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e0854e-9e90-4139-8038-c0a66dee3097 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:20:54.764126 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:20:54.775392 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e0854e-9e90-4139-8038-c0a66dee3097 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:20:54.810800 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf796d2e-7ad9-412a-bf4a-e6514c4d0407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:20:54.811403 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf796d2e-7ad9-412a-bf4a-e6514c4d0407 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:54.811684 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf796d2e-7ad9-412a-bf4a-e6514c4d0407 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:54.811973 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf796d2e-7ad9-412a-bf4a-e6514c4d0407 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:54.879972 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf796d2e-7ad9-412a-bf4a-e6514c4d0407 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:20:54.881351 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf796d2e-7ad9-412a-bf4a-e6514c4d0407 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:20:54.976992 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:20:54.988757 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 638/1282] 10.222.0.26 () {58 vars in 1282 bytes} [Fri Aug 12 01:20:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 12 01:20:54.994824 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdc528e-2972-4229-91c8-263b9315d667 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:20:55.058878 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:20:55.099764 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdc528e-2972-4229-91c8-263b9315d667 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:20:55.133981 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d04051d-db3c-4478-b250-6f5f189b606b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:20:55.134552 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04051d-db3c-4478-b250-6f5f189b606b None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:55.134820 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04051d-db3c-4478-b250-6f5f189b606b None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:55.135082 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04051d-db3c-4478-b250-6f5f189b606b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:55.148631 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d04051d-db3c-4478-b250-6f5f189b606b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:20:55.150094 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d04051d-db3c-4478-b250-6f5f189b606b None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:20:55.166219 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-1d04051d-db3c-4478-b250-6f5f189b606b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:20:55.166219 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:20:55.166219 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:20:55.166219 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:20:55.166219 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:20:55.166219 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:20:55.166219 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:20:55.166219 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:20:55.166219 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:20:55.166219 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:20:55.166219 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:20:55.166219 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:20:55.166219 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 12 01:20:55.166219 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 12 01:20:55.166219 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 12 01:20:55.166219 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 12 01:20:55.167320 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:20:55.167320 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:20:55.167320 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:20:55.167320 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:20:55.167320 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:20:55.167320 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:20:55.167320 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:20:55.167320 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:20:55.167320 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:20:55.167320 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:20:55.167320 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:20:55.167320 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:20:55.167320 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:20:55.167320 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:20:55.167320 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:20:55.167320 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:20:55.167320 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 12 01:20:55.168199 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 12 01:20:55.168199 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 12 01:20:55.168199 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:20:55.168199 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 645/1283] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:20:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:20:55.173243 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf796d2e-7ad9-412a-bf4a-e6514c4d0407 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:20:55.276980 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf796d2e-7ad9-412a-bf4a-e6514c4d0407 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:20:55.311688 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc364174-0abf-4f87-aaa1-2ab9be3669e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:20:55.312290 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc364174-0abf-4f87-aaa1-2ab9be3669e4 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:55.312566 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc364174-0abf-4f87-aaa1-2ab9be3669e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:55.312832 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc364174-0abf-4f87-aaa1-2ab9be3669e4 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:55.313469 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc364174-0abf-4f87-aaa1-2ab9be3669e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:20:55.313915 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc364174-0abf-4f87-aaa1-2ab9be3669e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:20:55.315381 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc364174-0abf-4f87-aaa1-2ab9be3669e4 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:20:55.326688 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 639/1284] 10.222.0.26 () {56 vars in 1109 bytes} [Fri Aug 12 01:20:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:20:55.333073 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d04051d-db3c-4478-b250-6f5f189b606b None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:20:55.438302 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d04051d-db3c-4478-b250-6f5f189b606b None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:20:55.452224 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:20:55.474517 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a11cf-0fe1-4dea-a2bb-05b1f9bf7417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:20:55.475132 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a11cf-0fe1-4dea-a2bb-05b1f9bf7417 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:55.475405 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a11cf-0fe1-4dea-a2bb-05b1f9bf7417 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:55.475669 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a11cf-0fe1-4dea-a2bb-05b1f9bf7417 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:55.482500 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2a11cf-0fe1-4dea-a2bb-05b1f9bf7417 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:20:55.483933 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2a11cf-0fe1-4dea-a2bb-05b1f9bf7417 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:20:55.495144 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-bd2a11cf-0fe1-4dea-a2bb-05b1f9bf7417 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 01:20:55.495144 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:20:55.495144 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:20:55.495144 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:20:55.495144 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:20:55.495144 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:20:55.495144 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:20:55.495144 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:20:55.495144 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:20:55.495144 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:20:55.495144 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:20:55.495144 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:20:55.495144 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 12 01:20:55.495144 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 12 01:20:55.495144 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 12 01:20:55.496121 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 12 01:20:55.496121 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:20:55.496121 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:20:55.496121 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:20:55.496121 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:20:55.496121 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:20:55.496121 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:20:55.496121 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:20:55.496121 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Aug 12 01:20:55.496121 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:20:55.496121 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:20:55.496121 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:20:55.496121 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:20:55.496121 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:20:55.496121 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:20:55.496121 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:20:55.496121 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:20:55.497215 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 12 01:20:55.497215 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 12 01:20:55.497215 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 12 01:20:55.497215 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 12 01:20:55.497215 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 12 01:20:55.497215 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 12 01:20:55.497215 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 12 01:20:55.497215 dv-cinder-784815-15-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Aug 12 01:20:55.497215 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 646/1285] 10.222.0.26 () {56 vars in 1111 bytes} [Fri Aug 12 01:20:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:20:55.502591 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc364174-0abf-4f87-aaa1-2ab9be3669e4 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:20:55.553479 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:20:55.604945 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc364174-0abf-4f87-aaa1-2ab9be3669e4 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:20:55.639732 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f80c20-41d7-4d86-9b5c-696004d88a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:20:55.640320 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f80c20-41d7-4d86-9b5c-696004d88a23 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:55.640586 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f80c20-41d7-4d86-9b5c-696004d88a23 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:55.640848 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f80c20-41d7-4d86-9b5c-696004d88a23 None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:55.641528 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f80c20-41d7-4d86-9b5c-696004d88a23 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:20:55.641848 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f80c20-41d7-4d86-9b5c-696004d88a23 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:20:55.643279 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f80c20-41d7-4d86-9b5c-696004d88a23 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:20:55.655360 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 640/1286] 10.222.0.26 () {56 vars in 1148 bytes} [Fri Aug 12 01:20:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:20:55.662667 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a11cf-0fe1-4dea-a2bb-05b1f9bf7417 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:20:55.770530 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a11cf-0fe1-4dea-a2bb-05b1f9bf7417 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:20:55.805107 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4964b96-d703-4371-973a-1410ecddade4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:20:55.805686 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4964b96-d703-4371-973a-1410ecddade4 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:55.805957 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4964b96-d703-4371-973a-1410ecddade4 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:55.806254 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4964b96-d703-4371-973a-1410ecddade4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:55.806971 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4964b96-d703-4371-973a-1410ecddade4 None admin] RBAC: Adding query filter params (role.id=fb48693810be495fb4b1893a79429b78, scope.project.id=fa91143910a74c6b896ced5b51f9966a, user.id=06dccf61c686414d904bdf1ecf19d53d) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:20:55.807269 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4964b96-d703-4371-973a-1410ecddade4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:20:55.808676 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4964b96-d703-4371-973a-1410ecddade4 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:20:55.814596 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 647/1287] 10.222.0.26 () {56 vars in 1374 bytes} [Fri Aug 12 01:20:55 2022] GET /identity/v3/role_assignments?user.id=06dccf61c686414d904bdf1ecf19d53d&scope.project.id=fa91143910a74c6b896ced5b51f9966a&role.id=fb48693810be495fb4b1893a79429b78 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:20:57.711384 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337c93d-8a11-422d-ba56-18034f3873c4 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:57.711947 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337c93d-8a11-422d-ba56-18034f3873c4 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:57.711947 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337c93d-8a11-422d-ba56-18034f3873c4 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:57.714065 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 641/1288] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:20:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:20:57.722767 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8eb78e-90ac-4a92-8051-c58b9627ec8a None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:57.723183 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8eb78e-90ac-4a92-8051-c58b9627ec8a None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:57.723330 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8eb78e-90ac-4a92-8051-c58b9627ec8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:57.752381 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-6e8eb78e-90ac-4a92-8051-c58b9627ec8a None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:20:57.753519 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-6e8eb78e-90ac-4a92-8051-c58b9627ec8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:20:57.785741 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:20:57.835047 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 648/1289] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:20:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 01:20:58.096238 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e337c93d-8a11-422d-ba56-18034f3873c4 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:20:58.219339 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e337c93d-8a11-422d-ba56-18034f3873c4 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:20:58.231431 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:20:58.258749 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60ae498-d284-4bf6-a491-27caaeeb2dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:20:58.259450 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ae498-d284-4bf6-a491-27caaeeb2dff None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:58.259726 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ae498-d284-4bf6-a491-27caaeeb2dff None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:58.260065 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ae498-d284-4bf6-a491-27caaeeb2dff None admin] PATH_INFO: `/v3/services/placement` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:58.260742 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60ae498-d284-4bf6-a491-27caaeeb2dff None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:20:58.262273 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60ae498-d284-4bf6-a491-27caaeeb2dff None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:20:58.270694 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-a60ae498-d284-4bf6-a491-27caaeeb2dff None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 12 01:20:58.270694 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:20:58.270694 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 01:20:58.270694 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 01:20:58.270694 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 01:20:58.270694 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 01:20:58.270694 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 01:20:58.270694 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 01:20:58.270694 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 12 01:20:58.270694 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:20:58.270694 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 01:20:58.270694 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:20:58.270694 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:20:58.270694 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:20:58.270694 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:20:58.270694 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:20:58.270694 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:20:58.271947 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:20:58.271947 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:20:58.271947 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:20:58.271947 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:20:58.271947 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:20:58.271947 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:20:58.271947 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 01:20:58.271947 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 01:20:58.271947 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 01:20:58.271947 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 01:20:58.271947 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:20:58.271947 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:20:58.271947 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:20:58.271947 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:20:58.271947 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:20:58.271947 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:20:58.272806 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:20:58.272806 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:20:58.272806 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:20:58.272806 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:20:58.272806 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:20:58.272806 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:20:58.272806 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:20:58.272806 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:20:58.272806 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:20:58.272806 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:20:58.272806 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 01:20:58.272806 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 01:20:58.272806 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 12 01:20:58.272806 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:20:58.272806 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 642/1290] 10.222.0.26 () {56 vars in 1117 bytes} [Fri Aug 12 01:20:58 2022] GET /identity/v3/services/placement => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:20:58.278345 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8eb78e-90ac-4a92-8051-c58b9627ec8a None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:20:58.376358 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8eb78e-90ac-4a92-8051-c58b9627ec8a None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:20:58.411815 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de904981-21b6-4b5e-b673-f7e279c8b293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:20:58.412404 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de904981-21b6-4b5e-b673-f7e279c8b293 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:58.412674 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de904981-21b6-4b5e-b673-f7e279c8b293 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:58.412938 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de904981-21b6-4b5e-b673-f7e279c8b293 None admin] PATH_INFO: `/v3/services` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:58.413556 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de904981-21b6-4b5e-b673-f7e279c8b293 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:20:58.413868 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de904981-21b6-4b5e-b673-f7e279c8b293 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:20:58.415241 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de904981-21b6-4b5e-b673-f7e279c8b293 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:20:58.420047 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 649/1291] 10.222.0.26 () {56 vars in 1116 bytes} [Fri Aug 12 01:20:58 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:20:58.426304 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60ae498-d284-4bf6-a491-27caaeeb2dff None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:20:58.529171 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60ae498-d284-4bf6-a491-27caaeeb2dff None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:20:58.564293 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eefbc9e-5a32-4d8c-a913-3edfa5285b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:20:58.564886 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eefbc9e-5a32-4d8c-a913-3edfa5285b49 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:20:58.565156 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eefbc9e-5a32-4d8c-a913-3edfa5285b49 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:20:58.565417 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eefbc9e-5a32-4d8c-a913-3edfa5285b49 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:20:58.566032 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eefbc9e-5a32-4d8c-a913-3edfa5285b49 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:20:58.566353 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eefbc9e-5a32-4d8c-a913-3edfa5285b49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:20:58.567706 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eefbc9e-5a32-4d8c-a913-3edfa5285b49 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:20:58.572205 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 643/1292] 10.222.0.26 () {56 vars in 1116 bytes} [Fri Aug 12 01:20:58 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:21:00.461107 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1157bc-dbc5-458f-bf0c-3ca8f86302ff None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:21:00.461951 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1157bc-dbc5-458f-bf0c-3ca8f86302ff None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:21:00.461951 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1157bc-dbc5-458f-bf0c-3ca8f86302ff None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:21:00.464117 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 650/1293] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:21:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:21:00.469430 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e23fd9-71ee-44d4-8743-c5a13f9c4722 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:21:00.470055 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e23fd9-71ee-44d4-8743-c5a13f9c4722 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:21:00.470055 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e23fd9-71ee-44d4-8743-c5a13f9c4722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:21:00.493704 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-c8e23fd9-71ee-44d4-8743-c5a13f9c4722 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:21:00.494929 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c8e23fd9-71ee-44d4-8743-c5a13f9c4722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:21:00.525835 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:21:00.564611 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 644/1294] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:21:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 01:21:00.831993 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1157bc-dbc5-458f-bf0c-3ca8f86302ff None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:21:00.869347 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:21:00.945395 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1157bc-dbc5-458f-bf0c-3ca8f86302ff None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:21:00.981372 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2031dd25-ce1a-4221-b3aa-6053aa513c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:21:00.981968 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031dd25-ce1a-4221-b3aa-6053aa513c0b None admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:21:00.982270 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031dd25-ce1a-4221-b3aa-6053aa513c0b None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:21:00.982542 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031dd25-ce1a-4221-b3aa-6053aa513c0b None admin] PATH_INFO: `/v3/services` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:21:00.983190 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2031dd25-ce1a-4221-b3aa-6053aa513c0b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:21:00.984555 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2031dd25-ce1a-4221-b3aa-6053aa513c0b None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:21:01.001630 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 651/1295] 10.222.0.26 () {60 vars in 1141 bytes} [Fri Aug 12 01:21:00 2022] POST /identity/v3/services => generated 246 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:21:02.935799 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89149c21-a448-46ec-87d2-7038895d36a0 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:21:02.936332 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89149c21-a448-46ec-87d2-7038895d36a0 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:21:02.936515 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89149c21-a448-46ec-87d2-7038895d36a0 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:21:02.938440 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 645/1296] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:21:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:21:02.945827 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f77dc2-bbdc-4b01-a0c8-70e0a64f6975 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:21:02.946306 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f77dc2-bbdc-4b01-a0c8-70e0a64f6975 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:21:02.946397 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f77dc2-bbdc-4b01-a0c8-70e0a64f6975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:21:02.974891 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-c5f77dc2-bbdc-4b01-a0c8-70e0a64f6975 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:21:02.976075 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-c5f77dc2-bbdc-4b01-a0c8-70e0a64f6975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:21:03.054208 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 652/1297] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:21:02 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 01:21:03.322572 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89149c21-a448-46ec-87d2-7038895d36a0 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:21:03.435227 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89149c21-a448-46ec-87d2-7038895d36a0 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:21:03.470266 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a8f57f-223f-4cdd-8995-cbdacddfdcc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:21:03.470886 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8f57f-223f-4cdd-8995-cbdacddfdcc4 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:21:03.471164 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8f57f-223f-4cdd-8995-cbdacddfdcc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:21:03.471439 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8f57f-223f-4cdd-8995-cbdacddfdcc4 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:21:03.472032 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a8f57f-223f-4cdd-8995-cbdacddfdcc4 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:21:03.473375 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a8f57f-223f-4cdd-8995-cbdacddfdcc4 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:21:03.482314 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-85a8f57f-223f-4cdd-8995-cbdacddfdcc4 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 12 01:21:03.482314 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:21:03.482314 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 01:21:03.482314 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 01:21:03.482314 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 01:21:03.482314 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 01:21:03.482314 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 01:21:03.482314 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 01:21:03.482314 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 12 01:21:03.482314 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:21:03.482314 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 01:21:03.482314 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:21:03.482314 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:21:03.482314 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:21:03.482314 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:21:03.482314 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:21:03.482314 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:21:03.483461 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:21:03.483461 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:21:03.483461 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:21:03.483461 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:21:03.483461 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:21:03.483461 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:21:03.483461 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 01:21:03.483461 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 01:21:03.483461 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 01:21:03.483461 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 01:21:03.483461 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:21:03.483461 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:21:03.483461 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:21:03.483461 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:21:03.483461 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:21:03.483461 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:21:03.484703 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:21:03.484703 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:21:03.484703 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:21:03.484703 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:21:03.484703 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:21:03.484703 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:21:03.484703 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:21:03.484703 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:21:03.484703 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:21:03.484703 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:21:03.484703 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 01:21:03.484703 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 01:21:03.484703 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 12 01:21:03.484703 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:21:03.484703 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 646/1298] 10.222.0.26 () {56 vars in 1117 bytes} [Fri Aug 12 01:21:03 2022] GET /identity/v3/services/placement => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:21:03.489692 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f77dc2-bbdc-4b01-a0c8-70e0a64f6975 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:21:03.508371 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:21:03.606523 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f77dc2-bbdc-4b01-a0c8-70e0a64f6975 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:21:03.645350 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5efc7c6-50ae-4ec5-bed2-87d49de51779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:21:03.645942 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5efc7c6-50ae-4ec5-bed2-87d49de51779 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:21:03.646248 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5efc7c6-50ae-4ec5-bed2-87d49de51779 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:21:03.646514 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5efc7c6-50ae-4ec5-bed2-87d49de51779 None admin] PATH_INFO: `/v3/services` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:21:03.647131 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5efc7c6-50ae-4ec5-bed2-87d49de51779 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:21:03.647427 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5efc7c6-50ae-4ec5-bed2-87d49de51779 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:21:03.648784 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5efc7c6-50ae-4ec5-bed2-87d49de51779 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:21:03.654699 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 653/1299] 10.222.0.26 () {56 vars in 1116 bytes} [Fri Aug 12 01:21:03 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:21:03.664956 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a8f57f-223f-4cdd-8995-cbdacddfdcc4 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:21:03.707155 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:21:03.794214 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a8f57f-223f-4cdd-8995-cbdacddfdcc4 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:21:03.833251 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149fe8e5-83f4-424e-afd3-a2dcfb9c1046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:21:03.833847 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149fe8e5-83f4-424e-afd3-a2dcfb9c1046 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:21:03.834147 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149fe8e5-83f4-424e-afd3-a2dcfb9c1046 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:21:03.834415 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149fe8e5-83f4-424e-afd3-a2dcfb9c1046 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:21:03.835105 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149fe8e5-83f4-424e-afd3-a2dcfb9c1046 None admin] RBAC: Adding query filter params (interface=public, service_id=7d6b71dd11a5479a8acd86c359b7515b, region_id=RegionOne) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:21:03.835408 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149fe8e5-83f4-424e-afd3-a2dcfb9c1046 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:21:03.836800 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149fe8e5-83f4-424e-afd3-a2dcfb9c1046 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:21:03.841762 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 647/1300] 10.222.0.26 () {56 vars in 1251 bytes} [Fri Aug 12 01:21:03 2022] GET /identity/v3/endpoints?service_id=7d6b71dd11a5479a8acd86c359b7515b&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:21:03.847728 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5efc7c6-50ae-4ec5-bed2-87d49de51779 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:21:03.935112 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:21:03.953931 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5efc7c6-50ae-4ec5-bed2-87d49de51779 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:21:03.994931 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ae39ef-26ef-4701-82cd-df01d106c3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:21:03.995533 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae39ef-26ef-4701-82cd-df01d106c3f6 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:21:03.995805 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae39ef-26ef-4701-82cd-df01d106c3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:21:03.996073 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae39ef-26ef-4701-82cd-df01d106c3f6 None admin] PATH_INFO: `/v3/services` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:21:03.996668 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ae39ef-26ef-4701-82cd-df01d106c3f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:21:03.998017 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ae39ef-26ef-4701-82cd-df01d106c3f6 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:21:04.005222 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 654/1301] 10.222.0.26 () {56 vars in 1087 bytes} [Fri Aug 12 01:21:03 2022] GET /identity/v3/services => generated 2191 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:21:05.855154 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ade423-b7c2-4a2f-9901-6878b2cb0b7d None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:21:05.855971 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ade423-b7c2-4a2f-9901-6878b2cb0b7d None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:21:05.855971 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ade423-b7c2-4a2f-9901-6878b2cb0b7d None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:21:05.857951 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 648/1302] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:21:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:21:05.863404 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38645f1e-46ed-4086-b357-cad35571becd None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:21:05.863838 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38645f1e-46ed-4086-b357-cad35571becd None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:21:05.863929 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38645f1e-46ed-4086-b357-cad35571becd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:21:05.883335 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-38645f1e-46ed-4086-b357-cad35571becd None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:21:05.884507 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-38645f1e-46ed-4086-b357-cad35571becd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:21:05.953271 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 655/1303] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:21:05 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 12 01:21:06.230877 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ade423-b7c2-4a2f-9901-6878b2cb0b7d None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:21:06.329835 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:21:06.337398 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ade423-b7c2-4a2f-9901-6878b2cb0b7d None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:21:06.372372 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8cd47b-c13f-4a52-999e-f33f5ab34511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:21:06.372985 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8cd47b-c13f-4a52-999e-f33f5ab34511 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:21:06.373256 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8cd47b-c13f-4a52-999e-f33f5ab34511 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:21:06.373517 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8cd47b-c13f-4a52-999e-f33f5ab34511 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:21:06.374087 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8cd47b-c13f-4a52-999e-f33f5ab34511 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:21:06.375621 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8cd47b-c13f-4a52-999e-f33f5ab34511 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:21:06.384306 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-8e8cd47b-c13f-4a52-999e-f33f5ab34511 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 12 01:21:06.384306 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:21:06.384306 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 12 01:21:06.384306 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 12 01:21:06.384306 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 12 01:21:06.384306 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 12 01:21:06.384306 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 12 01:21:06.384306 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 01:21:06.384306 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 12 01:21:06.384306 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:21:06.384306 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 12 01:21:06.384306 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:21:06.384306 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 12 01:21:06.384306 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 12 01:21:06.384306 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 12 01:21:06.384306 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 12 01:21:06.384306 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 12 01:21:06.385435 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 12 01:21:06.385435 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 12 01:21:06.385435 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 12 01:21:06.385435 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 12 01:21:06.385435 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 12 01:21:06.385435 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 12 01:21:06.385435 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 12 01:21:06.385435 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 12 01:21:06.385435 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 12 01:21:06.385435 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 12 01:21:06.385435 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 12 01:21:06.385435 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 12 01:21:06.385435 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 12 01:21:06.385435 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 12 01:21:06.385435 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 12 01:21:06.385435 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Aug 12 01:21:06.386582 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 12 01:21:06.386582 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Aug 12 01:21:06.386582 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 12 01:21:06.386582 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Aug 12 01:21:06.386582 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 12 01:21:06.386582 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 12 01:21:06.386582 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 12 01:21:06.386582 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Aug 12 01:21:06.386582 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 12 01:21:06.386582 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Aug 12 01:21:06.386582 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 12 01:21:06.386582 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 12 01:21:06.386582 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 12 01:21:06.386582 dv-cinder-784815-15-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Aug 12 01:21:06.386582 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 649/1304] 10.222.0.26 () {56 vars in 1117 bytes} [Fri Aug 12 01:21:06 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 12 01:21:06.394330 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38645f1e-46ed-4086-b357-cad35571becd None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:21:06.474029 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:21:06.500582 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38645f1e-46ed-4086-b357-cad35571becd None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:21:06.536988 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9d69e7-aef1-4148-a0e8-a52137997e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:21:06.537580 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d69e7-aef1-4148-a0e8-a52137997e66 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:21:06.537856 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d69e7-aef1-4148-a0e8-a52137997e66 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:21:06.538160 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d69e7-aef1-4148-a0e8-a52137997e66 None admin] PATH_INFO: `/v3/services` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:21:06.538774 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9d69e7-aef1-4148-a0e8-a52137997e66 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:21:06.539070 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9d69e7-aef1-4148-a0e8-a52137997e66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:21:06.540431 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9d69e7-aef1-4148-a0e8-a52137997e66 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:21:06.545751 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 656/1305] 10.222.0.26 () {56 vars in 1116 bytes} [Fri Aug 12 01:21:06 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:21:06.551960 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8cd47b-c13f-4a52-999e-f33f5ab34511 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:21:06.660312 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8cd47b-c13f-4a52-999e-f33f5ab34511 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:21:06.703386 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86107d3d-85ff-4f70-ba8a-337dde2fff0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:21:06.703973 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86107d3d-85ff-4f70-ba8a-337dde2fff0c None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:21:06.704244 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86107d3d-85ff-4f70-ba8a-337dde2fff0c None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:21:06.704507 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86107d3d-85ff-4f70-ba8a-337dde2fff0c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:21:06.705147 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86107d3d-85ff-4f70-ba8a-337dde2fff0c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:21:06.706535 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86107d3d-85ff-4f70-ba8a-337dde2fff0c None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:21:06.728902 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 650/1306] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:21:06 2022] POST /identity/v3/endpoints => generated 331 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:21:16.542517 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=30 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:21:16.724575 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:22:10.593914 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a5d789-2fd4-444a-89b5-3bc4d1832a4b None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:22:10.594414 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a5d789-2fd4-444a-89b5-3bc4d1832a4b None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:22:10.594503 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a5d789-2fd4-444a-89b5-3bc4d1832a4b None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:22:10.599990 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 657/1307] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:22:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:22:10.601203 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36fb960-f79b-4c16-ab00-6d695afc5414 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:22:10.601602 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36fb960-f79b-4c16-ab00-6d695afc5414 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:22:10.601845 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36fb960-f79b-4c16-ab00-6d695afc5414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:22:10.754337 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-d36fb960-f79b-4c16-ab00-6d695afc5414 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:22:10.755547 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d36fb960-f79b-4c16-ab00-6d695afc5414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:22:10.864704 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 651/1308] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:22:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:22:11.166159 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10147453-ef4b-4b05-a966-fa3d7e2c0c46 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:22:11.166934 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10147453-ef4b-4b05-a966-fa3d7e2c0c46 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:22:11.166934 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10147453-ef4b-4b05-a966-fa3d7e2c0c46 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:22:11.168225 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 658/1309] 10.222.0.26 () {54 vars in 965 bytes} [Fri Aug 12 01:22:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:22:11.174144 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c564892a-6cfd-4b53-84aa-23d7c55ea82b None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:22:11.174701 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c564892a-6cfd-4b53-84aa-23d7c55ea82b None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:22:11.175188 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c564892a-6cfd-4b53-84aa-23d7c55ea82b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:22:11.263290 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-c564892a-6cfd-4b53-84aa-23d7c55ea82b None None] MFA Rules not processed for user `a80678458dc9405285b70da707a399c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:22:11.265077 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c564892a-6cfd-4b53-84aa-23d7c55ea82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:22:11.288868 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:22:11.348467 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 652/1310] 10.222.0.26 () {58 vars in 1062 bytes} [Fri Aug 12 01:22:11 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:22:11.358650 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10147453-ef4b-4b05-a966-fa3d7e2c0c46 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:22:11.360719 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-10147453-ef4b-4b05-a966-fa3d7e2c0c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:22:11.529004 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10147453-ef4b-4b05-a966-fa3d7e2c0c46 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:22:11.620347 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c26841-b8d4-4afe-8b85-5b89ece44520 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:22:11.620938 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c26841-b8d4-4afe-8b85-5b89ece44520 service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:22:11.621215 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c26841-b8d4-4afe-8b85-5b89ece44520 service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:22:11.621480 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c26841-b8d4-4afe-8b85-5b89ece44520 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:22:11.623110 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-a4c26841-b8d4-4afe-8b85-5b89ece44520 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:22:11.685400 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:22:11.750149 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c26841-b8d4-4afe-8b85-5b89ece44520 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:22:11.751619 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c26841-b8d4-4afe-8b85-5b89ece44520 service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:22:11.771806 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 659/1311] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:22:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:22:13.960931 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f8cde-2db0-43e6-97eb-3a5acc7dab8d None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:22:13.961498 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f8cde-2db0-43e6-97eb-3a5acc7dab8d None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:22:13.961498 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f8cde-2db0-43e6-97eb-3a5acc7dab8d None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:22:13.962866 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 653/1312] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:22:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:22:13.970330 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c470acba-92f3-419b-8a1a-7a5deda7bdd8 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:22:13.970880 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c470acba-92f3-419b-8a1a-7a5deda7bdd8 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:22:13.970880 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c470acba-92f3-419b-8a1a-7a5deda7bdd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:22:14.063158 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-c470acba-92f3-419b-8a1a-7a5deda7bdd8 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:22:14.064396 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-c470acba-92f3-419b-8a1a-7a5deda7bdd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:22:14.163484 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 660/1313] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:22:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:22:14.479433 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f06989-4f32-4607-8d79-3645425882d6 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:22:14.479718 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f06989-4f32-4607-8d79-3645425882d6 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:22:14.479974 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f06989-4f32-4607-8d79-3645425882d6 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:22:14.481823 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 654/1314] 10.222.0.26 () {54 vars in 965 bytes} [Fri Aug 12 01:22:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:22:14.489046 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b7014-2b65-427e-ac3e-b1d700598428 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:22:14.489349 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b7014-2b65-427e-ac3e-b1d700598428 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:22:14.489991 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b7014-2b65-427e-ac3e-b1d700598428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:22:14.502872 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:22:14.573812 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-823b7014-2b65-427e-ac3e-b1d700598428 None None] MFA Rules not processed for user `a80678458dc9405285b70da707a399c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:22:14.575108 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-823b7014-2b65-427e-ac3e-b1d700598428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:22:14.662609 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 661/1315] 10.222.0.26 () {58 vars in 1062 bytes} [Fri Aug 12 01:22:14 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:22:14.672328 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f06989-4f32-4607-8d79-3645425882d6 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:22:14.674771 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-a0f06989-4f32-4607-8d79-3645425882d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:22:14.797586 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f06989-4f32-4607-8d79-3645425882d6 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:22:14.872611 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:22:14.875665 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f97fabd-eacb-4903-8cbc-3e34d2ffac0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:22:14.876275 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f97fabd-eacb-4903-8cbc-3e34d2ffac0a service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:22:14.876555 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f97fabd-eacb-4903-8cbc-3e34d2ffac0a service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:22:14.876833 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f97fabd-eacb-4903-8cbc-3e34d2ffac0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:22:14.879037 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-7f97fabd-eacb-4903-8cbc-3e34d2ffac0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:22:14.993900 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f97fabd-eacb-4903-8cbc-3e34d2ffac0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:22:14.995371 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f97fabd-eacb-4903-8cbc-3e34d2ffac0a service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:22:15.014290 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 655/1316] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:22:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:22:17.433939 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d409cff-1c4a-4d91-a920-032e09b17569 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:22:17.434520 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d409cff-1c4a-4d91-a920-032e09b17569 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:22:17.434601 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d409cff-1c4a-4d91-a920-032e09b17569 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:22:17.435946 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 662/1317] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:22:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:22:17.441378 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193216b-f345-4a6c-8e7a-e181990afb98 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:22:17.441798 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193216b-f345-4a6c-8e7a-e181990afb98 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:22:17.441959 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193216b-f345-4a6c-8e7a-e181990afb98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:22:17.512049 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-8193216b-f345-4a6c-8e7a-e181990afb98 None None] MFA Rules not processed for user `5f6ec5f1c46f46ccb2adc6dd83aafb22`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:22:17.513273 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-8193216b-f345-4a6c-8e7a-e181990afb98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:22:17.565014 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:22:17.623041 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 656/1318] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:22:17 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:22:17.910889 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d409cff-1c4a-4d91-a920-032e09b17569 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:22:17.913347 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-4d409cff-1c4a-4d91-a920-032e09b17569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:22:18.040900 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d409cff-1c4a-4d91-a920-032e09b17569 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:22:18.046007 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:22:18.127681 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf6811-5a6e-43dd-8831-c2d9e94c6ae4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:22:18.128277 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf6811-5a6e-43dd-8831-c2d9e94c6ae4 service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:22:18.128505 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf6811-5a6e-43dd-8831-c2d9e94c6ae4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:22:18.128803 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf6811-5a6e-43dd-8831-c2d9e94c6ae4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:22:18.130437 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-05cf6811-5a6e-43dd-8831-c2d9e94c6ae4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:22:18.242623 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cf6811-5a6e-43dd-8831-c2d9e94c6ae4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:22:18.244061 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cf6811-5a6e-43dd-8831-c2d9e94c6ae4 service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:22:18.263370 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 663/1319] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:22:17 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:22:20.777100 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f4a67-12f4-4508-819c-c53476f37e2b None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:22:20.777680 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f4a67-12f4-4508-819c-c53476f37e2b None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:22:20.777923 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f4a67-12f4-4508-819c-c53476f37e2b None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:22:20.779993 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 657/1320] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:22:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:22:20.786700 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a6f41-5250-45a1-9ade-3c39eb1b0f5a None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:22:20.787634 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a6f41-5250-45a1-9ade-3c39eb1b0f5a None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:22:20.787634 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a6f41-5250-45a1-9ade-3c39eb1b0f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:22:20.835309 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:22:20.862671 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-434a6f41-5250-45a1-9ade-3c39eb1b0f5a None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:22:20.863878 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-434a6f41-5250-45a1-9ade-3c39eb1b0f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:22:20.961994 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 664/1321] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:22:20 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:22:21.262367 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2f4a67-12f4-4508-819c-c53476f37e2b None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:22:21.263924 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-fe2f4a67-12f4-4508-819c-c53476f37e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:22:21.390386 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2f4a67-12f4-4508-819c-c53476f37e2b None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:22:21.475965 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784faf50-64e9-43ed-b5fa-661b6b286899 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:22:21.476564 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784faf50-64e9-43ed-b5fa-661b6b286899 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:22:21.476835 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784faf50-64e9-43ed-b5fa-661b6b286899 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:22:21.477114 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784faf50-64e9-43ed-b5fa-661b6b286899 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:22:21.479028 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-784faf50-64e9-43ed-b5fa-661b6b286899 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:22:21.486887 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:22:21.590509 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784faf50-64e9-43ed-b5fa-661b6b286899 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:22:21.591857 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784faf50-64e9-43ed-b5fa-661b6b286899 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:22:21.610737 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 658/1322] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:22:21 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:22:24.510090 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc38f3c-645e-42e9-acf6-bff0e2085d36 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:22:24.510645 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc38f3c-645e-42e9-acf6-bff0e2085d36 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:22:24.510736 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc38f3c-645e-42e9-acf6-bff0e2085d36 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:22:24.512169 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 665/1323] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:22:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:22:24.517623 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50aa71-0ee6-45f5-8444-fa4cd86a3a98 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:22:24.518362 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50aa71-0ee6-45f5-8444-fa4cd86a3a98 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:22:24.518507 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50aa71-0ee6-45f5-8444-fa4cd86a3a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:22:24.586341 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-6f50aa71-0ee6-45f5-8444-fa4cd86a3a98 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:22:24.587852 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-6f50aa71-0ee6-45f5-8444-fa4cd86a3a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:22:24.649033 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:22:24.690980 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 659/1324] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:22:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:22:24.969334 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc38f3c-645e-42e9-acf6-bff0e2085d36 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:22:24.970972 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-dcc38f3c-645e-42e9-acf6-bff0e2085d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:22:25.078897 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc38f3c-645e-42e9-acf6-bff0e2085d36 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:22:25.091392 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:22:25.157570 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84347654-33c3-4ace-8020-284df7f96219 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:22:25.158282 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84347654-33c3-4ace-8020-284df7f96219 service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:22:25.158533 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84347654-33c3-4ace-8020-284df7f96219 service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:22:25.158802 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84347654-33c3-4ace-8020-284df7f96219 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:22:25.160490 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-84347654-33c3-4ace-8020-284df7f96219 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:22:25.272499 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84347654-33c3-4ace-8020-284df7f96219 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:22:25.273935 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84347654-33c3-4ace-8020-284df7f96219 service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:22:25.292805 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 666/1325] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:22:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:22:27.232539 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c996ef5-705a-4bb7-8b53-4880e6b58b4a None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:22:27.233051 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c996ef5-705a-4bb7-8b53-4880e6b58b4a None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:22:27.233051 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c996ef5-705a-4bb7-8b53-4880e6b58b4a None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:22:27.234385 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 660/1326] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:22:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:22:27.240014 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba17300-974e-4fef-9098-4b1ecbd4a320 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:22:27.240427 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba17300-974e-4fef-9098-4b1ecbd4a320 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:22:27.240639 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba17300-974e-4fef-9098-4b1ecbd4a320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:22:27.292717 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:22:27.311892 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-5ba17300-974e-4fef-9098-4b1ecbd4a320 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:22:27.313120 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-5ba17300-974e-4fef-9098-4b1ecbd4a320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:22:27.413577 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 667/1327] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:22:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:22:27.694501 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c996ef5-705a-4bb7-8b53-4880e6b58b4a None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:22:27.696090 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-1c996ef5-705a-4bb7-8b53-4880e6b58b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:22:27.802421 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c996ef5-705a-4bb7-8b53-4880e6b58b4a None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:22:27.899304 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e7eb76-8e37-4035-876b-3d0dc4834a60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:22:27.899913 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7eb76-8e37-4035-876b-3d0dc4834a60 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:22:27.900186 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7eb76-8e37-4035-876b-3d0dc4834a60 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:22:27.900452 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7eb76-8e37-4035-876b-3d0dc4834a60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:22:27.902040 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-b5e7eb76-8e37-4035-876b-3d0dc4834a60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:22:27.918860 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:22:28.016292 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e7eb76-8e37-4035-876b-3d0dc4834a60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:22:28.018051 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e7eb76-8e37-4035-876b-3d0dc4834a60 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:22:28.037903 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 661/1328] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:22:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:22:29.978785 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615133e-7836-4064-9f41-ee0698c440de None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:22:29.979352 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615133e-7836-4064-9f41-ee0698c440de None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:22:29.979352 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615133e-7836-4064-9f41-ee0698c440de None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:22:29.981399 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 668/1329] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:22:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:22:29.989376 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f20954-9133-4ff3-b122-7f59b1919d12 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:22:29.989900 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f20954-9133-4ff3-b122-7f59b1919d12 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:22:29.989900 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f20954-9133-4ff3-b122-7f59b1919d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:22:30.062352 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-41f20954-9133-4ff3-b122-7f59b1919d12 None None] MFA Rules not processed for user `5f6ec5f1c46f46ccb2adc6dd83aafb22`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:22:30.063928 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-41f20954-9133-4ff3-b122-7f59b1919d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:22:30.129942 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:22:30.163617 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 662/1330] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:22:29 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 01:22:30.443063 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7615133e-7836-4064-9f41-ee0698c440de None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:22:30.444623 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-7615133e-7836-4064-9f41-ee0698c440de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:22:30.556485 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7615133e-7836-4064-9f41-ee0698c440de None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:22:30.576583 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:22:30.633311 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c46168-c34b-48b0-8888-10d9a56ce5a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:22:30.633915 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c46168-c34b-48b0-8888-10d9a56ce5a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:22:30.634223 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c46168-c34b-48b0-8888-10d9a56ce5a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:22:30.634492 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c46168-c34b-48b0-8888-10d9a56ce5a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:22:30.636115 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-44c46168-c34b-48b0-8888-10d9a56ce5a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:22:30.748648 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c46168-c34b-48b0-8888-10d9a56ce5a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:22:30.750061 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c46168-c34b-48b0-8888-10d9a56ce5a3 service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:22:30.769806 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 669/1331] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:22:30 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:22:32.937639 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43179cc-1d4a-4ea1-8a19-89331145c5c3 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:22:32.938259 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43179cc-1d4a-4ea1-8a19-89331145c5c3 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:22:32.938259 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43179cc-1d4a-4ea1-8a19-89331145c5c3 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:22:32.939539 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 663/1332] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:22:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:22:32.945717 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab201f-acb7-43b5-bd0f-af271ebd40c7 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:22:32.946486 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab201f-acb7-43b5-bd0f-af271ebd40c7 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:22:32.946636 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab201f-acb7-43b5-bd0f-af271ebd40c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:22:33.016215 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:22:33.019479 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-07ab201f-acb7-43b5-bd0f-af271ebd40c7 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:22:33.021099 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-07ab201f-acb7-43b5-bd0f-af271ebd40c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:22:33.122240 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 670/1333] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:22:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:22:33.401453 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43179cc-1d4a-4ea1-8a19-89331145c5c3 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:22:33.404146 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c43179cc-1d4a-4ea1-8a19-89331145c5c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:22:33.528283 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43179cc-1d4a-4ea1-8a19-89331145c5c3 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:22:33.610599 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d413d6-cb7e-4b20-bbbb-574156069688 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:22:33.611199 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d413d6-cb7e-4b20-bbbb-574156069688 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:22:33.611468 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d413d6-cb7e-4b20-bbbb-574156069688 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:22:33.611726 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d413d6-cb7e-4b20-bbbb-574156069688 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:22:33.613342 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-49d413d6-cb7e-4b20-bbbb-574156069688 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:22:33.650400 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:22:33.733161 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d413d6-cb7e-4b20-bbbb-574156069688 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:22:33.734615 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d413d6-cb7e-4b20-bbbb-574156069688 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:22:33.752761 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 664/1334] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:22:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:22:35.680274 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753acbe4-a2f4-412b-8b12-1318976d0a5b None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:22:35.680847 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753acbe4-a2f4-412b-8b12-1318976d0a5b None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:22:35.680847 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753acbe4-a2f4-412b-8b12-1318976d0a5b None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:22:35.683114 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 671/1335] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:22:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:22:35.691147 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92692db8-621a-4c94-95ee-e84cdcb2571d None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:22:35.691613 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92692db8-621a-4c94-95ee-e84cdcb2571d None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:22:35.691706 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92692db8-621a-4c94-95ee-e84cdcb2571d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:22:35.766607 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-92692db8-621a-4c94-95ee-e84cdcb2571d None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:22:35.768031 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-92692db8-621a-4c94-95ee-e84cdcb2571d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:22:35.849071 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:22:35.873349 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 665/1336] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:22:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 01:22:36.164661 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753acbe4-a2f4-412b-8b12-1318976d0a5b None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:22:36.167119 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-753acbe4-a2f4-412b-8b12-1318976d0a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:22:36.290738 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753acbe4-a2f4-412b-8b12-1318976d0a5b None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:22:36.335340 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:22:36.392817 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f525e9-db6c-42ed-90d9-79488d3f6602 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:22:36.393418 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f525e9-db6c-42ed-90d9-79488d3f6602 service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:22:36.393690 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f525e9-db6c-42ed-90d9-79488d3f6602 service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:22:36.393953 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f525e9-db6c-42ed-90d9-79488d3f6602 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:22:36.395609 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-28f525e9-db6c-42ed-90d9-79488d3f6602 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:22:36.524423 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f525e9-db6c-42ed-90d9-79488d3f6602 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:22:36.525870 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f525e9-db6c-42ed-90d9-79488d3f6602 service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:22:36.545791 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 672/1337] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:22:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:22:38.804316 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb20d0a-b038-43cb-9d5f-a276814ab586 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:22:38.804889 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb20d0a-b038-43cb-9d5f-a276814ab586 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:22:38.804889 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb20d0a-b038-43cb-9d5f-a276814ab586 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:22:38.806198 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 666/1338] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:22:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:22:38.812817 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880472ab-7b80-4595-9831-e801dda0f7ad None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:22:38.813504 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880472ab-7b80-4595-9831-e801dda0f7ad None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:22:38.813654 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880472ab-7b80-4595-9831-e801dda0f7ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:22:38.889922 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-880472ab-7b80-4595-9831-e801dda0f7ad None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:22:38.891160 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-880472ab-7b80-4595-9831-e801dda0f7ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:22:38.899891 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:22:38.994064 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 673/1339] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:22:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:22:39.280963 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb20d0a-b038-43cb-9d5f-a276814ab586 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:22:39.283443 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-feb20d0a-b038-43cb-9d5f-a276814ab586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:22:39.394489 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb20d0a-b038-43cb-9d5f-a276814ab586 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:22:39.479006 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dbf774-698a-42e0-8b29-7b9433800bda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:22:39.479616 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dbf774-698a-42e0-8b29-7b9433800bda service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:22:39.479946 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dbf774-698a-42e0-8b29-7b9433800bda service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:22:39.480188 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dbf774-698a-42e0-8b29-7b9433800bda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:22:39.481805 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-45dbf774-698a-42e0-8b29-7b9433800bda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:22:39.520820 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:22:39.595952 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dbf774-698a-42e0-8b29-7b9433800bda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:22:39.597310 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dbf774-698a-42e0-8b29-7b9433800bda service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:22:39.616979 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 667/1340] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:22:39 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:22:43.646257 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d6a7f-b3d4-442a-9435-41d11baf65af None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:22:43.646823 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d6a7f-b3d4-442a-9435-41d11baf65af None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:22:43.647052 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d6a7f-b3d4-442a-9435-41d11baf65af None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:22:43.648447 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 674/1341] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:22:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:22:43.653900 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcddaba-3b5e-4f1e-948d-ba56d10fe526 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:22:43.654370 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcddaba-3b5e-4f1e-948d-ba56d10fe526 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:22:43.654463 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcddaba-3b5e-4f1e-948d-ba56d10fe526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:22:43.725234 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-ffcddaba-3b5e-4f1e-948d-ba56d10fe526 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:22:43.726528 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-ffcddaba-3b5e-4f1e-948d-ba56d10fe526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:22:43.812906 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:22:43.825018 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 668/1342] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:22:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:22:44.102536 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d6a7f-b3d4-442a-9435-41d11baf65af None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:22:44.104145 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-b34d6a7f-b3d4-442a-9435-41d11baf65af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:22:44.216607 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d6a7f-b3d4-442a-9435-41d11baf65af None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:22:44.257273 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:22:44.294600 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6e75eb-6106-48d2-9fbf-35ca6b0a9608 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:22:44.295236 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e75eb-6106-48d2-9fbf-35ca6b0a9608 service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:22:44.295534 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e75eb-6106-48d2-9fbf-35ca6b0a9608 service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:22:44.295761 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e75eb-6106-48d2-9fbf-35ca6b0a9608 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:22:44.297389 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-bc6e75eb-6106-48d2-9fbf-35ca6b0a9608 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:22:44.410172 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6e75eb-6106-48d2-9fbf-35ca6b0a9608 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:22:44.411527 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6e75eb-6106-48d2-9fbf-35ca6b0a9608 service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:22:44.430277 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 675/1343] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:22:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:22:47.004700 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab7ec2f-3f9e-4479-a278-bc11f94aa671 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:22:47.005266 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab7ec2f-3f9e-4479-a278-bc11f94aa671 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:22:47.005266 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab7ec2f-3f9e-4479-a278-bc11f94aa671 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:22:47.007415 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 669/1344] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:22:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:22:47.013539 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee5591b-ef24-406a-a39a-bd349628bdf7 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:22:47.014103 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee5591b-ef24-406a-a39a-bd349628bdf7 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:22:47.014103 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee5591b-ef24-406a-a39a-bd349628bdf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:22:47.083630 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-dee5591b-ef24-406a-a39a-bd349628bdf7 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:22:47.084938 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-dee5591b-ef24-406a-a39a-bd349628bdf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:22:47.105209 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:22:47.187029 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 676/1345] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:22:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:22:47.466918 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab7ec2f-3f9e-4479-a278-bc11f94aa671 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:22:47.468482 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-6ab7ec2f-3f9e-4479-a278-bc11f94aa671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:22:47.578773 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab7ec2f-3f9e-4479-a278-bc11f94aa671 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:22:47.657929 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee74f9-489a-4b92-94e2-2130cf826e4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:22:47.658564 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee74f9-489a-4b92-94e2-2130cf826e4e service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:22:47.658828 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee74f9-489a-4b92-94e2-2130cf826e4e service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:22:47.659087 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee74f9-489a-4b92-94e2-2130cf826e4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:22:47.660670 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-7bee74f9-489a-4b92-94e2-2130cf826e4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:22:47.706955 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:22:47.776244 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bee74f9-489a-4b92-94e2-2130cf826e4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:22:47.777684 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bee74f9-489a-4b92-94e2-2130cf826e4e service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:22:47.797342 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 670/1346] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:22:47 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:22:51.846552 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9776ccd-af1e-4c8d-9f5a-22e47d5024ae None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:22:51.847141 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9776ccd-af1e-4c8d-9f5a-22e47d5024ae None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:22:51.847141 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9776ccd-af1e-4c8d-9f5a-22e47d5024ae None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:22:51.848475 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 677/1347] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:22:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:22:51.854811 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa2d4f-cdc4-420e-a03d-87dc57a3b050 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:22:51.855277 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa2d4f-cdc4-420e-a03d-87dc57a3b050 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:22:51.855546 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa2d4f-cdc4-420e-a03d-87dc57a3b050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:22:51.929028 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-42aa2d4f-cdc4-420e-a03d-87dc57a3b050 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:22:51.930291 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-42aa2d4f-cdc4-420e-a03d-87dc57a3b050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:22:52.032969 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:22:52.038412 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 671/1348] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:22:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:22:52.321405 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9776ccd-af1e-4c8d-9f5a-22e47d5024ae None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:22:52.323984 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-b9776ccd-af1e-4c8d-9f5a-22e47d5024ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:22:52.447859 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9776ccd-af1e-4c8d-9f5a-22e47d5024ae None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:22:52.498775 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:22:52.527043 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a9079d-d27e-4ebb-813b-24bbd1080bc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:22:52.527777 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a9079d-d27e-4ebb-813b-24bbd1080bc5 service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:22:52.528117 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a9079d-d27e-4ebb-813b-24bbd1080bc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:22:52.528392 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a9079d-d27e-4ebb-813b-24bbd1080bc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:22:52.530037 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-a2a9079d-d27e-4ebb-813b-24bbd1080bc5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:22:52.643538 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a9079d-d27e-4ebb-813b-24bbd1080bc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:22:52.644970 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a9079d-d27e-4ebb-813b-24bbd1080bc5 service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:22:52.664810 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 678/1349] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:22:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:22:57.538834 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128164d4-73c4-4129-93dc-fe6ad54bdc3d None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:22:57.539981 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128164d4-73c4-4129-93dc-fe6ad54bdc3d None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:22:57.540499 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128164d4-73c4-4129-93dc-fe6ad54bdc3d None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:22:57.543544 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 672/1350] 10.222.0.26 () {54 vars in 921 bytes} [Fri Aug 12 01:22:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 01:22:57.550492 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e2434-571c-4ebd-8fd6-992d12c6bb2a None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:22:57.551323 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e2434-571c-4ebd-8fd6-992d12c6bb2a None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:22:57.551926 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e2434-571c-4ebd-8fd6-992d12c6bb2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:22:57.673673 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-d71e2434-571c-4ebd-8fd6-992d12c6bb2a None None] MFA Rules not processed for user `06dccf61c686414d904bdf1ecf19d53d`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:22:57.675387 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-d71e2434-571c-4ebd-8fd6-992d12c6bb2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:22:57.719344 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:22:57.827840 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 679/1351] 10.222.0.26 () {58 vars in 1018 bytes} [Fri Aug 12 01:22:57 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 01:23:01.842907 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd1b07-53e5-4162-a0b2-c97c97feeeb1 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:23:01.843461 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd1b07-53e5-4162-a0b2-c97c97feeeb1 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:23:01.843716 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd1b07-53e5-4162-a0b2-c97c97feeeb1 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:23:01.845220 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 673/1352] 10.222.0.26 () {54 vars in 921 bytes} [Fri Aug 12 01:23:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:23:01.851175 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990baaf0-a1e4-42ed-8ba5-f48072392377 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:23:01.851793 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990baaf0-a1e4-42ed-8ba5-f48072392377 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:23:01.851793 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990baaf0-a1e4-42ed-8ba5-f48072392377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:23:01.939446 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-990baaf0-a1e4-42ed-8ba5-f48072392377 None None] MFA Rules not processed for user `06dccf61c686414d904bdf1ecf19d53d`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:23:01.940735 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-990baaf0-a1e4-42ed-8ba5-f48072392377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:23:02.016397 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:23:02.053819 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 680/1353] 10.222.0.26 () {58 vars in 1018 bytes} [Fri Aug 12 01:23:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:23:03.436760 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28416b9-972c-4476-b0f3-0caa73fe0bee None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:23:03.437352 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28416b9-972c-4476-b0f3-0caa73fe0bee None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:23:03.437352 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28416b9-972c-4476-b0f3-0caa73fe0bee None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:23:03.438877 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 674/1354] 10.222.0.26 () {54 vars in 921 bytes} [Fri Aug 12 01:23:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:23:03.443705 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc692f-2cbb-4ef8-99e7-6b37bf9f2695 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:23:03.444152 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc692f-2cbb-4ef8-99e7-6b37bf9f2695 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:23:03.444269 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc692f-2cbb-4ef8-99e7-6b37bf9f2695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:23:03.530321 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-85dc692f-2cbb-4ef8-99e7-6b37bf9f2695 None None] MFA Rules not processed for user `06dccf61c686414d904bdf1ecf19d53d`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:23:03.531532 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-85dc692f-2cbb-4ef8-99e7-6b37bf9f2695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:23:03.643300 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 681/1355] 10.222.0.26 () {58 vars in 1018 bytes} [Fri Aug 12 01:23:03 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:23:06.913261 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f40eebd-3a0b-47ed-8b01-d420cbd47e46 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:23:06.913828 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f40eebd-3a0b-47ed-8b01-d420cbd47e46 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:23:06.913828 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f40eebd-3a0b-47ed-8b01-d420cbd47e46 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:23:06.915151 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 675/1356] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:23:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:23:06.920508 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ca38c-48cc-47da-8a41-65cf55c01cd1 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:23:06.920924 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ca38c-48cc-47da-8a41-65cf55c01cd1 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:23:06.921027 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ca38c-48cc-47da-8a41-65cf55c01cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:23:06.969152 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:23:07.008167 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-7a3ca38c-48cc-47da-8a41-65cf55c01cd1 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:23:07.010725 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-7a3ca38c-48cc-47da-8a41-65cf55c01cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:23:07.129065 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 682/1357] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:23:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:23:07.439126 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969022ec-13b3-480d-929b-622619748f96 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:23:07.440068 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969022ec-13b3-480d-929b-622619748f96 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:23:07.440611 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969022ec-13b3-480d-929b-622619748f96 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:23:07.442907 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 676/1358] 10.222.0.26 () {54 vars in 962 bytes} [Fri Aug 12 01:23:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 01:23:07.452477 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeefc46a-4dca-459d-8577-9f943bff663a None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:23:07.453369 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeefc46a-4dca-459d-8577-9f943bff663a None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:23:07.453720 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeefc46a-4dca-459d-8577-9f943bff663a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:23:07.536668 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-aeefc46a-4dca-459d-8577-9f943bff663a None None] MFA Rules not processed for user `fcd5e95467b44175be2478c2c7c89926`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:23:07.537972 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-aeefc46a-4dca-459d-8577-9f943bff663a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:23:07.588727 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:23:07.675382 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 683/1359] 10.222.0.26 () {58 vars in 1059 bytes} [Fri Aug 12 01:23:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:23:07.683620 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969022ec-13b3-480d-929b-622619748f96 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:23:07.685237 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-969022ec-13b3-480d-929b-622619748f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:23:07.836991 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969022ec-13b3-480d-929b-622619748f96 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:23:07.921725 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:23:07.963457 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913c742f-a9af-464e-b3a1-013fb11cd45f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd5e95467b44175be2478c2c7c89926', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:23:07.963981 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c742f-a9af-464e-b3a1-013fb11cd45f service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:23:07.964266 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c742f-a9af-464e-b3a1-013fb11cd45f service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:23:07.964503 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c742f-a9af-464e-b3a1-013fb11cd45f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:23:07.966137 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-913c742f-a9af-464e-b3a1-013fb11cd45f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:23:08.059440 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913c742f-a9af-464e-b3a1-013fb11cd45f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:23:08.061283 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913c742f-a9af-464e-b3a1-013fb11cd45f service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:23:08.080390 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 677/1360] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:23:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:23:10.183691 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53273a6-e18c-44fa-8e92-17dfd092c12a None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:23:10.184235 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53273a6-e18c-44fa-8e92-17dfd092c12a None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:23:10.184235 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53273a6-e18c-44fa-8e92-17dfd092c12a None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:23:10.185679 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 684/1361] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:23:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:23:10.191630 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cfca4e-e3c9-4cff-be26-2ae3b9d89feb None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:23:10.192073 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cfca4e-e3c9-4cff-be26-2ae3b9d89feb None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:23:10.192181 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cfca4e-e3c9-4cff-be26-2ae3b9d89feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:23:10.265361 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-c6cfca4e-e3c9-4cff-be26-2ae3b9d89feb None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:23:10.267016 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c6cfca4e-e3c9-4cff-be26-2ae3b9d89feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:23:10.311452 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:23:10.382293 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 678/1362] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:23:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:23:10.658915 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53273a6-e18c-44fa-8e92-17dfd092c12a None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:23:10.660430 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-c53273a6-e18c-44fa-8e92-17dfd092c12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:23:10.823286 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53273a6-e18c-44fa-8e92-17dfd092c12a None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:23:10.833514 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:23:10.943376 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c219e108-ba3f-4b78-9d73-6e76eede3560 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd5e95467b44175be2478c2c7c89926', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:23:10.944035 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c219e108-ba3f-4b78-9d73-6e76eede3560 service nova] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:23:10.944320 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c219e108-ba3f-4b78-9d73-6e76eede3560 service nova] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:23:10.944588 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c219e108-ba3f-4b78-9d73-6e76eede3560 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:23:10.946258 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-c219e108-ba3f-4b78-9d73-6e76eede3560 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:23:11.049436 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c219e108-ba3f-4b78-9d73-6e76eede3560 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:23:11.051378 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c219e108-ba3f-4b78-9d73-6e76eede3560 service nova] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:23:11.071085 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 685/1363] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:23:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:23:13.304593 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a27e2-bae1-49f5-8ae0-c8db801a75cc None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:23:13.305163 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a27e2-bae1-49f5-8ae0-c8db801a75cc None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:23:13.305163 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a27e2-bae1-49f5-8ae0-c8db801a75cc None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:23:13.306648 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 679/1364] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:23:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:23:13.311664 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee66a6f-f00c-4560-b5b9-bf15c8a7c3fc None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:23:13.312069 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee66a6f-f00c-4560-b5b9-bf15c8a7c3fc None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:23:13.312175 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee66a6f-f00c-4560-b5b9-bf15c8a7c3fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:23:13.328023 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:23:13.384686 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-2ee66a6f-f00c-4560-b5b9-bf15c8a7c3fc None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:23:13.386322 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-2ee66a6f-f00c-4560-b5b9-bf15c8a7c3fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:23:13.501086 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 686/1365] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:23:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:23:13.786066 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5093294f-8957-4dd0-9922-7ce1245430a5 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:23:13.786569 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5093294f-8957-4dd0-9922-7ce1245430a5 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:23:13.787005 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5093294f-8957-4dd0-9922-7ce1245430a5 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:23:13.788457 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 680/1366] 10.222.0.26 () {54 vars in 962 bytes} [Fri Aug 12 01:23:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:23:13.794170 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91fae1-7305-4288-9613-c2d99e340b2d None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:23:13.794531 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91fae1-7305-4288-9613-c2d99e340b2d None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:23:13.794879 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91fae1-7305-4288-9613-c2d99e340b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:23:13.885599 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-bc91fae1-7305-4288-9613-c2d99e340b2d None None] MFA Rules not processed for user `fcd5e95467b44175be2478c2c7c89926`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:23:13.886852 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-bc91fae1-7305-4288-9613-c2d99e340b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:23:13.923764 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:23:14.011856 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 687/1367] 10.222.0.26 () {58 vars in 1059 bytes} [Fri Aug 12 01:23:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:23:14.020078 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5093294f-8957-4dd0-9922-7ce1245430a5 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:23:14.021907 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-5093294f-8957-4dd0-9922-7ce1245430a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:23:14.176110 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5093294f-8957-4dd0-9922-7ce1245430a5 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:23:14.200277 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:23:14.305479 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcd5b3c-cf2a-4d96-9028-31c1b0a4b7c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd5e95467b44175be2478c2c7c89926', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:23:14.306338 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcd5b3c-cf2a-4d96-9028-31c1b0a4b7c8 service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:23:14.306456 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcd5b3c-cf2a-4d96-9028-31c1b0a4b7c8 service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:23:14.306617 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcd5b3c-cf2a-4d96-9028-31c1b0a4b7c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:23:14.308199 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-cdcd5b3c-cf2a-4d96-9028-31c1b0a4b7c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:23:14.405243 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcd5b3c-cf2a-4d96-9028-31c1b0a4b7c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:23:14.407161 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcd5b3c-cf2a-4d96-9028-31c1b0a4b7c8 service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:23:14.426230 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 681/1368] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:23:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:23:14.999530 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf25a0-9d73-4e88-bafb-955ed06097d4 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:23:15.000076 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf25a0-9d73-4e88-bafb-955ed06097d4 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:23:15.000452 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccf25a0-9d73-4e88-bafb-955ed06097d4 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:23:15.002164 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 688/1369] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:23:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:23:15.008106 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4cde74-9d81-41fb-b309-864c3a7d6743 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:23:15.008394 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4cde74-9d81-41fb-b309-864c3a7d6743 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:23:15.008623 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4cde74-9d81-41fb-b309-864c3a7d6743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:23:15.043777 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:23:15.078465 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-0a4cde74-9d81-41fb-b309-864c3a7d6743 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:23:15.079736 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-0a4cde74-9d81-41fb-b309-864c3a7d6743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:23:15.183878 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 682/1370] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:23:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:23:15.762303 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70081715-bc7e-4005-9b57-6d4ed3ef08d7 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:23:15.762303 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70081715-bc7e-4005-9b57-6d4ed3ef08d7 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:23:15.762303 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70081715-bc7e-4005-9b57-6d4ed3ef08d7 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:23:15.764884 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 689/1371] 10.222.0.26 () {54 vars in 964 bytes} [Fri Aug 12 01:23:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:23:15.768966 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2973a550-4fd1-4755-82e5-5f4d346458f4 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:23:15.768966 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2973a550-4fd1-4755-82e5-5f4d346458f4 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:23:15.770282 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2973a550-4fd1-4755-82e5-5f4d346458f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:23:15.847867 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-2973a550-4fd1-4755-82e5-5f4d346458f4 None None] MFA Rules not processed for user `7853d40c29af424c8d7913950d89750b`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:23:15.849469 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2973a550-4fd1-4755-82e5-5f4d346458f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:23:15.899165 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:23:15.933600 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 683/1372] 10.222.0.26 () {58 vars in 1061 bytes} [Fri Aug 12 01:23:15 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:23:15.941471 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70081715-bc7e-4005-9b57-6d4ed3ef08d7 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:23:15.944138 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-70081715-bc7e-4005-9b57-6d4ed3ef08d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:23:16.060867 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70081715-bc7e-4005-9b57-6d4ed3ef08d7 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:23:16.104398 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:23:16.143327 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667a59f-8b10-4646-8208-96c317991996 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7853d40c29af424c8d7913950d89750b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:23:16.144079 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667a59f-8b10-4646-8208-96c317991996 service cinder] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:23:16.144355 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667a59f-8b10-4646-8208-96c317991996 service cinder] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:23:16.144622 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667a59f-8b10-4646-8208-96c317991996 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:23:16.146301 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-9667a59f-8b10-4646-8208-96c317991996 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:23:16.274390 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9667a59f-8b10-4646-8208-96c317991996 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:23:16.275787 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9667a59f-8b10-4646-8208-96c317991996 service cinder] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:23:16.294768 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 690/1373] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:23:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:23:16.388994 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c187ce-56d6-496b-bc2e-f3a2fa86ae85 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:23:16.390154 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c187ce-56d6-496b-bc2e-f3a2fa86ae85 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:23:16.390154 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c187ce-56d6-496b-bc2e-f3a2fa86ae85 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:23:16.390918 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 684/1374] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:23:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 01:23:16.396267 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93723651-0754-4540-a745-ee31138515bf None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:23:16.396636 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93723651-0754-4540-a745-ee31138515bf None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:23:16.396791 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93723651-0754-4540-a745-ee31138515bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:23:16.466324 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-93723651-0754-4540-a745-ee31138515bf None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:23:16.467148 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-93723651-0754-4540-a745-ee31138515bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:23:16.497504 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:23:16.577364 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 691/1375] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:23:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:23:16.867175 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c187ce-56d6-496b-bc2e-f3a2fa86ae85 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:23:16.868755 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-a1c187ce-56d6-496b-bc2e-f3a2fa86ae85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:23:17.027272 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c187ce-56d6-496b-bc2e-f3a2fa86ae85 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:23:17.083258 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:23:17.152083 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d2b1c-9042-4731-a649-aea969f772ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd5e95467b44175be2478c2c7c89926', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:23:17.152615 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d2b1c-9042-4731-a649-aea969f772ee service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:23:17.152886 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d2b1c-9042-4731-a649-aea969f772ee service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:23:17.153150 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d2b1c-9042-4731-a649-aea969f772ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:23:17.154818 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-4a1d2b1c-9042-4731-a649-aea969f772ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:23:17.374737 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1d2b1c-9042-4731-a649-aea969f772ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:23:17.376357 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1d2b1c-9042-4731-a649-aea969f772ee service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:23:17.395868 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 685/1376] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:23:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:23:19.330861 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7d06a-134c-47d8-ae36-76b8d5cc1de5 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:23:19.331379 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7d06a-134c-47d8-ae36-76b8d5cc1de5 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:23:19.331379 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7d06a-134c-47d8-ae36-76b8d5cc1de5 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:23:19.332724 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 692/1377] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:23:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:23:19.338081 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89acdb47-d8c6-48cc-9145-04a1da5bc1b0 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:23:19.338581 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89acdb47-d8c6-48cc-9145-04a1da5bc1b0 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:23:19.338671 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89acdb47-d8c6-48cc-9145-04a1da5bc1b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:23:19.426425 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-89acdb47-d8c6-48cc-9145-04a1da5bc1b0 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:23:19.427581 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-89acdb47-d8c6-48cc-9145-04a1da5bc1b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:23:19.434487 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:23:19.531369 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 686/1378] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:23:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:23:19.823546 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a7d06a-134c-47d8-ae36-76b8d5cc1de5 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:23:19.825196 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-65a7d06a-134c-47d8-ae36-76b8d5cc1de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:23:19.990531 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a7d06a-134c-47d8-ae36-76b8d5cc1de5 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:23:19.994457 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:23:20.119857 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ccb3b4-49fd-4cf9-ba13-b18c0696d63f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd5e95467b44175be2478c2c7c89926', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:23:20.120574 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ccb3b4-49fd-4cf9-ba13-b18c0696d63f service nova] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:23:20.120948 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ccb3b4-49fd-4cf9-ba13-b18c0696d63f service nova] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:23:20.121324 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ccb3b4-49fd-4cf9-ba13-b18c0696d63f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:23:20.123025 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-24ccb3b4-49fd-4cf9-ba13-b18c0696d63f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:23:20.219386 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ccb3b4-49fd-4cf9-ba13-b18c0696d63f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:23:20.221342 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ccb3b4-49fd-4cf9-ba13-b18c0696d63f service nova] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:23:20.240734 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 693/1379] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:23:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:23:22.160521 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97247971-6d3d-4863-8a92-cd4c09d5860d None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:23:22.160977 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97247971-6d3d-4863-8a92-cd4c09d5860d None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:23:22.161075 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97247971-6d3d-4863-8a92-cd4c09d5860d None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:23:22.166286 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 687/1380] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:23:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:23:22.167916 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2190d4-c897-4d26-8870-d65dac82a3f6 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:23:22.168313 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2190d4-c897-4d26-8870-d65dac82a3f6 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:23:22.168655 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2190d4-c897-4d26-8870-d65dac82a3f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:23:22.181884 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:23:22.244836 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-df2190d4-c897-4d26-8870-d65dac82a3f6 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:23:22.246083 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-df2190d4-c897-4d26-8870-d65dac82a3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:23:22.346750 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 694/1381] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:23:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:23:22.642947 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97247971-6d3d-4863-8a92-cd4c09d5860d None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:23:22.644687 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-97247971-6d3d-4863-8a92-cd4c09d5860d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:23:22.803103 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:23:22.814293 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97247971-6d3d-4863-8a92-cd4c09d5860d None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:23:22.952743 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984ff96b-ea3c-4488-81ef-b0adf7789a80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd5e95467b44175be2478c2c7c89926', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:23:22.954205 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ff96b-ea3c-4488-81ef-b0adf7789a80 service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:23:22.955237 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ff96b-ea3c-4488-81ef-b0adf7789a80 service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:23:22.955755 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ff96b-ea3c-4488-81ef-b0adf7789a80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:23:22.958046 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-984ff96b-ea3c-4488-81ef-b0adf7789a80 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:23:23.058144 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984ff96b-ea3c-4488-81ef-b0adf7789a80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:23:23.059904 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984ff96b-ea3c-4488-81ef-b0adf7789a80 service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:23:23.071408 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:23:23.081128 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 688/1382] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:23:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:23:25.371800 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ad9d0-c234-412f-bed5-0c85356196e7 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:23:25.372614 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ad9d0-c234-412f-bed5-0c85356196e7 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:23:25.372614 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ad9d0-c234-412f-bed5-0c85356196e7 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:23:25.374919 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 695/1383] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:23:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:23:25.382688 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bfb059-2252-4769-a14b-538a29db3f24 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:23:25.384497 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bfb059-2252-4769-a14b-538a29db3f24 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:23:25.384497 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bfb059-2252-4769-a14b-538a29db3f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:23:25.470297 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-04bfb059-2252-4769-a14b-538a29db3f24 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:23:25.471654 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-04bfb059-2252-4769-a14b-538a29db3f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:23:25.578843 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 689/1384] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:23:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:23:25.940148 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ad9d0-c234-412f-bed5-0c85356196e7 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:23:25.941705 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-8b2ad9d0-c234-412f-bed5-0c85356196e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:23:26.030389 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:23:26.095028 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ad9d0-c234-412f-bed5-0c85356196e7 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:23:26.210439 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3bbf9e-d8ad-4ff3-b990-d8f755c54a5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd5e95467b44175be2478c2c7c89926', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:23:26.210948 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3bbf9e-d8ad-4ff3-b990-d8f755c54a5f service nova] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:23:26.211218 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3bbf9e-d8ad-4ff3-b990-d8f755c54a5f service nova] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:23:26.211489 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3bbf9e-d8ad-4ff3-b990-d8f755c54a5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:23:26.213109 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-3f3bbf9e-d8ad-4ff3-b990-d8f755c54a5f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:23:26.264107 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:23:26.306902 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3bbf9e-d8ad-4ff3-b990-d8f755c54a5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:23:26.308487 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3bbf9e-d8ad-4ff3-b990-d8f755c54a5f service nova] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:23:26.327492 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 696/1385] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:23:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:23:28.284748 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e30d145-32ad-4ce1-8243-e5ca291a1437 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:23:28.285495 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e30d145-32ad-4ce1-8243-e5ca291a1437 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:23:28.285495 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e30d145-32ad-4ce1-8243-e5ca291a1437 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:23:28.286720 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 690/1386] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:23:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:23:28.292460 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c69cc-0d35-486a-b4e4-c7d084c1cf75 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:23:28.293015 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c69cc-0d35-486a-b4e4-c7d084c1cf75 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:23:28.293015 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c69cc-0d35-486a-b4e4-c7d084c1cf75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:23:28.361541 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-8f2c69cc-0d35-486a-b4e4-c7d084c1cf75 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:23:28.362863 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-8f2c69cc-0d35-486a-b4e4-c7d084c1cf75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:23:28.473091 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 697/1387] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:23:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:23:28.844764 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e30d145-32ad-4ce1-8243-e5ca291a1437 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:23:28.846871 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2e30d145-32ad-4ce1-8243-e5ca291a1437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:23:28.941047 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:23:29.021865 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e30d145-32ad-4ce1-8243-e5ca291a1437 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:23:29.162072 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539026c4-96ff-47dd-8811-15c13fdcf38b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd5e95467b44175be2478c2c7c89926', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:23:29.162655 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539026c4-96ff-47dd-8811-15c13fdcf38b service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:23:29.162926 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539026c4-96ff-47dd-8811-15c13fdcf38b service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:23:29.163196 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539026c4-96ff-47dd-8811-15c13fdcf38b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:23:29.164831 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-539026c4-96ff-47dd-8811-15c13fdcf38b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:23:29.208101 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:23:29.273245 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539026c4-96ff-47dd-8811-15c13fdcf38b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:23:29.274893 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539026c4-96ff-47dd-8811-15c13fdcf38b service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:23:29.294102 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 691/1388] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:23:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:23:31.208660 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d68ba0-267b-4f86-ba09-fb5f40f5e8d8 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:23:31.209240 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d68ba0-267b-4f86-ba09-fb5f40f5e8d8 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:23:31.209240 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d68ba0-267b-4f86-ba09-fb5f40f5e8d8 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:23:31.210590 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 698/1389] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:23:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:23:31.215954 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab34a6f-e8cc-45c2-8ed3-1c717ee4c384 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:23:31.216427 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab34a6f-e8cc-45c2-8ed3-1c717ee4c384 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:23:31.216618 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab34a6f-e8cc-45c2-8ed3-1c717ee4c384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:23:31.284211 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-9ab34a6f-e8cc-45c2-8ed3-1c717ee4c384 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:23:31.285353 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-9ab34a6f-e8cc-45c2-8ed3-1c717ee4c384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:23:31.351286 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef90eef-ba85-48b1-8990-be44f9def26d None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:23:31.351583 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef90eef-ba85-48b1-8990-be44f9def26d None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:23:31.352000 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef90eef-ba85-48b1-8990-be44f9def26d None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:23:31.354807 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 699/1390] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:23:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:23:31.360258 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b9731-0c1a-4741-b2a5-8a495a29b019 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:23:31.360535 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b9731-0c1a-4741-b2a5-8a495a29b019 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:23:31.360799 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b9731-0c1a-4741-b2a5-8a495a29b019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:23:31.388102 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 692/1391] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:23:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:23:31.396818 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:23:31.430172 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-b69b9731-0c1a-4741-b2a5-8a495a29b019 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:23:31.431450 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-b69b9731-0c1a-4741-b2a5-8a495a29b019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:23:31.537573 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 700/1392] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:23:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:23:31.671817 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab34a6f-e8cc-45c2-8ed3-1c717ee4c384 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:23:31.673255 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-9ab34a6f-e8cc-45c2-8ed3-1c717ee4c384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:23:31.688392 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:23:31.786540 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab34a6f-e8cc-45c2-8ed3-1c717ee4c384 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:23:31.830689 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055db156-0388-458d-b7a8-913d4d965a48 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:23:31.830927 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055db156-0388-458d-b7a8-913d4d965a48 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:23:31.831289 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055db156-0388-458d-b7a8-913d4d965a48 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:23:31.832676 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 701/1393] 10.222.0.26 () {54 vars in 967 bytes} [Fri Aug 12 01:23:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:23:31.837778 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9fc687-9ab7-46cb-b85a-d7c5a27cb9da None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:23:31.838059 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9fc687-9ab7-46cb-b85a-d7c5a27cb9da None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:23:31.838356 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9fc687-9ab7-46cb-b85a-d7c5a27cb9da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:23:31.900549 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f340d1-3bb2-4ccb-8746-fedaabedc03d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd5e95467b44175be2478c2c7c89926', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:23:31.901154 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f340d1-3bb2-4ccb-8746-fedaabedc03d service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:23:31.901427 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f340d1-3bb2-4ccb-8746-fedaabedc03d service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:23:31.901688 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f340d1-3bb2-4ccb-8746-fedaabedc03d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:23:31.903384 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-66f340d1-3bb2-4ccb-8746-fedaabedc03d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:23:31.912208 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:23:31.916112 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-1c9fc687-9ab7-46cb-b85a-d7c5a27cb9da None None] MFA Rules not processed for user `bd73d9b9b63a499d909fec034bf9a259`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:23:31.917321 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-1c9fc687-9ab7-46cb-b85a-d7c5a27cb9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:23:31.966883 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:23:31.994515 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f340d1-3bb2-4ccb-8746-fedaabedc03d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:23:31.995561 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 702/1394] 10.222.0.26 () {58 vars in 1064 bytes} [Fri Aug 12 01:23:31 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 01:23:31.996100 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f340d1-3bb2-4ccb-8746-fedaabedc03d service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:23:32.003077 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9fc687-9ab7-46cb-b85a-d7c5a27cb9da None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:23:32.010742 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9fc687-9ab7-46cb-b85a-d7c5a27cb9da None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:23:32.015292 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 693/1395] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:23:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:23:32.090441 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5787d81-d430-4f8b-b8a3-ef082cf09969 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd73d9b9b63a499d909fec034bf9a259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:23:32.091066 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5787d81-d430-4f8b-b8a3-ef082cf09969 service glance] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:23:32.091341 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5787d81-d430-4f8b-b8a3-ef082cf09969 service glance] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:23:32.091613 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5787d81-d430-4f8b-b8a3-ef082cf09969 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:23:32.093321 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-e5787d81-d430-4f8b-b8a3-ef082cf09969 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:23:32.217754 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5787d81-d430-4f8b-b8a3-ef082cf09969 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:23:32.219243 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5787d81-d430-4f8b-b8a3-ef082cf09969 service glance] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:23:32.233997 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:23:32.239094 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 703/1396] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:23:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 01:23:33.008418 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece31b1d-c2e1-41b6-a0a8-6190679b3eea None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:23:33.008947 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece31b1d-c2e1-41b6-a0a8-6190679b3eea None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:23:33.009042 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece31b1d-c2e1-41b6-a0a8-6190679b3eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:23:33.076058 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-ece31b1d-c2e1-41b6-a0a8-6190679b3eea None None] MFA Rules not processed for user `f3643631cf2d4a9592d465bdeba99669`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:23:33.077296 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-ece31b1d-c2e1-41b6-a0a8-6190679b3eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:23:33.166140 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:23:33.169910 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 694/1397] 10.222.0.26 () {58 vars in 1009 bytes} [Fri Aug 12 01:23:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:23:33.216524 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638c5fff-c8fc-4617-8019-b18fb9b5f8ac None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:23:33.216874 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638c5fff-c8fc-4617-8019-b18fb9b5f8ac None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:23:33.217229 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638c5fff-c8fc-4617-8019-b18fb9b5f8ac None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:23:33.218751 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 704/1398] 10.222.0.26 () {54 vars in 943 bytes} [Fri Aug 12 01:23:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:23:33.225250 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3bb2c-f7ec-4e82-9c39-0fdc16c98c01 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:23:33.225533 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3bb2c-f7ec-4e82-9c39-0fdc16c98c01 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:23:33.225806 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3bb2c-f7ec-4e82-9c39-0fdc16c98c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:23:33.300156 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-8ce3bb2c-f7ec-4e82-9c39-0fdc16c98c01 None None] MFA Rules not processed for user `32c1ba237f864b5d9699cb817e42e647`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:23:33.301295 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-8ce3bb2c-f7ec-4e82-9c39-0fdc16c98c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:23:33.415416 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 695/1399] 10.222.0.26 () {58 vars in 1040 bytes} [Fri Aug 12 01:23:33 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:23:33.425273 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638c5fff-c8fc-4617-8019-b18fb9b5f8ac None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:23:33.426837 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-638c5fff-c8fc-4617-8019-b18fb9b5f8ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:23:33.569802 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638c5fff-c8fc-4617-8019-b18fb9b5f8ac None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:23:33.657692 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:23:33.678681 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772b4e58-69dd-41e7-ad90-8e305636e324 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32c1ba237f864b5d9699cb817e42e647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:23:33.679315 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b4e58-69dd-41e7-ad90-8e305636e324 service swift] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:23:33.679590 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b4e58-69dd-41e7-ad90-8e305636e324 service swift] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:23:33.679832 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b4e58-69dd-41e7-ad90-8e305636e324 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:23:33.681498 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-772b4e58-69dd-41e7-ad90-8e305636e324 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:23:33.768078 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772b4e58-69dd-41e7-ad90-8e305636e324 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:23:33.769701 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772b4e58-69dd-41e7-ad90-8e305636e324 service swift] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:23:33.778596 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 705/1400] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Aug 12 01:23:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 12 01:23:33.948638 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6436c1-36d0-4676-9ef5-4f171dfdb99b None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:23:33.948924 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6436c1-36d0-4676-9ef5-4f171dfdb99b None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:23:33.949193 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6436c1-36d0-4676-9ef5-4f171dfdb99b None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:23:33.950607 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 696/1401] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:23:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:23:33.956698 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b145f1-0cea-48a2-b8b5-7b676605dd43 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:23:33.957301 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b145f1-0cea-48a2-b8b5-7b676605dd43 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:23:33.957541 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b145f1-0cea-48a2-b8b5-7b676605dd43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:23:34.030266 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-18b145f1-0cea-48a2-b8b5-7b676605dd43 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:23:34.032187 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-18b145f1-0cea-48a2-b8b5-7b676605dd43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:23:34.117985 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:23:34.277911 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 706/1402] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:23:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:23:34.558426 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6436c1-36d0-4676-9ef5-4f171dfdb99b None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:23:34.560809 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-ae6436c1-36d0-4676-9ef5-4f171dfdb99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:23:34.625814 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:23:34.719708 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6436c1-36d0-4676-9ef5-4f171dfdb99b None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:23:34.851490 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be358c-2d91-4813-9050-a035303ccffc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd5e95467b44175be2478c2c7c89926', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:23:34.852020 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be358c-2d91-4813-9050-a035303ccffc service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:23:34.852291 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be358c-2d91-4813-9050-a035303ccffc service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:23:34.852553 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be358c-2d91-4813-9050-a035303ccffc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:23:34.854240 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c4be358c-2d91-4813-9050-a035303ccffc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:23:34.873900 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:23:34.953885 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be358c-2d91-4813-9050-a035303ccffc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:23:34.955666 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be358c-2d91-4813-9050-a035303ccffc service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:23:34.974888 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 697/1403] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:23:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:23:36.942000 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd947f7-ddac-4b46-8225-049529ff7f68 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:23:36.942643 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd947f7-ddac-4b46-8225-049529ff7f68 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:23:36.942643 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd947f7-ddac-4b46-8225-049529ff7f68 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:23:36.943908 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 707/1404] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:23:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:23:36.949347 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42470d6-5e02-48ef-826c-492c0a46bf5e None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:23:36.950133 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42470d6-5e02-48ef-826c-492c0a46bf5e None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:23:36.950412 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42470d6-5e02-48ef-826c-492c0a46bf5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:23:37.021482 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-c42470d6-5e02-48ef-826c-492c0a46bf5e None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:23:37.024505 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c42470d6-5e02-48ef-826c-492c0a46bf5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:23:37.124748 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:23:37.134285 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 698/1405] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:23:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:23:37.423002 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd947f7-ddac-4b46-8225-049529ff7f68 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:23:37.424529 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-2bd947f7-ddac-4b46-8225-049529ff7f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:23:37.591638 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd947f7-ddac-4b46-8225-049529ff7f68 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:23:37.678937 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:23:37.761986 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4dc48d-ad14-4aeb-8027-45f1ad06f5e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd5e95467b44175be2478c2c7c89926', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:23:37.762872 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4dc48d-ad14-4aeb-8027-45f1ad06f5e6 service nova] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:23:37.763250 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4dc48d-ad14-4aeb-8027-45f1ad06f5e6 service nova] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:23:37.763829 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4dc48d-ad14-4aeb-8027-45f1ad06f5e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:23:37.765773 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-8b4dc48d-ad14-4aeb-8027-45f1ad06f5e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:23:37.865998 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4dc48d-ad14-4aeb-8027-45f1ad06f5e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:23:37.867878 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4dc48d-ad14-4aeb-8027-45f1ad06f5e6 service nova] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:23:37.888090 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 708/1406] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:23:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:23:39.863597 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb238b-27be-4105-914b-7ddb610c977a None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:23:39.864129 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb238b-27be-4105-914b-7ddb610c977a None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:23:39.864129 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb238b-27be-4105-914b-7ddb610c977a None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:23:39.865379 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 699/1407] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:23:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:23:39.871032 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36861efe-76ff-49c5-983a-b6f7fa0f89fb None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:23:39.871473 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36861efe-76ff-49c5-983a-b6f7fa0f89fb None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:23:39.871556 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36861efe-76ff-49c5-983a-b6f7fa0f89fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:23:39.944722 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-36861efe-76ff-49c5-983a-b6f7fa0f89fb None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:23:39.946042 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-36861efe-76ff-49c5-983a-b6f7fa0f89fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:23:39.961641 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:23:40.069558 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 709/1408] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:23:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:23:40.373014 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abb238b-27be-4105-914b-7ddb610c977a None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:23:40.375934 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-4abb238b-27be-4105-914b-7ddb610c977a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:23:40.553464 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abb238b-27be-4105-914b-7ddb610c977a None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:23:40.630030 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:23:40.682990 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0992c8-d1c2-4332-9e6b-293d2eed7335 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd5e95467b44175be2478c2c7c89926', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:23:40.683636 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0992c8-d1c2-4332-9e6b-293d2eed7335 service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:23:40.683914 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0992c8-d1c2-4332-9e6b-293d2eed7335 service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:23:40.684190 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0992c8-d1c2-4332-9e6b-293d2eed7335 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:23:40.685823 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-9f0992c8-d1c2-4332-9e6b-293d2eed7335 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:23:40.799536 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0992c8-d1c2-4332-9e6b-293d2eed7335 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:23:40.801138 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0992c8-d1c2-4332-9e6b-293d2eed7335 service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:23:40.820860 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 700/1409] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:23:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:23:50.067683 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=38 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:23:50.818406 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=64 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:23:55.557013 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1461a533-b0ee-48bc-818d-2e2d87f77369 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:23:55.557583 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1461a533-b0ee-48bc-818d-2e2d87f77369 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:23:55.557583 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1461a533-b0ee-48bc-818d-2e2d87f77369 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:23:55.559001 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 710/1410] 10.222.0.26 () {54 vars in 918 bytes} [Fri Aug 12 01:23:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:23:55.565051 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0ea8b-fe97-4e76-bd9f-da1476bf0289 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:23:55.565505 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0ea8b-fe97-4e76-bd9f-da1476bf0289 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:23:55.565628 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0ea8b-fe97-4e76-bd9f-da1476bf0289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:23:55.648563 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-38f0ea8b-fe97-4e76-bd9f-da1476bf0289 None None] MFA Rules not processed for user `06dccf61c686414d904bdf1ecf19d53d`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:23:55.649795 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-38f0ea8b-fe97-4e76-bd9f-da1476bf0289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:23:55.761827 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 701/1411] 10.222.0.26 () {58 vars in 1015 bytes} [Fri Aug 12 01:23:55 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:23:55.778257 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760449e4-5ba9-4e49-afd6-b50ff8a3719a None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:23:55.778542 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760449e4-5ba9-4e49-afd6-b50ff8a3719a None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:23:55.778811 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760449e4-5ba9-4e49-afd6-b50ff8a3719a None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:23:55.780276 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 711/1412] 10.222.0.26 () {54 vars in 918 bytes} [Fri Aug 12 01:23:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:23:55.786195 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9fa99f-d481-436f-8b65-0681084cc1e6 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:23:55.786480 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9fa99f-d481-436f-8b65-0681084cc1e6 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:23:55.786787 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9fa99f-d481-436f-8b65-0681084cc1e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:23:55.869380 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:23:55.872376 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-0c9fa99f-d481-436f-8b65-0681084cc1e6 None None] MFA Rules not processed for user `fcd5e95467b44175be2478c2c7c89926`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:23:55.874512 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-0c9fa99f-d481-436f-8b65-0681084cc1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:23:56.004079 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 702/1413] 10.222.0.26 () {58 vars in 1015 bytes} [Fri Aug 12 01:23:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:23:58.431501 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79043c9c-0a55-4875-b61a-e570a1cf391f None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:23:58.432023 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79043c9c-0a55-4875-b61a-e570a1cf391f None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:23:58.432023 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79043c9c-0a55-4875-b61a-e570a1cf391f None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:23:58.433964 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 712/1414] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 12 01:23:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:23:58.440909 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a7619-dc61-4b92-b965-4c7d1a45d93f None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:23:58.441324 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a7619-dc61-4b92-b965-4c7d1a45d93f None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:23:58.441456 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a7619-dc61-4b92-b965-4c7d1a45d93f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:23:58.521869 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-2e5a7619-dc61-4b92-b965-4c7d1a45d93f None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:23:58.523103 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2e5a7619-dc61-4b92-b965-4c7d1a45d93f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:23:58.581049 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:23:58.626085 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 703/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 12 01:23:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:23:58.931514 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79043c9c-0a55-4875-b61a-e570a1cf391f None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:23:58.933598 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-79043c9c-0a55-4875-b61a-e570a1cf391f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:23:59.107408 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79043c9c-0a55-4875-b61a-e570a1cf391f None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:23:59.182368 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:23:59.224831 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7632e9-4c65-4712-9a6c-446e1f16b382 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd5e95467b44175be2478c2c7c89926', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:23:59.225736 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7632e9-4c65-4712-9a6c-446e1f16b382 service nova] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:23:59.226006 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7632e9-4c65-4712-9a6c-446e1f16b382 service nova] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:23:59.226286 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7632e9-4c65-4712-9a6c-446e1f16b382 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:23:59.227908 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-7e7632e9-4c65-4712-9a6c-446e1f16b382 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:23:59.322811 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7632e9-4c65-4712-9a6c-446e1f16b382 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:23:59.324390 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7632e9-4c65-4712-9a6c-446e1f16b382 service nova] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:23:59.342885 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 713/1416] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:23:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:24:00.252920 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436ae65-e10d-4e8c-9499-d71a5b8091e1 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:24:00.253509 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436ae65-e10d-4e8c-9499-d71a5b8091e1 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:24:00.253509 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436ae65-e10d-4e8c-9499-d71a5b8091e1 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:24:00.255601 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 704/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 12 01:24:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:24:00.264258 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e5a36-df11-4a8b-beaa-3fabaec270b2 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:24:00.264994 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e5a36-df11-4a8b-beaa-3fabaec270b2 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:24:00.265168 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e5a36-df11-4a8b-beaa-3fabaec270b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:24:00.349650 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-bc3e5a36-df11-4a8b-beaa-3fabaec270b2 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:24:00.350890 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-bc3e5a36-df11-4a8b-beaa-3fabaec270b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:24:00.380030 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:24:00.455131 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 714/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 12 01:24:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:24:00.607930 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9436ae65-e10d-4e8c-9499-d71a5b8091e1 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:24:00.609376 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-9436ae65-e10d-4e8c-9499-d71a5b8091e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:24:00.772947 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9436ae65-e10d-4e8c-9499-d71a5b8091e1 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:24:00.823003 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:24:00.908276 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09d4131-5480-4bbe-9980-2b382ffe0abf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd5e95467b44175be2478c2c7c89926', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:24:00.908791 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d4131-5480-4bbe-9980-2b382ffe0abf service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:24:00.909064 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d4131-5480-4bbe-9980-2b382ffe0abf service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:24:00.909333 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d4131-5480-4bbe-9980-2b382ffe0abf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:24:00.910972 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-b09d4131-5480-4bbe-9980-2b382ffe0abf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:24:01.008707 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09d4131-5480-4bbe-9980-2b382ffe0abf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:24:01.010330 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09d4131-5480-4bbe-9980-2b382ffe0abf service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:24:01.028435 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 705/1419] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:24:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:24:01.905578 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cafb624-b15f-4294-8168-b35b7963fca9 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:24:01.906137 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cafb624-b15f-4294-8168-b35b7963fca9 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:24:01.906137 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cafb624-b15f-4294-8168-b35b7963fca9 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:24:01.907483 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 715/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 12 01:24:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:24:01.912874 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21957ed9-8a90-4a8a-a283-f7052d87dbfd None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:24:01.913356 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21957ed9-8a90-4a8a-a283-f7052d87dbfd None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:24:01.913356 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21957ed9-8a90-4a8a-a283-f7052d87dbfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:24:01.969665 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:24:02.002407 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-21957ed9-8a90-4a8a-a283-f7052d87dbfd None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:24:02.003644 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-21957ed9-8a90-4a8a-a283-f7052d87dbfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:24:02.106310 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 706/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 12 01:24:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 01:24:02.269854 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cafb624-b15f-4294-8168-b35b7963fca9 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:24:02.272313 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-4cafb624-b15f-4294-8168-b35b7963fca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:24:02.434319 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cafb624-b15f-4294-8168-b35b7963fca9 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:24:02.446712 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:24:02.571103 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdf4eba-1934-43e0-953f-e7f086afbe36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd5e95467b44175be2478c2c7c89926', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:24:02.571632 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf4eba-1934-43e0-953f-e7f086afbe36 service nova] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:24:02.571879 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf4eba-1934-43e0-953f-e7f086afbe36 service nova] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:24:02.572169 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf4eba-1934-43e0-953f-e7f086afbe36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:24:02.573770 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-6cdf4eba-1934-43e0-953f-e7f086afbe36 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:24:02.669674 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdf4eba-1934-43e0-953f-e7f086afbe36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:24:02.671297 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdf4eba-1934-43e0-953f-e7f086afbe36 service nova] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:24:02.691619 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 716/1422] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:24:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:24:03.587308 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6692aef6-7938-4cc5-b220-e0409442120e None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:24:03.587866 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6692aef6-7938-4cc5-b220-e0409442120e None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:24:03.587866 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6692aef6-7938-4cc5-b220-e0409442120e None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:24:03.589182 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 707/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 12 01:24:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:24:03.595491 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea71c5-dc09-4a7f-b817-08c25383c788 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:24:03.596277 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea71c5-dc09-4a7f-b817-08c25383c788 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:24:03.596430 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea71c5-dc09-4a7f-b817-08c25383c788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:24:03.620329 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:24:03.681012 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-acea71c5-dc09-4a7f-b817-08c25383c788 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:24:03.682265 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-acea71c5-dc09-4a7f-b817-08c25383c788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:24:03.792040 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 717/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 12 01:24:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:24:03.944072 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6692aef6-7938-4cc5-b220-e0409442120e None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:24:03.946577 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-6692aef6-7938-4cc5-b220-e0409442120e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:24:04.070942 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:24:04.114345 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6692aef6-7938-4cc5-b220-e0409442120e None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:24:04.236231 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c7ea69-6d42-4016-9e2e-64dce4f759af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd5e95467b44175be2478c2c7c89926', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:24:04.236838 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7ea69-6d42-4016-9e2e-64dce4f759af service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:24:04.237111 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7ea69-6d42-4016-9e2e-64dce4f759af service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:24:04.237378 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7ea69-6d42-4016-9e2e-64dce4f759af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:24:04.239093 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-18c7ea69-6d42-4016-9e2e-64dce4f759af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:24:04.321211 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:24:04.338024 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c7ea69-6d42-4016-9e2e-64dce4f759af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:24:04.339761 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c7ea69-6d42-4016-9e2e-64dce4f759af service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:24:04.360650 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 708/1425] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:24:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:24:05.218675 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb608c8-1f0e-40ee-a0b5-cd0e511bf2dc None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:24:05.219252 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb608c8-1f0e-40ee-a0b5-cd0e511bf2dc None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:24:05.219252 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb608c8-1f0e-40ee-a0b5-cd0e511bf2dc None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:24:05.220544 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 718/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 12 01:24:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:24:05.226671 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2589c21-5578-4a9e-aa6e-9f03f843066b None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:24:05.227153 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2589c21-5578-4a9e-aa6e-9f03f843066b None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:24:05.227252 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2589c21-5578-4a9e-aa6e-9f03f843066b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:24:05.310888 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-a2589c21-5578-4a9e-aa6e-9f03f843066b None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:24:05.312103 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-a2589c21-5578-4a9e-aa6e-9f03f843066b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:24:05.414022 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 709/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 12 01:24:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:24:05.574822 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb608c8-1f0e-40ee-a0b5-cd0e511bf2dc None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:24:05.577278 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-1bb608c8-1f0e-40ee-a0b5-cd0e511bf2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:24:05.671829 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:24:05.744175 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb608c8-1f0e-40ee-a0b5-cd0e511bf2dc None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:24:05.864359 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ffd694-1ed4-40df-91fc-a5ea28d11d86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd5e95467b44175be2478c2c7c89926', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:24:05.864959 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ffd694-1ed4-40df-91fc-a5ea28d11d86 service nova] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:24:05.865232 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ffd694-1ed4-40df-91fc-a5ea28d11d86 service nova] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:24:05.865498 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ffd694-1ed4-40df-91fc-a5ea28d11d86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:24:05.867149 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-c6ffd694-1ed4-40df-91fc-a5ea28d11d86 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:24:05.916267 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:24:05.969319 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ffd694-1ed4-40df-91fc-a5ea28d11d86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:24:05.970941 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ffd694-1ed4-40df-91fc-a5ea28d11d86 service nova] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:24:05.988859 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 719/1428] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:24:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:24:06.812604 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6ead7-9968-4ce4-a053-955c8850fe41 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:24:06.813520 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6ead7-9968-4ce4-a053-955c8850fe41 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:24:06.813520 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6ead7-9968-4ce4-a053-955c8850fe41 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:24:06.815769 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 710/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 12 01:24:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:24:06.824340 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e8fc24-78db-4d79-9322-b7adeade8052 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:24:06.824772 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e8fc24-78db-4d79-9322-b7adeade8052 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:24:06.824864 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e8fc24-78db-4d79-9322-b7adeade8052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:24:06.916984 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-b5e8fc24-78db-4d79-9322-b7adeade8052 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:24:06.918228 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-b5e8fc24-78db-4d79-9322-b7adeade8052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:24:07.032766 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 720/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 12 01:24:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:24:07.211851 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed6ead7-9968-4ce4-a053-955c8850fe41 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:24:07.214351 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-4ed6ead7-9968-4ce4-a053-955c8850fe41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:24:07.267006 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:24:07.383048 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed6ead7-9968-4ce4-a053-955c8850fe41 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:24:07.510296 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f7cf27-256f-450c-bfea-1cf4c3898482 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd5e95467b44175be2478c2c7c89926', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:24:07.510930 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7cf27-256f-450c-bfea-1cf4c3898482 service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:24:07.511200 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7cf27-256f-450c-bfea-1cf4c3898482 service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:24:07.511463 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7cf27-256f-450c-bfea-1cf4c3898482 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:24:07.513595 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-08f7cf27-256f-450c-bfea-1cf4c3898482 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:24:07.521510 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:24:07.639187 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f7cf27-256f-450c-bfea-1cf4c3898482 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:24:07.640838 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f7cf27-256f-450c-bfea-1cf4c3898482 service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:24:07.659793 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 711/1431] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:24:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:24:08.453595 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ca22b-673a-4733-9c2b-641b4e058876 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:24:08.454548 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ca22b-673a-4733-9c2b-641b4e058876 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:24:08.454548 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ca22b-673a-4733-9c2b-641b4e058876 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:24:08.456680 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 721/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 12 01:24:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:24:08.462984 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16431e5d-48c8-4e7b-b2d9-fcbe611bfaee None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:24:08.463727 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16431e5d-48c8-4e7b-b2d9-fcbe611bfaee None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:24:08.463944 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16431e5d-48c8-4e7b-b2d9-fcbe611bfaee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:24:08.548083 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-16431e5d-48c8-4e7b-b2d9-fcbe611bfaee None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:24:08.549291 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-16431e5d-48c8-4e7b-b2d9-fcbe611bfaee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:24:08.622607 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:24:08.652092 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 712/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 12 01:24:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:24:08.806341 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316ca22b-673a-4733-9c2b-641b4e058876 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:24:08.807859 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-316ca22b-673a-4733-9c2b-641b4e058876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:24:08.827381 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:24:08.985157 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316ca22b-673a-4733-9c2b-641b4e058876 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:24:09.079250 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:24:09.107156 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5fea86-cd52-4122-8687-be6edd8f08fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd5e95467b44175be2478c2c7c89926', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:24:09.107773 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5fea86-cd52-4122-8687-be6edd8f08fc service nova] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:24:09.108091 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5fea86-cd52-4122-8687-be6edd8f08fc service nova] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:24:09.108340 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5fea86-cd52-4122-8687-be6edd8f08fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:24:09.110552 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-1e5fea86-cd52-4122-8687-be6edd8f08fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:24:09.202029 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5fea86-cd52-4122-8687-be6edd8f08fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:24:09.203706 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5fea86-cd52-4122-8687-be6edd8f08fc service nova] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:24:09.222619 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 722/1434] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:24:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:24:10.024607 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e5b7e-763f-49c6-93c0-ab582385e667 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:24:10.025164 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e5b7e-763f-49c6-93c0-ab582385e667 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:24:10.025164 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e5b7e-763f-49c6-93c0-ab582385e667 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:24:10.027150 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 713/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 12 01:24:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:24:10.033970 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a799b-bfe5-48b0-a2b9-8cf2bca4270c None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:24:10.034443 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a799b-bfe5-48b0-a2b9-8cf2bca4270c None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:24:10.034557 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a799b-bfe5-48b0-a2b9-8cf2bca4270c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:24:10.127111 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-972a799b-bfe5-48b0-a2b9-8cf2bca4270c None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:24:10.128470 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-972a799b-bfe5-48b0-a2b9-8cf2bca4270c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:24:10.178042 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:24:10.236119 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 723/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 12 01:24:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:24:10.391053 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e5b7e-763f-49c6-93c0-ab582385e667 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:24:10.392578 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-4c8e5b7e-763f-49c6-93c0-ab582385e667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:24:10.551117 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e5b7e-763f-49c6-93c0-ab582385e667 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:24:10.608797 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:24:10.671786 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0128f177-d72e-4881-a0fd-5d3a0d8fd31e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd5e95467b44175be2478c2c7c89926', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:24:10.672391 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128f177-d72e-4881-a0fd-5d3a0d8fd31e service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:24:10.672659 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128f177-d72e-4881-a0fd-5d3a0d8fd31e service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:24:10.672918 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128f177-d72e-4881-a0fd-5d3a0d8fd31e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:24:10.674561 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-0128f177-d72e-4881-a0fd-5d3a0d8fd31e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:24:10.768878 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0128f177-d72e-4881-a0fd-5d3a0d8fd31e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:24:10.770429 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0128f177-d72e-4881-a0fd-5d3a0d8fd31e service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:24:10.794385 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 714/1437] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:24:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:24:11.610636 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0674fabd-ace9-4f05-994b-9a6195a6738c None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:24:11.611470 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0674fabd-ace9-4f05-994b-9a6195a6738c None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:24:11.611470 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0674fabd-ace9-4f05-994b-9a6195a6738c None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:24:11.613615 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 724/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 12 01:24:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:24:11.619955 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592fc8be-bd52-4ddf-89a8-fc554aaa84e3 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:24:11.620421 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592fc8be-bd52-4ddf-89a8-fc554aaa84e3 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:24:11.620529 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592fc8be-bd52-4ddf-89a8-fc554aaa84e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:24:11.703364 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-592fc8be-bd52-4ddf-89a8-fc554aaa84e3 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:24:11.705238 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-592fc8be-bd52-4ddf-89a8-fc554aaa84e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:24:11.708429 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:24:11.813699 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 715/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 12 01:24:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:24:11.966727 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0674fabd-ace9-4f05-994b-9a6195a6738c None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:24:11.969654 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-0674fabd-ace9-4f05-994b-9a6195a6738c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:24:12.129221 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0674fabd-ace9-4f05-994b-9a6195a6738c None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:24:12.167571 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:24:12.262343 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea2c77f-3e82-4365-86fc-4ade46098ea8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd5e95467b44175be2478c2c7c89926', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:24:12.262950 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea2c77f-3e82-4365-86fc-4ade46098ea8 service nova] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:24:12.263217 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea2c77f-3e82-4365-86fc-4ade46098ea8 service nova] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:24:12.263476 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea2c77f-3e82-4365-86fc-4ade46098ea8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:24:12.265086 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-6ea2c77f-3e82-4365-86fc-4ade46098ea8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:24:12.363239 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea2c77f-3e82-4365-86fc-4ade46098ea8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:24:12.364869 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea2c77f-3e82-4365-86fc-4ade46098ea8 service nova] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:24:12.384890 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 725/1440] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:24:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:24:14.189195 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ea405-7a52-42a5-9031-eae0cb6c76ec None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:24:14.189787 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ea405-7a52-42a5-9031-eae0cb6c76ec None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:24:14.189787 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ea405-7a52-42a5-9031-eae0cb6c76ec None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:24:14.191101 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 716/1441] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 12 01:24:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:24:14.197453 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ffca9-baf1-4218-9324-3f0b9ed647b3 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:24:14.198212 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ffca9-baf1-4218-9324-3f0b9ed647b3 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:24:14.198323 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ffca9-baf1-4218-9324-3f0b9ed647b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:24:14.243678 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:24:14.276144 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-064ffca9-baf1-4218-9324-3f0b9ed647b3 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:24:14.277418 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-064ffca9-baf1-4218-9324-3f0b9ed647b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:24:14.382653 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 726/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 12 01:24:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:24:14.682141 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ea405-7a52-42a5-9031-eae0cb6c76ec None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:24:14.683865 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-040ea405-7a52-42a5-9031-eae0cb6c76ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:24:14.788539 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ea405-7a52-42a5-9031-eae0cb6c76ec None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:24:14.823035 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:24:14.877663 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5662f545-f989-4a6a-b917-3b315a792941 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:24:14.878303 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5662f545-f989-4a6a-b917-3b315a792941 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:24:14.878574 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5662f545-f989-4a6a-b917-3b315a792941 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:24:14.878836 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5662f545-f989-4a6a-b917-3b315a792941 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:24:14.880534 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-5662f545-f989-4a6a-b917-3b315a792941 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:24:14.997936 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5662f545-f989-4a6a-b917-3b315a792941 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:24:14.999423 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5662f545-f989-4a6a-b917-3b315a792941 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:24:15.018807 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 717/1443] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:24:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:24:17.058800 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb42403-8125-4228-a827-585b29c32fd6 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:24:17.059795 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb42403-8125-4228-a827-585b29c32fd6 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:24:17.059795 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb42403-8125-4228-a827-585b29c32fd6 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:24:17.061779 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 727/1444] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 12 01:24:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:24:17.068137 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba7bef-cfdb-4d63-9090-f58eebe36305 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:24:17.068879 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba7bef-cfdb-4d63-9090-f58eebe36305 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:24:17.069066 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba7bef-cfdb-4d63-9090-f58eebe36305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:24:17.142004 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-2eba7bef-cfdb-4d63-9090-f58eebe36305 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:24:17.143242 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2eba7bef-cfdb-4d63-9090-f58eebe36305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:24:17.156332 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:24:17.243308 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 718/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 12 01:24:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:24:17.523409 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb42403-8125-4228-a827-585b29c32fd6 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:24:17.524963 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-aeb42403-8125-4228-a827-585b29c32fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:24:17.640794 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb42403-8125-4228-a827-585b29c32fd6 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:24:17.654499 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:24:17.717776 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440e2d7d-57a5-4e1b-a412-60b4c2b4688a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:24:17.718412 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e2d7d-57a5-4e1b-a412-60b4c2b4688a service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:24:17.718685 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e2d7d-57a5-4e1b-a412-60b4c2b4688a service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:24:17.718951 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e2d7d-57a5-4e1b-a412-60b4c2b4688a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:24:17.720558 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-440e2d7d-57a5-4e1b-a412-60b4c2b4688a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:24:17.842720 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440e2d7d-57a5-4e1b-a412-60b4c2b4688a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:24:17.844064 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440e2d7d-57a5-4e1b-a412-60b4c2b4688a service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:24:17.863130 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 728/1446] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:24:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:24:20.116156 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c498f5-cec2-4abe-8151-3e6456b1fd94 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:24:20.116754 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c498f5-cec2-4abe-8151-3e6456b1fd94 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:24:20.116754 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c498f5-cec2-4abe-8151-3e6456b1fd94 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:24:20.118019 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 719/1447] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 12 01:24:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:24:20.124498 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b767ad-8967-4cf6-90b1-57190b701214 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:24:20.125326 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b767ad-8967-4cf6-90b1-57190b701214 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:24:20.125326 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b767ad-8967-4cf6-90b1-57190b701214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:24:20.179788 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:24:20.199495 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-78b767ad-8967-4cf6-90b1-57190b701214 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:24:20.200695 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-78b767ad-8967-4cf6-90b1-57190b701214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:24:20.306208 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 729/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 12 01:24:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:24:20.589410 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c498f5-cec2-4abe-8151-3e6456b1fd94 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:24:20.591021 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-a0c498f5-cec2-4abe-8151-3e6456b1fd94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:24:20.713531 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c498f5-cec2-4abe-8151-3e6456b1fd94 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:24:20.754833 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:24:20.791710 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafdcc8f-edec-483f-851c-db1e137d57f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:24:20.792340 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafdcc8f-edec-483f-851c-db1e137d57f4 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:24:20.792606 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafdcc8f-edec-483f-851c-db1e137d57f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:24:20.792867 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafdcc8f-edec-483f-851c-db1e137d57f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:24:20.794491 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-bafdcc8f-edec-483f-851c-db1e137d57f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:24:20.921397 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafdcc8f-edec-483f-851c-db1e137d57f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:24:20.922866 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafdcc8f-edec-483f-851c-db1e137d57f4 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:24:20.944466 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 720/1449] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:24:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:24:22.985308 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79995cb0-6988-4ce3-8628-eb5a704d3598 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:24:22.986206 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79995cb0-6988-4ce3-8628-eb5a704d3598 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:24:22.986206 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79995cb0-6988-4ce3-8628-eb5a704d3598 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:24:22.987993 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 730/1450] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 12 01:24:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:24:22.996471 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4e95dd-4604-4f5d-bd06-0f7d77813d75 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:24:22.996918 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4e95dd-4604-4f5d-bd06-0f7d77813d75 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:24:22.997022 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4e95dd-4604-4f5d-bd06-0f7d77813d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:24:23.067523 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-ae4e95dd-4604-4f5d-bd06-0f7d77813d75 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:24:23.068717 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-ae4e95dd-4604-4f5d-bd06-0f7d77813d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:24:23.094155 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:24:23.177167 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 721/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 12 01:24:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:24:23.457669 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79995cb0-6988-4ce3-8628-eb5a704d3598 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:24:23.459255 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-79995cb0-6988-4ce3-8628-eb5a704d3598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:24:23.567657 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79995cb0-6988-4ce3-8628-eb5a704d3598 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:24:23.592371 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:24:23.648763 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b88405f-190e-4ac8-8c3c-bab56a064d3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:24:23.649365 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b88405f-190e-4ac8-8c3c-bab56a064d3b service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:24:23.649641 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b88405f-190e-4ac8-8c3c-bab56a064d3b service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:24:23.649902 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b88405f-190e-4ac8-8c3c-bab56a064d3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:24:23.651625 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-7b88405f-190e-4ac8-8c3c-bab56a064d3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:24:23.766092 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b88405f-190e-4ac8-8c3c-bab56a064d3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:24:23.767544 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b88405f-190e-4ac8-8c3c-bab56a064d3b service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:24:23.785624 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 731/1452] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:24:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:24:25.853542 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6bb165-3344-4aed-bfe7-839f9ea6f734 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:24:25.854104 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6bb165-3344-4aed-bfe7-839f9ea6f734 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:24:25.854104 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6bb165-3344-4aed-bfe7-839f9ea6f734 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:24:25.855971 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 722/1453] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 12 01:24:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:24:25.861564 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1415d11-c6cf-4d4e-b6e8-48e4192b1a7d None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:24:25.862017 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1415d11-c6cf-4d4e-b6e8-48e4192b1a7d None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:24:25.862161 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1415d11-c6cf-4d4e-b6e8-48e4192b1a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:24:25.946951 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:24:25.950448 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-b1415d11-c6cf-4d4e-b6e8-48e4192b1a7d None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:24:25.952153 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-b1415d11-c6cf-4d4e-b6e8-48e4192b1a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:24:26.066746 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 732/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 12 01:24:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:24:26.353620 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6bb165-3344-4aed-bfe7-839f9ea6f734 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:24:26.355357 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-9e6bb165-3344-4aed-bfe7-839f9ea6f734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:24:26.468626 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6bb165-3344-4aed-bfe7-839f9ea6f734 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:24:26.521007 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:24:26.547426 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5488bd35-787b-4ecb-8188-9453ecf0ceb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:24:26.548038 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488bd35-787b-4ecb-8188-9453ecf0ceb3 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:24:26.548312 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488bd35-787b-4ecb-8188-9453ecf0ceb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:24:26.548580 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488bd35-787b-4ecb-8188-9453ecf0ceb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:24:26.550233 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-5488bd35-787b-4ecb-8188-9453ecf0ceb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:24:26.663834 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5488bd35-787b-4ecb-8188-9453ecf0ceb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:24:26.665200 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5488bd35-787b-4ecb-8188-9453ecf0ceb3 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:24:26.684696 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 723/1455] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:24:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:24:28.652734 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a7ed4-ab84-4a4e-8f67-7a225160461a None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:24:28.653288 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a7ed4-ab84-4a4e-8f67-7a225160461a None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:24:28.653288 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a7ed4-ab84-4a4e-8f67-7a225160461a None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:24:28.654560 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 733/1456] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 12 01:24:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:24:28.660918 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ecdacc-e9e8-4feb-9b48-10a2f1e09557 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:24:28.661658 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ecdacc-e9e8-4feb-9b48-10a2f1e09557 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:24:28.661818 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ecdacc-e9e8-4feb-9b48-10a2f1e09557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:24:28.737902 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-13ecdacc-e9e8-4feb-9b48-10a2f1e09557 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:24:28.739136 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-13ecdacc-e9e8-4feb-9b48-10a2f1e09557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:24:28.774324 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:24:28.851585 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 724/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 12 01:24:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:24:29.137431 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661a7ed4-ab84-4a4e-8f67-7a225160461a None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:24:29.139020 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-661a7ed4-ab84-4a4e-8f67-7a225160461a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:24:29.250253 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661a7ed4-ab84-4a4e-8f67-7a225160461a None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:24:29.281575 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:24:29.328820 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29fae27-bd57-4bbf-970b-7b0dc3c95e8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:24:29.329838 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29fae27-bd57-4bbf-970b-7b0dc3c95e8e service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:24:29.330308 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29fae27-bd57-4bbf-970b-7b0dc3c95e8e service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:24:29.330740 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29fae27-bd57-4bbf-970b-7b0dc3c95e8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:24:29.333416 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-d29fae27-bd57-4bbf-970b-7b0dc3c95e8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:24:29.451312 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29fae27-bd57-4bbf-970b-7b0dc3c95e8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:24:29.452738 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29fae27-bd57-4bbf-970b-7b0dc3c95e8e service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:24:29.470417 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 734/1458] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:24:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:24:31.397832 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806681d0-43d4-49c6-a098-7d72cc9ffc43 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:24:31.398450 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806681d0-43d4-49c6-a098-7d72cc9ffc43 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:24:31.398450 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806681d0-43d4-49c6-a098-7d72cc9ffc43 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:24:31.399724 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 725/1459] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 12 01:24:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:24:31.406018 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d59d13-bd18-4534-b814-a33dcf978db5 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:24:31.406508 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d59d13-bd18-4534-b814-a33dcf978db5 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:24:31.406612 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d59d13-bd18-4534-b814-a33dcf978db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:24:31.486984 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-28d59d13-bd18-4534-b814-a33dcf978db5 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:24:31.488193 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-28d59d13-bd18-4534-b814-a33dcf978db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:24:31.497077 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:24:31.594801 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 735/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 12 01:24:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:24:31.873571 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806681d0-43d4-49c6-a098-7d72cc9ffc43 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:24:31.876081 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-806681d0-43d4-49c6-a098-7d72cc9ffc43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:24:32.000354 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806681d0-43d4-49c6-a098-7d72cc9ffc43 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:24:32.058131 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:24:32.078354 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb98c6-4bc5-4090-a896-2067d0364cb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:24:32.078963 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb98c6-4bc5-4090-a896-2067d0364cb8 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:24:32.079234 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb98c6-4bc5-4090-a896-2067d0364cb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:24:32.079502 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb98c6-4bc5-4090-a896-2067d0364cb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:24:32.081097 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-5efb98c6-4bc5-4090-a896-2067d0364cb8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:24:32.204434 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efb98c6-4bc5-4090-a896-2067d0364cb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:24:32.205977 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efb98c6-4bc5-4090-a896-2067d0364cb8 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:24:32.226134 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 726/1461] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:24:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 01:24:34.212576 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6413b7-5592-4e51-b7e3-cd53e4935583 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:24:34.213160 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6413b7-5592-4e51-b7e3-cd53e4935583 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:24:34.213160 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6413b7-5592-4e51-b7e3-cd53e4935583 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:24:34.214491 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 736/1462] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 12 01:24:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:24:34.220622 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1aede-81f4-478c-b9dd-84d43674fdd6 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:24:34.221275 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1aede-81f4-478c-b9dd-84d43674fdd6 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:24:34.221369 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1aede-81f4-478c-b9dd-84d43674fdd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:24:34.298940 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-0ce1aede-81f4-478c-b9dd-84d43674fdd6 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:24:34.300161 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-0ce1aede-81f4-478c-b9dd-84d43674fdd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:24:34.343309 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:24:34.407619 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 727/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 12 01:24:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:24:34.691234 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6413b7-5592-4e51-b7e3-cd53e4935583 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:24:34.693729 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-cc6413b7-5592-4e51-b7e3-cd53e4935583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:24:34.820018 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6413b7-5592-4e51-b7e3-cd53e4935583 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:24:34.860591 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:24:34.898333 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebe6981-75b8-435b-aedf-7102b61bf95d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:24:34.898939 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe6981-75b8-435b-aedf-7102b61bf95d service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:24:34.899213 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe6981-75b8-435b-aedf-7102b61bf95d service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:24:34.899550 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe6981-75b8-435b-aedf-7102b61bf95d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:24:34.901155 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-5ebe6981-75b8-435b-aedf-7102b61bf95d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:24:35.026448 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebe6981-75b8-435b-aedf-7102b61bf95d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:24:35.033328 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebe6981-75b8-435b-aedf-7102b61bf95d service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:24:35.056588 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 737/1464] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:24:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:24:36.976874 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d74c4a-707f-4a85-9f83-d4c245430d64 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:24:36.977777 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d74c4a-707f-4a85-9f83-d4c245430d64 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:24:36.977777 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d74c4a-707f-4a85-9f83-d4c245430d64 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:24:36.979789 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 728/1465] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 12 01:24:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:24:36.988495 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c564b859-968d-43a4-8391-794b70ccdc94 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:24:36.988935 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c564b859-968d-43a4-8391-794b70ccdc94 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:24:36.989030 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c564b859-968d-43a4-8391-794b70ccdc94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:24:37.063769 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-c564b859-968d-43a4-8391-794b70ccdc94 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:24:37.064976 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-c564b859-968d-43a4-8391-794b70ccdc94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:24:37.085592 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:24:37.171261 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 738/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 12 01:24:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:24:37.453485 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d74c4a-707f-4a85-9f83-d4c245430d64 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:24:37.455066 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-34d74c4a-707f-4a85-9f83-d4c245430d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:24:37.577632 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d74c4a-707f-4a85-9f83-d4c245430d64 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:24:37.656723 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:24:37.665392 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d120253-d476-4a8b-bee8-4cfd5657e6f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:24:37.666025 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d120253-d476-4a8b-bee8-4cfd5657e6f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:24:37.666332 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d120253-d476-4a8b-bee8-4cfd5657e6f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:24:37.666599 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d120253-d476-4a8b-bee8-4cfd5657e6f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:24:37.668287 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-9d120253-d476-4a8b-bee8-4cfd5657e6f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:24:37.793898 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d120253-d476-4a8b-bee8-4cfd5657e6f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:24:37.795375 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d120253-d476-4a8b-bee8-4cfd5657e6f1 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:24:37.816327 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 729/1467] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:24:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:24:39.791501 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb70da-b638-48ca-9e0e-46fa39031eed None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:24:39.792031 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb70da-b638-48ca-9e0e-46fa39031eed None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:24:39.792031 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb70da-b638-48ca-9e0e-46fa39031eed None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:24:39.793429 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 739/1468] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 12 01:24:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:24:39.799103 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62482ce7-c54d-4748-a574-a1914ad288b7 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:24:39.799521 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62482ce7-c54d-4748-a574-a1914ad288b7 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:24:39.799617 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62482ce7-c54d-4748-a574-a1914ad288b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:24:39.875659 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-62482ce7-c54d-4748-a574-a1914ad288b7 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:24:39.876868 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-62482ce7-c54d-4748-a574-a1914ad288b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:24:39.927697 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:24:39.985310 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 730/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 12 01:24:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:24:40.263661 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb70da-b638-48ca-9e0e-46fa39031eed None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:24:40.265226 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-86bb70da-b638-48ca-9e0e-46fa39031eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:24:40.370622 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb70da-b638-48ca-9e0e-46fa39031eed None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:24:40.420045 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:24:40.449191 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6133c42-b139-4a64-9029-bd9e2ec79b12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:24:40.449799 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6133c42-b139-4a64-9029-bd9e2ec79b12 service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:24:40.450074 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6133c42-b139-4a64-9029-bd9e2ec79b12 service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:24:40.450377 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6133c42-b139-4a64-9029-bd9e2ec79b12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:24:40.451990 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-a6133c42-b139-4a64-9029-bd9e2ec79b12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:24:40.570386 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6133c42-b139-4a64-9029-bd9e2ec79b12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:24:40.571828 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6133c42-b139-4a64-9029-bd9e2ec79b12 service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:24:40.591300 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 740/1470] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:24:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 01:24:49.983458 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=22 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:24:50.588610 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=66 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:25:00.162281 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de6a4d9-3b48-4a89-b53a-af3a5fb1c88d None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:25:00.162827 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de6a4d9-3b48-4a89-b53a-af3a5fb1c88d None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:25:00.162827 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de6a4d9-3b48-4a89-b53a-af3a5fb1c88d None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:25:00.164927 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 731/1471] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:25:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:25:00.173065 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e534a5f-2fbd-48b0-bd27-ac14f8745f98 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:25:00.173528 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e534a5f-2fbd-48b0-bd27-ac14f8745f98 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:25:00.173641 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e534a5f-2fbd-48b0-bd27-ac14f8745f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:25:00.244886 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-1e534a5f-2fbd-48b0-bd27-ac14f8745f98 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:25:00.246087 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-1e534a5f-2fbd-48b0-bd27-ac14f8745f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:25:00.356849 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 741/1472] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:25:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 01:25:00.654928 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a4c540-d170-4206-84fc-265fb79d33f4 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:25:00.655264 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a4c540-d170-4206-84fc-265fb79d33f4 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:25:00.655623 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a4c540-d170-4206-84fc-265fb79d33f4 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:25:00.657707 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 732/1473] 10.222.0.26 () {54 vars in 967 bytes} [Fri Aug 12 01:25:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:25:00.663067 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85bc2f-ea87-4098-bc90-68839c5d0e82 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:25:00.663355 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85bc2f-ea87-4098-bc90-68839c5d0e82 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:25:00.663634 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85bc2f-ea87-4098-bc90-68839c5d0e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:25:00.746028 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-3e85bc2f-ea87-4098-bc90-68839c5d0e82 None None] MFA Rules not processed for user `bd73d9b9b63a499d909fec034bf9a259`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:25:00.747726 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-3e85bc2f-ea87-4098-bc90-68839c5d0e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:25:00.772609 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:25:00.829599 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 742/1474] 10.222.0.26 () {58 vars in 1064 bytes} [Fri Aug 12 01:25:00 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:25:00.837316 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a4c540-d170-4206-84fc-265fb79d33f4 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:25:00.838879 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d0a4c540-d170-4206-84fc-265fb79d33f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:25:00.952503 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a4c540-d170-4206-84fc-265fb79d33f4 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:25:01.037647 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f708fd-56ae-4459-b845-ab41d9ab0231 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd73d9b9b63a499d909fec034bf9a259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:25:01.038460 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f708fd-56ae-4459-b845-ab41d9ab0231 service glance] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:25:01.038813 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f708fd-56ae-4459-b845-ab41d9ab0231 service glance] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:25:01.039174 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f708fd-56ae-4459-b845-ab41d9ab0231 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:25:01.041755 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-51f708fd-56ae-4459-b845-ab41d9ab0231 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:25:01.104350 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:25:01.164534 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f708fd-56ae-4459-b845-ab41d9ab0231 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:25:01.165987 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f708fd-56ae-4459-b845-ab41d9ab0231 service glance] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:25:01.185169 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 733/1475] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:25:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:25:03.191166 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02baf91-1888-4e48-b132-3c048b0a5e77 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:25:03.192088 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02baf91-1888-4e48-b132-3c048b0a5e77 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:25:03.192088 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02baf91-1888-4e48-b132-3c048b0a5e77 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:25:03.195015 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 743/1476] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:25:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:25:03.200502 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f09a50-4b13-4569-a3ac-6d260d46aa0c None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:25:03.200959 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f09a50-4b13-4569-a3ac-6d260d46aa0c None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:25:03.201076 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f09a50-4b13-4569-a3ac-6d260d46aa0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:25:03.277472 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-61f09a50-4b13-4569-a3ac-6d260d46aa0c None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:25:03.278743 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-61f09a50-4b13-4569-a3ac-6d260d46aa0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:25:03.404863 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 734/1477] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:25:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:25:03.675151 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02baf91-1888-4e48-b132-3c048b0a5e77 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:25:03.676720 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-a02baf91-1888-4e48-b132-3c048b0a5e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:25:03.812948 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02baf91-1888-4e48-b132-3c048b0a5e77 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:25:03.862379 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:25:03.911684 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67755a3-72bd-4150-853b-254bbecbb7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:25:03.912179 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67755a3-72bd-4150-853b-254bbecbb7fd admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:25:03.912286 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67755a3-72bd-4150-853b-254bbecbb7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:25:03.912588 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67755a3-72bd-4150-853b-254bbecbb7fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:25:03.913234 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67755a3-72bd-4150-853b-254bbecbb7fd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:25:03.915025 dv-cinder-784815-15-smb devstack@keystone.service[81555]: WARNING py.warnings [None req-e67755a3-72bd-4150-853b-254bbecbb7fd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 12 01:25:03.915025 dv-cinder-784815-15-smb devstack@keystone.service[81555]: warnings.warn(msg) Aug 12 01:25:03.915025 dv-cinder-784815-15-smb devstack@keystone.service[81555]: Aug 12 01:25:03.916155 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67755a3-72bd-4150-853b-254bbecbb7fd admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:25:03.934912 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 744/1478] 10.222.0.26 () {56 vars in 1108 bytes} [Fri Aug 12 01:25:03 2022] GET /identity/v3/projects => generated 2553 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:25:05.898548 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbac584-d859-46a3-ae50-269b33cc9dd6 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:25:05.899466 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbac584-d859-46a3-ae50-269b33cc9dd6 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:25:05.899466 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbac584-d859-46a3-ae50-269b33cc9dd6 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:25:05.901497 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 735/1479] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:25:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:25:05.907530 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810274b-9bfc-4317-9db8-e98d3bd0c062 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:25:05.908233 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810274b-9bfc-4317-9db8-e98d3bd0c062 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:25:05.908417 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810274b-9bfc-4317-9db8-e98d3bd0c062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:25:05.986622 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-e810274b-9bfc-4317-9db8-e98d3bd0c062 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:25:05.988504 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-e810274b-9bfc-4317-9db8-e98d3bd0c062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:25:06.096989 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 745/1480] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:25:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:25:06.381955 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbac584-d859-46a3-ae50-269b33cc9dd6 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:25:06.384372 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-6bbac584-d859-46a3-ae50-269b33cc9dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:25:06.398532 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:25:06.544442 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbac584-d859-46a3-ae50-269b33cc9dd6 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:25:06.633157 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:25:06.667857 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1b8c8d-6e56-46f4-bf9e-9925115765f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd5e95467b44175be2478c2c7c89926', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:25:06.668609 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b8c8d-6e56-46f4-bf9e-9925115765f4 service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:25:06.668882 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b8c8d-6e56-46f4-bf9e-9925115765f4 service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:25:06.669151 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b8c8d-6e56-46f4-bf9e-9925115765f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:25:06.670817 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-1e1b8c8d-6e56-46f4-bf9e-9925115765f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:25:06.764262 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1b8c8d-6e56-46f4-bf9e-9925115765f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:25:06.765848 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1b8c8d-6e56-46f4-bf9e-9925115765f4 service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:25:06.788343 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 736/1481] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:25:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:25:08.876504 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a43d5-105f-48d7-aa52-ee7bd714045b None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:25:08.877062 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a43d5-105f-48d7-aa52-ee7bd714045b None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:25:08.877062 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a43d5-105f-48d7-aa52-ee7bd714045b None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:25:08.879263 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 746/1482] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:25:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:25:08.885743 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57bbbe6-bc24-416c-983d-b41b53ae2d50 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:25:08.886218 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57bbbe6-bc24-416c-983d-b41b53ae2d50 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:25:08.886325 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57bbbe6-bc24-416c-983d-b41b53ae2d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:25:08.972346 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-b57bbbe6-bc24-416c-983d-b41b53ae2d50 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:25:08.974136 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-b57bbbe6-bc24-416c-983d-b41b53ae2d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:25:09.025530 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:25:09.078605 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 737/1483] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:25:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:25:09.369113 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662a43d5-105f-48d7-aa52-ee7bd714045b None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:25:09.370707 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-662a43d5-105f-48d7-aa52-ee7bd714045b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:25:09.395068 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:25:09.480215 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662a43d5-105f-48d7-aa52-ee7bd714045b None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:25:09.577973 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ec5a80-ea55-4065-85ed-e6d43733e6eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:25:09.578506 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec5a80-ea55-4065-85ed-e6d43733e6eb service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:25:09.578776 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec5a80-ea55-4065-85ed-e6d43733e6eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:25:09.579037 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec5a80-ea55-4065-85ed-e6d43733e6eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:25:09.580646 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-e9ec5a80-ea55-4065-85ed-e6d43733e6eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:25:09.660663 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:25:09.705212 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ec5a80-ea55-4065-85ed-e6d43733e6eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:25:09.706727 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ec5a80-ea55-4065-85ed-e6d43733e6eb service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:25:09.727274 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 747/1484] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:25:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:25:11.667850 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935de01-1dbe-43ed-8688-04597a6797a1 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:25:11.668412 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935de01-1dbe-43ed-8688-04597a6797a1 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:25:11.668412 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935de01-1dbe-43ed-8688-04597a6797a1 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:25:11.669917 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 738/1485] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:25:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:25:11.675107 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc30c7ec-a670-4867-a1b2-075e250de140 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:25:11.675555 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc30c7ec-a670-4867-a1b2-075e250de140 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:25:11.675660 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc30c7ec-a670-4867-a1b2-075e250de140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:25:11.743663 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-bc30c7ec-a670-4867-a1b2-075e250de140 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:25:11.744844 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-bc30c7ec-a670-4867-a1b2-075e250de140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:25:11.849357 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 748/1486] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:25:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:25:12.135284 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a935de01-1dbe-43ed-8688-04597a6797a1 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:25:12.137729 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-a935de01-1dbe-43ed-8688-04597a6797a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:25:12.248603 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a935de01-1dbe-43ed-8688-04597a6797a1 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:25:12.333621 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:25:12.335709 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44e750-6cdd-4dd4-9c36-2c543add4045 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:25:12.336472 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44e750-6cdd-4dd4-9c36-2c543add4045 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:25:12.336754 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44e750-6cdd-4dd4-9c36-2c543add4045 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:25:12.337078 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44e750-6cdd-4dd4-9c36-2c543add4045 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:25:12.340038 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-0c44e750-6cdd-4dd4-9c36-2c543add4045 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:25:12.463568 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c44e750-6cdd-4dd4-9c36-2c543add4045 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:25:12.465024 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c44e750-6cdd-4dd4-9c36-2c543add4045 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:25:12.485351 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 739/1487] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:25:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:25:14.502612 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe01d7-dc84-418a-b6c4-1487f360810d None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:25:14.503186 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe01d7-dc84-418a-b6c4-1487f360810d None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:25:14.503186 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe01d7-dc84-418a-b6c4-1487f360810d None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:25:14.505292 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 749/1488] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:25:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:25:14.512718 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9329b4f-2181-4335-9332-a90e99e851d2 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:25:14.513230 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9329b4f-2181-4335-9332-a90e99e851d2 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:25:14.513230 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9329b4f-2181-4335-9332-a90e99e851d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:25:14.597071 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-d9329b4f-2181-4335-9332-a90e99e851d2 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:25:14.598319 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d9329b4f-2181-4335-9332-a90e99e851d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:25:14.664902 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:25:14.719270 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 740/1489] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:25:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:25:15.030153 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe01d7-dc84-418a-b6c4-1487f360810d None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:25:15.032557 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-63fe01d7-dc84-418a-b6c4-1487f360810d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:25:15.070796 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:25:15.156936 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe01d7-dc84-418a-b6c4-1487f360810d None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:25:15.253153 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df18eb5c-60c9-42e8-8a74-b0d1b2e34df1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:25:15.253761 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df18eb5c-60c9-42e8-8a74-b0d1b2e34df1 service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:25:15.254082 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df18eb5c-60c9-42e8-8a74-b0d1b2e34df1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:25:15.254385 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df18eb5c-60c9-42e8-8a74-b0d1b2e34df1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:25:15.256000 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-df18eb5c-60c9-42e8-8a74-b0d1b2e34df1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:25:15.347405 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:25:15.385585 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df18eb5c-60c9-42e8-8a74-b0d1b2e34df1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:25:15.387078 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df18eb5c-60c9-42e8-8a74-b0d1b2e34df1 service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:25:15.407539 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 750/1490] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:25:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:25:17.552565 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330744bb-a4af-4aaa-a0f7-5efa551e1405 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:25:17.553158 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330744bb-a4af-4aaa-a0f7-5efa551e1405 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:25:17.553158 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330744bb-a4af-4aaa-a0f7-5efa551e1405 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:25:17.554473 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 741/1491] 10.222.0.26 () {54 vars in 927 bytes} [Fri Aug 12 01:25:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:25:17.560634 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457def65-df5c-485a-ba4f-032ddda69ce1 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:25:17.561104 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457def65-df5c-485a-ba4f-032ddda69ce1 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:25:17.561206 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457def65-df5c-485a-ba4f-032ddda69ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:25:17.644213 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-457def65-df5c-485a-ba4f-032ddda69ce1 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:25:17.645484 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-457def65-df5c-485a-ba4f-032ddda69ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:25:17.749459 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 751/1492] 10.222.0.26 () {58 vars in 1024 bytes} [Fri Aug 12 01:25:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:25:18.039202 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330744bb-a4af-4aaa-a0f7-5efa551e1405 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:25:18.040751 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-330744bb-a4af-4aaa-a0f7-5efa551e1405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:25:18.151221 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330744bb-a4af-4aaa-a0f7-5efa551e1405 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:25:18.235944 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd6d595-8b54-4b56-9b9a-012ca42cd615 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:25:18.236704 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd6d595-8b54-4b56-9b9a-012ca42cd615 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:25:18.237078 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd6d595-8b54-4b56-9b9a-012ca42cd615 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:25:18.237421 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd6d595-8b54-4b56-9b9a-012ca42cd615 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:25:18.239284 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-ccd6d595-8b54-4b56-9b9a-012ca42cd615 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:25:18.248484 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:25:18.357352 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd6d595-8b54-4b56-9b9a-012ca42cd615 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:25:18.358748 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd6d595-8b54-4b56-9b9a-012ca42cd615 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:25:18.379935 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 742/1493] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:25:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:25:27.747434 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=82 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:25:28.376725 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=50 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:26:29.923657 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1614697-a259-47b0-ac96-67851dd6085e None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:26:29.924544 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1614697-a259-47b0-ac96-67851dd6085e None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:26:29.924544 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1614697-a259-47b0-ac96-67851dd6085e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:26:30.015085 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-b1614697-a259-47b0-ac96-67851dd6085e None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:26:30.016308 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-b1614697-a259-47b0-ac96-67851dd6085e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:26:30.126411 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 752/1494] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:26:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:26:30.134817 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e62ff-cfe1-43cd-8fc1-be6c5635a221 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:26:30.135468 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e62ff-cfe1-43cd-8fc1-be6c5635a221 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:26:30.135468 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e62ff-cfe1-43cd-8fc1-be6c5635a221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:26:30.226219 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-783e62ff-cfe1-43cd-8fc1-be6c5635a221 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:26:30.227395 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-783e62ff-cfe1-43cd-8fc1-be6c5635a221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:26:30.339701 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 743/1495] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:26:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:26:30.346628 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1614697-a259-47b0-ac96-67851dd6085e None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:26:30.347841 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-b1614697-a259-47b0-ac96-67851dd6085e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:26:30.360099 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1614697-a259-47b0-ac96-67851dd6085e None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:26:30.433443 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:26:30.469087 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d39992-9c1e-4f1d-a9cc-ce8ada3f324d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:26:30.469690 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d39992-9c1e-4f1d-a9cc-ce8ada3f324d admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:26:30.469957 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d39992-9c1e-4f1d-a9cc-ce8ada3f324d admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:26:30.470252 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d39992-9c1e-4f1d-a9cc-ce8ada3f324d admin admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:26:30.470889 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d39992-9c1e-4f1d-a9cc-ce8ada3f324d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:26:30.471179 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d39992-9c1e-4f1d-a9cc-ce8ada3f324d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:26:30.472202 dv-cinder-784815-15-smb devstack@keystone.service[81555]: WARNING py.warnings [None req-26d39992-9c1e-4f1d-a9cc-ce8ada3f324d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 12 01:26:30.472202 dv-cinder-784815-15-smb devstack@keystone.service[81555]: warnings.warn(msg) Aug 12 01:26:30.472202 dv-cinder-784815-15-smb devstack@keystone.service[81555]: Aug 12 01:26:30.473075 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d39992-9c1e-4f1d-a9cc-ce8ada3f324d admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:26:30.484692 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 753/1496] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 01:26:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:26:30.493838 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783e62ff-cfe1-43cd-8fc1-be6c5635a221 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:26:30.503895 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783e62ff-cfe1-43cd-8fc1-be6c5635a221 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:26:30.567242 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:26:30.608809 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4fad59-ac63-475a-8135-328e050c717d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:26:30.609421 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4fad59-ac63-475a-8135-328e050c717d admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:26:30.609687 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4fad59-ac63-475a-8135-328e050c717d admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:26:30.609947 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4fad59-ac63-475a-8135-328e050c717d admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:26:30.610611 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4fad59-ac63-475a-8135-328e050c717d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:26:30.612344 dv-cinder-784815-15-smb devstack@keystone.service[81554]: WARNING py.warnings [None req-df4fad59-ac63-475a-8135-328e050c717d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 12 01:26:30.612344 dv-cinder-784815-15-smb devstack@keystone.service[81554]: warnings.warn(msg) Aug 12 01:26:30.612344 dv-cinder-784815-15-smb devstack@keystone.service[81554]: Aug 12 01:26:30.613525 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4fad59-ac63-475a-8135-328e050c717d admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:26:30.678277 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 744/1497] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:26:30 2022] POST /identity/v3/projects => generated 379 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:26:30.682722 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d39992-9c1e-4f1d-a9cc-ce8ada3f324d admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:26:30.684253 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-26d39992-9c1e-4f1d-a9cc-ce8ada3f324d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:26:30.719365 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d39992-9c1e-4f1d-a9cc-ce8ada3f324d admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:26:30.826654 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740bd886-01c1-4f3d-b592-37853e456081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:26:30.827261 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740bd886-01c1-4f3d-b592-37853e456081 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:26:30.827529 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740bd886-01c1-4f3d-b592-37853e456081 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:26:30.827789 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740bd886-01c1-4f3d-b592-37853e456081 admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:26:30.828458 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740bd886-01c1-4f3d-b592-37853e456081 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:26:30.829471 dv-cinder-784815-15-smb devstack@keystone.service[81555]: WARNING py.warnings [None req-740bd886-01c1-4f3d-b592-37853e456081 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 12 01:26:30.829471 dv-cinder-784815-15-smb devstack@keystone.service[81555]: warnings.warn(msg) Aug 12 01:26:30.829471 dv-cinder-784815-15-smb devstack@keystone.service[81555]: Aug 12 01:26:30.830692 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740bd886-01c1-4f3d-b592-37853e456081 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:26:30.878441 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 754/1498] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:26:30 2022] POST /identity/v3/users => generated 290 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 01:26:30.883351 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4fad59-ac63-475a-8135-328e050c717d admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:26:30.886082 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-df4fad59-ac63-475a-8135-328e050c717d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:26:30.958746 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4fad59-ac63-475a-8135-328e050c717d admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:26:31.055794 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:26:31.069734 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d620fea6-59aa-469e-b3c4-5bbf16bc76e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:26:31.070377 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d620fea6-59aa-469e-b3c4-5bbf16bc76e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:26:31.070650 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d620fea6-59aa-469e-b3c4-5bbf16bc76e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:26:31.070913 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d620fea6-59aa-469e-b3c4-5bbf16bc76e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:26:31.071554 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d620fea6-59aa-469e-b3c4-5bbf16bc76e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:26:31.072578 dv-cinder-784815-15-smb devstack@keystone.service[81554]: WARNING py.warnings [None req-d620fea6-59aa-469e-b3c4-5bbf16bc76e8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 12 01:26:31.072578 dv-cinder-784815-15-smb devstack@keystone.service[81554]: warnings.warn(msg) Aug 12 01:26:31.072578 dv-cinder-784815-15-smb devstack@keystone.service[81554]: Aug 12 01:26:31.073459 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d620fea6-59aa-469e-b3c4-5bbf16bc76e8 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:26:31.085933 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 745/1499] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:26:31.091259 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740bd886-01c1-4f3d-b592-37853e456081 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:26:31.092779 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-740bd886-01c1-4f3d-b592-37853e456081 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:26:31.104919 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740bd886-01c1-4f3d-b592-37853e456081 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:26:31.132709 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:26:31.223999 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dda7744-8949-48ab-87f8-e6433e92a210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:26:31.224618 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda7744-8949-48ab-87f8-e6433e92a210 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:26:31.224895 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda7744-8949-48ab-87f8-e6433e92a210 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:26:31.225166 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda7744-8949-48ab-87f8-e6433e92a210 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:26:31.225817 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dda7744-8949-48ab-87f8-e6433e92a210 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:26:31.226887 dv-cinder-784815-15-smb devstack@keystone.service[81555]: WARNING py.warnings [None req-4dda7744-8949-48ab-87f8-e6433e92a210 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 12 01:26:31.226887 dv-cinder-784815-15-smb devstack@keystone.service[81555]: warnings.warn(msg) Aug 12 01:26:31.226887 dv-cinder-784815-15-smb devstack@keystone.service[81555]: Aug 12 01:26:31.227778 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dda7744-8949-48ab-87f8-e6433e92a210 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:26:31.240866 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 755/1500] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:26:31.245890 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d620fea6-59aa-469e-b3c4-5bbf16bc76e8 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:26:31.247485 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d620fea6-59aa-469e-b3c4-5bbf16bc76e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:26:31.286939 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d620fea6-59aa-469e-b3c4-5bbf16bc76e8 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:26:31.396058 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9ce12c-8293-413c-8e10-8d78f87a008b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:26:31.396618 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ce12c-8293-413c-8e10-8d78f87a008b admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:26:31.396889 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ce12c-8293-413c-8e10-8d78f87a008b admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:26:31.397153 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ce12c-8293-413c-8e10-8d78f87a008b admin admin] PATH_INFO: `/v3/projects/d0eb8f67202844bd95b4ccd7e6244fa4/users/a05fff410c36421fb029085f0cbf40e7/roles/13af81971c1c428eae0a571a22ea583d` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:26:31.420342 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9ce12c-8293-413c-8e10-8d78f87a008b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0eb8f67202844bd95b4ccd7e6244fa4, user_id=a05fff410c36421fb029085f0cbf40e7, role_id=13af81971c1c428eae0a571a22ea583d)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:26:31.421378 dv-cinder-784815-15-smb devstack@keystone.service[81554]: WARNING py.warnings [None req-eb9ce12c-8293-413c-8e10-8d78f87a008b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 12 01:26:31.421378 dv-cinder-784815-15-smb devstack@keystone.service[81554]: warnings.warn(msg) Aug 12 01:26:31.421378 dv-cinder-784815-15-smb devstack@keystone.service[81554]: Aug 12 01:26:31.423429 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9ce12c-8293-413c-8e10-8d78f87a008b admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:26:31.451017 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 746/1501] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:26:31 2022] PUT /identity/v3/projects/d0eb8f67202844bd95b4ccd7e6244fa4/users/a05fff410c36421fb029085f0cbf40e7/roles/13af81971c1c428eae0a571a22ea583d => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:26:31.463270 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e12ba1-2560-4bb4-80a7-16ef8e88e028 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:26:31.463577 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e12ba1-2560-4bb4-80a7-16ef8e88e028 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:26:31.463823 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e12ba1-2560-4bb4-80a7-16ef8e88e028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:26:31.523356 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-a4e12ba1-2560-4bb4-80a7-16ef8e88e028 None None] MFA Rules not processed for user `a05fff410c36421fb029085f0cbf40e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:26:31.524554 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-a4e12ba1-2560-4bb4-80a7-16ef8e88e028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:26:31.608691 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 756/1502] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:26:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:26:31.622581 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d83f1aa-aeb8-4db4-994b-836adbd45241 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:26:31.622860 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d83f1aa-aeb8-4db4-994b-836adbd45241 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:26:31.623128 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d83f1aa-aeb8-4db4-994b-836adbd45241 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:26:31.624462 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 747/1503] 10.222.0.26 () {54 vars in 964 bytes} [Fri Aug 12 01:26:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:26:31.630093 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce8563-f2b2-431a-8c47-09aac96350f4 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:26:31.630460 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce8563-f2b2-431a-8c47-09aac96350f4 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:26:31.630829 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce8563-f2b2-431a-8c47-09aac96350f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:26:31.666474 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:26:31.719603 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-16ce8563-f2b2-431a-8c47-09aac96350f4 None None] MFA Rules not processed for user `7853d40c29af424c8d7913950d89750b`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:26:31.727411 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-16ce8563-f2b2-431a-8c47-09aac96350f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:26:31.817524 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 757/1504] 10.222.0.26 () {58 vars in 1061 bytes} [Fri Aug 12 01:26:31 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:26:31.825477 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d83f1aa-aeb8-4db4-994b-836adbd45241 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:26:31.827051 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-0d83f1aa-aeb8-4db4-994b-836adbd45241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:26:31.881449 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:26:31.946754 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d83f1aa-aeb8-4db4-994b-836adbd45241 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:26:32.030039 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf00418-055e-476b-a3fc-4bb9c57b5b74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7853d40c29af424c8d7913950d89750b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:26:32.030695 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf00418-055e-476b-a3fc-4bb9c57b5b74 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:26:32.030973 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf00418-055e-476b-a3fc-4bb9c57b5b74 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:26:32.031238 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf00418-055e-476b-a3fc-4bb9c57b5b74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:26:32.032886 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-4bf00418-055e-476b-a3fc-4bb9c57b5b74 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:26:32.145490 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf00418-055e-476b-a3fc-4bb9c57b5b74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:26:32.146954 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf00418-055e-476b-a3fc-4bb9c57b5b74 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:26:32.150486 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:26:32.166210 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 748/1505] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:26:31 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:26:32.216091 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050cb4f2-0826-43ca-8400-1c9003546929 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:26:32.216577 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050cb4f2-0826-43ca-8400-1c9003546929 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:26:32.216748 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050cb4f2-0826-43ca-8400-1c9003546929 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:26:32.218073 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 758/1506] 10.222.0.26 () {52 vars in 830 bytes} [Fri Aug 12 01:26:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:26:32.223498 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf00418-055e-476b-a3fc-4bb9c57b5b74 service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:26:32.224737 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-4bf00418-055e-476b-a3fc-4bb9c57b5b74 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:26:32.330075 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf00418-055e-476b-a3fc-4bb9c57b5b74 service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:26:32.431891 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f945ca3f-1b77-47a5-b016-25dbfb68b716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:26:32.432721 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945ca3f-1b77-47a5-b016-25dbfb68b716 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:26:32.432994 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945ca3f-1b77-47a5-b016-25dbfb68b716 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:26:32.433745 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945ca3f-1b77-47a5-b016-25dbfb68b716 admin admin] PATH_INFO: `/v3/users/a05fff410c36421fb029085f0cbf40e7` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:26:32.447675 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f945ca3f-1b77-47a5-b016-25dbfb68b716 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a05fff410c36421fb029085f0cbf40e7)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:26:32.448797 dv-cinder-784815-15-smb devstack@keystone.service[81554]: WARNING py.warnings [None req-f945ca3f-1b77-47a5-b016-25dbfb68b716 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 12 01:26:32.448797 dv-cinder-784815-15-smb devstack@keystone.service[81554]: warnings.warn(msg) Aug 12 01:26:32.448797 dv-cinder-784815-15-smb devstack@keystone.service[81554]: Aug 12 01:26:32.449957 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f945ca3f-1b77-47a5-b016-25dbfb68b716 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:26:32.461212 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:26:32.521352 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f945ca3f-1b77-47a5-b016-25dbfb68b716 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a05fff410c36421fb029085f0cbf40e7'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:26:32.532556 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f945ca3f-1b77-47a5-b016-25dbfb68b716 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a05fff410c36421fb029085f0cbf40e7'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:26:32.532988 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f945ca3f-1b77-47a5-b016-25dbfb68b716 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a05fff410c36421fb029085f0cbf40e7'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:26:32.546494 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f945ca3f-1b77-47a5-b016-25dbfb68b716 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a05fff410c36421fb029085f0cbf40e7'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:26:32.569169 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f945ca3f-1b77-47a5-b016-25dbfb68b716 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a05fff410c36421fb029085f0cbf40e7'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:26:32.575212 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 749/1507] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:26:32 2022] DELETE /identity/v3/users/a05fff410c36421fb029085f0cbf40e7 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:26:32.580369 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a09083-085c-4afe-8654-4a3fed5a0f90 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:26:32.580755 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a09083-085c-4afe-8654-4a3fed5a0f90 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:26:32.581115 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a09083-085c-4afe-8654-4a3fed5a0f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:26:32.643057 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-54a09083-085c-4afe-8654-4a3fed5a0f90 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:26:32.644256 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-54a09083-085c-4afe-8654-4a3fed5a0f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:26:32.722526 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:26:32.735733 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 759/1508] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:26:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:26:32.746219 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f945ca3f-1b77-47a5-b016-25dbfb68b716 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:26:32.747494 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f945ca3f-1b77-47a5-b016-25dbfb68b716 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:26:32.866727 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f945ca3f-1b77-47a5-b016-25dbfb68b716 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:26:32.925954 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:26:32.946541 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893ad2fd-d0e9-494e-9ad0-cbb0c97f3afe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:26:32.947147 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ad2fd-d0e9-494e-9ad0-cbb0c97f3afe service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:26:32.947410 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ad2fd-d0e9-494e-9ad0-cbb0c97f3afe service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:26:32.947673 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ad2fd-d0e9-494e-9ad0-cbb0c97f3afe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:26:32.949680 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-893ad2fd-d0e9-494e-9ad0-cbb0c97f3afe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:26:33.058168 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893ad2fd-d0e9-494e-9ad0-cbb0c97f3afe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:26:33.059632 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893ad2fd-d0e9-494e-9ad0-cbb0c97f3afe service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:26:33.078533 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 750/1509] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:26:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:26:33.462771 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a09083-085c-4afe-8654-4a3fed5a0f90 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:26:33.464071 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-54a09083-085c-4afe-8654-4a3fed5a0f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:26:33.475807 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a09083-085c-4afe-8654-4a3fed5a0f90 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:26:33.581194 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288dffc5-a7d1-4040-8916-913743dff6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:26:33.581718 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288dffc5-a7d1-4040-8916-913743dff6b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:26:33.581990 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288dffc5-a7d1-4040-8916-913743dff6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:26:33.582289 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288dffc5-a7d1-4040-8916-913743dff6b6 admin admin] PATH_INFO: `/v3/projects/d0eb8f67202844bd95b4ccd7e6244fa4` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:26:33.592156 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288dffc5-a7d1-4040-8916-913743dff6b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0eb8f67202844bd95b4ccd7e6244fa4)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:26:33.593189 dv-cinder-784815-15-smb devstack@keystone.service[81555]: WARNING py.warnings [None req-288dffc5-a7d1-4040-8916-913743dff6b6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 12 01:26:33.593189 dv-cinder-784815-15-smb devstack@keystone.service[81555]: warnings.warn(msg) Aug 12 01:26:33.593189 dv-cinder-784815-15-smb devstack@keystone.service[81555]: Aug 12 01:26:33.594410 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288dffc5-a7d1-4040-8916-913743dff6b6 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:26:33.658221 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-288dffc5-a7d1-4040-8916-913743dff6b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0eb8f67202844bd95b4ccd7e6244fa4', 'request_id': 'req-288dffc5-a7d1-4040-8916-913743dff6b6'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:26:33.664802 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-288dffc5-a7d1-4040-8916-913743dff6b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0eb8f67202844bd95b4ccd7e6244fa4', 'request_id': 'req-288dffc5-a7d1-4040-8916-913743dff6b6'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:26:33.678261 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-288dffc5-a7d1-4040-8916-913743dff6b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0eb8f67202844bd95b4ccd7e6244fa4', 'request_id': 'req-288dffc5-a7d1-4040-8916-913743dff6b6'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:26:33.706500 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-288dffc5-a7d1-4040-8916-913743dff6b6 admin admin] The token cache is being invalidate because project d0eb8f67202844bd95b4ccd7e6244fa4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:26:33.706788 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-288dffc5-a7d1-4040-8916-913743dff6b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:26:33.707304 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-288dffc5-a7d1-4040-8916-913743dff6b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:26:33.708665 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 760/1510] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:26:33 2022] DELETE /identity/v3/projects/d0eb8f67202844bd95b4ccd7e6244fa4 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:26:43.076152 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=62 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:26:43.704308 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:28:01.989027 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687c761-886f-4624-8682-f33755706695 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:28:01.989920 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687c761-886f-4624-8682-f33755706695 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:28:01.989920 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687c761-886f-4624-8682-f33755706695 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:28:01.992047 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 751/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 12 01:28:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:28:01.998998 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c769e48c-a5e6-421c-9570-f37041af1413 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:28:01.999462 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c769e48c-a5e6-421c-9570-f37041af1413 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:28:01.999570 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c769e48c-a5e6-421c-9570-f37041af1413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:28:02.093534 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-c769e48c-a5e6-421c-9570-f37041af1413 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:28:02.094962 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-c769e48c-a5e6-421c-9570-f37041af1413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:28:02.203435 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 761/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 12 01:28:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:28:02.360323 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9687c761-886f-4624-8682-f33755706695 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:28:02.364191 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-9687c761-886f-4624-8682-f33755706695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:28:02.512333 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9687c761-886f-4624-8682-f33755706695 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:28:02.518698 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f7951b-3b5f-4665-b32d-e679cddd4d15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd5e95467b44175be2478c2c7c89926', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:28:02.519312 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7951b-3b5f-4665-b32d-e679cddd4d15 service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:28:02.519581 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7951b-3b5f-4665-b32d-e679cddd4d15 service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:28:02.519846 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7951b-3b5f-4665-b32d-e679cddd4d15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:28:02.528001 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f7951b-3b5f-4665-b32d-e679cddd4d15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:28:02.529585 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f7951b-3b5f-4665-b32d-e679cddd4d15 service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:28:02.545709 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 752/1513] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:28:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:28:03.364106 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a132ff88-fcc4-4450-acde-bbd055e2649c None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:28:03.364705 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a132ff88-fcc4-4450-acde-bbd055e2649c None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:28:03.364705 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a132ff88-fcc4-4450-acde-bbd055e2649c None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:28:03.366048 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 762/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 12 01:28:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:28:03.372896 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e4def-de7f-4741-8664-32a4ec7f44e1 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:28:03.373312 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e4def-de7f-4741-8664-32a4ec7f44e1 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:28:03.373418 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e4def-de7f-4741-8664-32a4ec7f44e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:28:03.394851 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-141e4def-de7f-4741-8664-32a4ec7f44e1 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:28:03.396065 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-141e4def-de7f-4741-8664-32a4ec7f44e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:28:03.404936 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 753/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 12 01:28:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:28:03.560731 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a132ff88-fcc4-4450-acde-bbd055e2649c None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:28:03.586663 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a132ff88-fcc4-4450-acde-bbd055e2649c None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:28:03.595020 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f57ef06-dbae-49d4-a3bb-409f86d780d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd5e95467b44175be2478c2c7c89926', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:28:03.595616 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f57ef06-dbae-49d4-a3bb-409f86d780d3 service nova] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:28:03.595888 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f57ef06-dbae-49d4-a3bb-409f86d780d3 service nova] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:28:03.596134 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f57ef06-dbae-49d4-a3bb-409f86d780d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:28:03.605142 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f57ef06-dbae-49d4-a3bb-409f86d780d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:28:03.606841 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f57ef06-dbae-49d4-a3bb-409f86d780d3 service nova] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:28:03.617134 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 763/1516] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:28:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:28:03.740095 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69878f16-5320-481e-a8b2-577f6b9c9e8c None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:28:03.740376 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69878f16-5320-481e-a8b2-577f6b9c9e8c None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:28:03.740675 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69878f16-5320-481e-a8b2-577f6b9c9e8c None None] PATH_INFO: `/v3` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:28:03.742001 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 754/1517] 10.222.0.17 () {54 vars in 925 bytes} [Fri Aug 12 01:28:03 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:28:03.749144 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4e59c-52f8-4fa8-afd3-a49a5d820dcd None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:28:03.749425 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4e59c-52f8-4fa8-afd3-a49a5d820dcd None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:28:03.749677 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4e59c-52f8-4fa8-afd3-a49a5d820dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:28:03.813589 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-9ed4e59c-52f8-4fa8-afd3-a49a5d820dcd None None] MFA Rules not processed for user `06dccf61c686414d904bdf1ecf19d53d`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:28:03.814822 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-9ed4e59c-52f8-4fa8-afd3-a49a5d820dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:28:03.833433 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:28:03.891588 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 764/1518] 10.222.0.17 () {58 vars in 1015 bytes} [Fri Aug 12 01:28:03 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:28:12.660734 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61966732-0c14-43cd-b68f-131dfd302a97 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:28:12.661641 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61966732-0c14-43cd-b68f-131dfd302a97 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:28:12.661641 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61966732-0c14-43cd-b68f-131dfd302a97 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:28:12.663843 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 755/1519] 10.222.0.26 () {54 vars in 961 bytes} [Fri Aug 12 01:28:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:28:12.670539 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa62f7-0cbb-417a-bcbb-b6f5034095b4 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:28:12.671029 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa62f7-0cbb-417a-bcbb-b6f5034095b4 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:28:12.671137 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa62f7-0cbb-417a-bcbb-b6f5034095b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:28:12.690739 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-2faa62f7-0cbb-417a-bcbb-b6f5034095b4 None None] MFA Rules not processed for user `06dccf61c686414d904bdf1ecf19d53d`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:28:12.691904 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-2faa62f7-0cbb-417a-bcbb-b6f5034095b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:28:12.700992 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 765/1520] 10.222.0.26 () {58 vars in 1058 bytes} [Fri Aug 12 01:28:12 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:28:12.708563 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61966732-0c14-43cd-b68f-131dfd302a97 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:28:12.723074 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61966732-0c14-43cd-b68f-131dfd302a97 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:28:12.728212 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee3c5e7-1600-482e-8e03-b84681a541a4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06dccf61c686414d904bdf1ecf19d53d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:28:12.728804 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3c5e7-1600-482e-8e03-b84681a541a4 service placement] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:28:12.729080 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3c5e7-1600-482e-8e03-b84681a541a4 service placement] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:28:12.729348 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3c5e7-1600-482e-8e03-b84681a541a4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:28:12.737931 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee3c5e7-1600-482e-8e03-b84681a541a4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:28:12.739573 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee3c5e7-1600-482e-8e03-b84681a541a4 service placement] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:28:12.749798 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 756/1521] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:28:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:28:14.861279 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1407277-12f3-47a4-b5f6-5c73e09113a5 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:28:14.861812 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1407277-12f3-47a4-b5f6-5c73e09113a5 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:28:14.861812 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1407277-12f3-47a4-b5f6-5c73e09113a5 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:28:14.864003 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 766/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 12 01:28:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:28:14.871087 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15534213-5f36-41a7-9c4e-d02056a9164a None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:28:14.871493 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15534213-5f36-41a7-9c4e-d02056a9164a None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:28:14.871631 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15534213-5f36-41a7-9c4e-d02056a9164a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:28:14.893080 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-15534213-5f36-41a7-9c4e-d02056a9164a None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:28:14.894330 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-15534213-5f36-41a7-9c4e-d02056a9164a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:28:14.904169 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 757/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 12 01:28:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:28:15.080319 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1407277-12f3-47a4-b5f6-5c73e09113a5 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:28:15.098062 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1407277-12f3-47a4-b5f6-5c73e09113a5 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:28:15.104407 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b6b440-2560-425c-8ae2-b5263e37fa97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd5e95467b44175be2478c2c7c89926', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:28:15.105022 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b6b440-2560-425c-8ae2-b5263e37fa97 service nova] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:28:15.105268 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b6b440-2560-425c-8ae2-b5263e37fa97 service nova] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:28:15.105541 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b6b440-2560-425c-8ae2-b5263e37fa97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:28:15.114193 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b6b440-2560-425c-8ae2-b5263e37fa97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:28:15.115997 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b6b440-2560-425c-8ae2-b5263e37fa97 service nova] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:28:15.125329 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 767/1524] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:28:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:28:15.960672 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b879f9-5be2-4f15-a153-49e926bf3c0f None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:28:15.961527 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b879f9-5be2-4f15-a153-49e926bf3c0f None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:28:15.961527 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b879f9-5be2-4f15-a153-49e926bf3c0f None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:28:15.963509 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 758/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 12 01:28:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:28:15.969784 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6835f2f-c75a-4cf8-9647-0eaf6d8fa781 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:28:15.970263 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6835f2f-c75a-4cf8-9647-0eaf6d8fa781 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:28:15.970374 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6835f2f-c75a-4cf8-9647-0eaf6d8fa781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:28:15.994967 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-c6835f2f-c75a-4cf8-9647-0eaf6d8fa781 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:28:15.996159 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-c6835f2f-c75a-4cf8-9647-0eaf6d8fa781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:28:16.005115 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 768/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 12 01:28:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:28:16.160749 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b879f9-5be2-4f15-a153-49e926bf3c0f None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:28:16.184868 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b879f9-5be2-4f15-a153-49e926bf3c0f None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:28:16.191451 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff336654-d699-4d24-bf9f-df6c5e189a0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd5e95467b44175be2478c2c7c89926', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:28:16.192053 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff336654-d699-4d24-bf9f-df6c5e189a0a service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:28:16.192326 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff336654-d699-4d24-bf9f-df6c5e189a0a service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:28:16.192594 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff336654-d699-4d24-bf9f-df6c5e189a0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:28:16.202555 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff336654-d699-4d24-bf9f-df6c5e189a0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:28:16.205012 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff336654-d699-4d24-bf9f-df6c5e189a0a service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:28:16.217489 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 759/1527] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:28:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:28:20.060212 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2bd52c-bed0-40f0-8548-7020a9e2a4b5 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:28:20.061067 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2bd52c-bed0-40f0-8548-7020a9e2a4b5 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:28:20.061067 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2bd52c-bed0-40f0-8548-7020a9e2a4b5 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:28:20.063242 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 769/1528] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 12 01:28:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:28:20.071858 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4145f6-5e93-4277-96a5-c8ca77bd1c32 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:28:20.072613 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4145f6-5e93-4277-96a5-c8ca77bd1c32 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:28:20.072770 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4145f6-5e93-4277-96a5-c8ca77bd1c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:28:20.099430 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-ac4145f6-5e93-4277-96a5-c8ca77bd1c32 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:28:20.100638 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-ac4145f6-5e93-4277-96a5-c8ca77bd1c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:28:20.110100 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 760/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 12 01:28:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:28:20.399513 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2bd52c-bed0-40f0-8548-7020a9e2a4b5 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:28:20.401876 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-df2bd52c-bed0-40f0-8548-7020a9e2a4b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:28:20.481565 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2bd52c-bed0-40f0-8548-7020a9e2a4b5 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:28:20.485408 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e89f6c4-6d22-4228-b3a8-22ae6a367267 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:28:20.486015 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e89f6c4-6d22-4228-b3a8-22ae6a367267 service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:28:20.486307 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e89f6c4-6d22-4228-b3a8-22ae6a367267 service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:28:20.486572 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e89f6c4-6d22-4228-b3a8-22ae6a367267 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:28:20.496351 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e89f6c4-6d22-4228-b3a8-22ae6a367267 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:28:20.497777 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e89f6c4-6d22-4228-b3a8-22ae6a367267 service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:28:20.507162 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 770/1530] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:28:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:28:22.355609 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2e7ca-6dc0-4bb8-94ee-75033b5affd6 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:28:22.356586 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2e7ca-6dc0-4bb8-94ee-75033b5affd6 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:28:22.356720 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2e7ca-6dc0-4bb8-94ee-75033b5affd6 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:28:22.358613 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 761/1531] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 12 01:28:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:28:22.364389 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca4ad62-9afc-4197-ac8f-05350a4dcacc None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:28:22.365010 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca4ad62-9afc-4197-ac8f-05350a4dcacc None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:28:22.365144 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca4ad62-9afc-4197-ac8f-05350a4dcacc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:28:22.387263 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-6ca4ad62-9afc-4197-ac8f-05350a4dcacc None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:28:22.388417 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-6ca4ad62-9afc-4197-ac8f-05350a4dcacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:28:22.396428 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 771/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 12 01:28:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:28:22.683144 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e2e7ca-6dc0-4bb8-94ee-75033b5affd6 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:28:22.685165 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-a9e2e7ca-6dc0-4bb8-94ee-75033b5affd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:28:22.699750 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e2e7ca-6dc0-4bb8-94ee-75033b5affd6 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:28:22.703504 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28223b7d-c6ab-45be-9e34-f99aff07e974 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:28:22.704101 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28223b7d-c6ab-45be-9e34-f99aff07e974 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:28:22.704372 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28223b7d-c6ab-45be-9e34-f99aff07e974 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:28:22.704637 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28223b7d-c6ab-45be-9e34-f99aff07e974 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:28:22.714123 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28223b7d-c6ab-45be-9e34-f99aff07e974 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:28:22.715646 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28223b7d-c6ab-45be-9e34-f99aff07e974 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:28:22.726031 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 762/1533] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:28:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:28:26.127784 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d62f54-3123-4feb-9146-fe450cdc30bc None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:28:26.128540 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d62f54-3123-4feb-9146-fe450cdc30bc None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:28:26.128540 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d62f54-3123-4feb-9146-fe450cdc30bc None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:28:26.130447 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 772/1534] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 12 01:28:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:28:26.136066 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a95aece-d1b9-4db6-971b-b47de3ca9576 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:28:26.136533 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a95aece-d1b9-4db6-971b-b47de3ca9576 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:28:26.136631 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a95aece-d1b9-4db6-971b-b47de3ca9576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:28:26.144758 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=81 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:28:26.161189 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-4a95aece-d1b9-4db6-971b-b47de3ca9576 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:28:26.163231 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-4a95aece-d1b9-4db6-971b-b47de3ca9576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:28:26.172898 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 763/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 12 01:28:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:28:26.771038 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d62f54-3123-4feb-9146-fe450cdc30bc None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:28:26.772851 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-11d62f54-3123-4feb-9146-fe450cdc30bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:28:26.853105 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:28:26.869238 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d62f54-3123-4feb-9146-fe450cdc30bc None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:28:26.873324 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe5e7ee-d8f3-4c37-8224-aa2ec69365d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7853d40c29af424c8d7913950d89750b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:28:26.873930 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe5e7ee-d8f3-4c37-8224-aa2ec69365d2 service cinder] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:28:26.874233 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe5e7ee-d8f3-4c37-8224-aa2ec69365d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:28:26.874502 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe5e7ee-d8f3-4c37-8224-aa2ec69365d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:28:26.884655 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe5e7ee-d8f3-4c37-8224-aa2ec69365d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:28:26.886075 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe5e7ee-d8f3-4c37-8224-aa2ec69365d2 service cinder] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:28:26.895901 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 773/1536] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:28:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:28:28.827604 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fbf3d1-15d7-4e15-80fa-4202480965fc None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:28:28.828180 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fbf3d1-15d7-4e15-80fa-4202480965fc None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:28:28.828180 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fbf3d1-15d7-4e15-80fa-4202480965fc None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:28:28.830033 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 764/1537] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 12 01:28:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:28:28.836138 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb806578-0e97-4bc9-90f1-34fc86b38833 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:28:28.836571 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb806578-0e97-4bc9-90f1-34fc86b38833 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:28:28.836689 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb806578-0e97-4bc9-90f1-34fc86b38833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:28:28.858616 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-cb806578-0e97-4bc9-90f1-34fc86b38833 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:28:28.859808 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-cb806578-0e97-4bc9-90f1-34fc86b38833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:28:28.869621 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 774/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 12 01:28:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:28:29.417024 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fbf3d1-15d7-4e15-80fa-4202480965fc None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:28:29.419148 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-59fbf3d1-15d7-4e15-80fa-4202480965fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:28:29.435065 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fbf3d1-15d7-4e15-80fa-4202480965fc None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:28:29.441037 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf03bd6-3d48-4582-8d26-934abc4c98cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7853d40c29af424c8d7913950d89750b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:28:29.442140 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf03bd6-3d48-4582-8d26-934abc4c98cd service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:28:29.442531 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf03bd6-3d48-4582-8d26-934abc4c98cd service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:28:29.442808 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf03bd6-3d48-4582-8d26-934abc4c98cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:28:29.452625 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf03bd6-3d48-4582-8d26-934abc4c98cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:28:29.454253 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf03bd6-3d48-4582-8d26-934abc4c98cd service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:28:29.464786 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 765/1539] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:28:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:28:38.853092 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=11 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:28:39.460236 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=8 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:29:53.348276 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e30d0b9-7ceb-4af9-be85-7aabee34f29b None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:53.349419 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e30d0b9-7ceb-4af9-be85-7aabee34f29b None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:53.349921 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e30d0b9-7ceb-4af9-be85-7aabee34f29b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:53.383282 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-6e30d0b9-7ceb-4af9-be85-7aabee34f29b None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:29:53.385086 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-6e30d0b9-7ceb-4af9-be85-7aabee34f29b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:29:53.400189 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 775/1540] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:29:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:29:53.410105 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b62ad-c3e9-47b2-8178-4bac33714081 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:53.410741 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b62ad-c3e9-47b2-8178-4bac33714081 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:53.410741 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b62ad-c3e9-47b2-8178-4bac33714081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:53.447812 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-1e4b62ad-c3e9-47b2-8178-4bac33714081 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:29:53.455549 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-1e4b62ad-c3e9-47b2-8178-4bac33714081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:29:53.472399 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 766/1541] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:29:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:29:53.480889 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e30d0b9-7ceb-4af9-be85-7aabee34f29b None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:29:53.504287 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e30d0b9-7ceb-4af9-be85-7aabee34f29b None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:29:53.512678 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbc384f-b3ef-499b-aa8b-43a138174579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:29:53.514225 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc384f-b3ef-499b-aa8b-43a138174579 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:53.514729 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc384f-b3ef-499b-aa8b-43a138174579 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:53.515261 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc384f-b3ef-499b-aa8b-43a138174579 admin admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:53.516267 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbc384f-b3ef-499b-aa8b-43a138174579 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:29:53.516800 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbc384f-b3ef-499b-aa8b-43a138174579 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:29:53.518834 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbc384f-b3ef-499b-aa8b-43a138174579 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:29:53.534199 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 776/1542] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 01:29:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:29:53.542603 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4b62ad-c3e9-47b2-8178-4bac33714081 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:29:53.553060 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4b62ad-c3e9-47b2-8178-4bac33714081 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:29:53.569001 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79928afd-c5fd-4305-a1dd-56f974f7d5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:29:53.569649 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79928afd-c5fd-4305-a1dd-56f974f7d5a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:53.569929 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79928afd-c5fd-4305-a1dd-56f974f7d5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:53.570222 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79928afd-c5fd-4305-a1dd-56f974f7d5a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:53.570880 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79928afd-c5fd-4305-a1dd-56f974f7d5a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:29:53.572836 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79928afd-c5fd-4305-a1dd-56f974f7d5a4 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:29:53.592243 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13177746-df6b-4369-a810-5465cc2cc8be None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:53.592951 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13177746-df6b-4369-a810-5465cc2cc8be None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:53.593441 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13177746-df6b-4369-a810-5465cc2cc8be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:53.631259 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-13177746-df6b-4369-a810-5465cc2cc8be None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:29:53.633084 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-13177746-df6b-4369-a810-5465cc2cc8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:29:53.641286 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 767/1543] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:29:53 2022] POST /identity/v3/projects => generated 387 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:29:53.642734 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe1fa50-0ca2-41e5-bded-a589268f9aa6 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:53.643015 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe1fa50-0ca2-41e5-bded-a589268f9aa6 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:53.643292 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe1fa50-0ca2-41e5-bded-a589268f9aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:53.684205 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-dbe1fa50-0ca2-41e5-bded-a589268f9aa6 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:29:53.685630 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-dbe1fa50-0ca2-41e5-bded-a589268f9aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:29:53.759255 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 777/1544] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:29:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:29:53.760548 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13177746-df6b-4369-a810-5465cc2cc8be None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:29:53.775733 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 768/1545] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:29:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:29:53.777018 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c61d94-b1df-4926-99ec-8920af75dbf5 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:53.777373 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c61d94-b1df-4926-99ec-8920af75dbf5 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:53.777560 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c61d94-b1df-4926-99ec-8920af75dbf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:53.780669 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13177746-df6b-4369-a810-5465cc2cc8be None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:29:53.788323 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca839c3b-9b9e-4766-a86d-9d34b0cd6537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:29:53.788950 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca839c3b-9b9e-4766-a86d-9d34b0cd6537 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:53.789337 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca839c3b-9b9e-4766-a86d-9d34b0cd6537 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:53.789605 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca839c3b-9b9e-4766-a86d-9d34b0cd6537 admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:53.790254 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca839c3b-9b9e-4766-a86d-9d34b0cd6537 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:29:53.792471 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca839c3b-9b9e-4766-a86d-9d34b0cd6537 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:29:53.805884 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-d4c61d94-b1df-4926-99ec-8920af75dbf5 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:29:53.807814 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d4c61d94-b1df-4926-99ec-8920af75dbf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:29:53.818324 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 769/1546] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:29:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:29:53.819996 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da7983-decf-4d32-b061-522c160986be None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:53.820283 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da7983-decf-4d32-b061-522c160986be None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:53.820556 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da7983-decf-4d32-b061-522c160986be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:53.822763 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 778/1547] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:29:53 2022] POST /identity/v3/users => generated 294 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:29:53.824773 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2485de8c-1fa9-4afb-9145-cf6f68d68911 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:53.826226 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2485de8c-1fa9-4afb-9145-cf6f68d68911 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:53.826731 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2485de8c-1fa9-4afb-9145-cf6f68d68911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:53.852159 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-2485de8c-1fa9-4afb-9145-cf6f68d68911 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:29:53.853403 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-2485de8c-1fa9-4afb-9145-cf6f68d68911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:29:53.855300 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-73da7983-decf-4d32-b061-522c160986be None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:29:53.856819 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-73da7983-decf-4d32-b061-522c160986be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:29:53.861600 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 779/1548] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:29:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:29:53.862670 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af206b-8c90-4e23-a319-a57992b2f305 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:53.862993 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af206b-8c90-4e23-a319-a57992b2f305 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:53.863266 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af206b-8c90-4e23-a319-a57992b2f305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:53.865415 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 770/1549] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:29:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:29:53.866844 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0481a6-c5c0-4ba9-9275-7604c9f01b24 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:53.867125 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0481a6-c5c0-4ba9-9275-7604c9f01b24 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:53.867394 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0481a6-c5c0-4ba9-9275-7604c9f01b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:53.883650 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-87af206b-8c90-4e23-a319-a57992b2f305 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:29:53.884770 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-87af206b-8c90-4e23-a319-a57992b2f305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:29:53.887153 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-db0481a6-c5c0-4ba9-9275-7604c9f01b24 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:29:53.888323 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-db0481a6-c5c0-4ba9-9275-7604c9f01b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:29:53.892830 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 780/1550] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:29:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:29:53.893426 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87af206b-8c90-4e23-a319-a57992b2f305 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:29:53.896449 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 771/1551] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:29:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:29:53.896449 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd321554-eb87-4131-b578-854852d47682 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:53.896449 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd321554-eb87-4131-b578-854852d47682 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:53.896449 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd321554-eb87-4131-b578-854852d47682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:53.910238 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87af206b-8c90-4e23-a319-a57992b2f305 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:29:53.914800 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e0c24b-8a3c-438d-a89b-b3c252d2e5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:29:53.915445 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0c24b-8a3c-438d-a89b-b3c252d2e5bb admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:53.915746 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0c24b-8a3c-438d-a89b-b3c252d2e5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:53.916015 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0c24b-8a3c-438d-a89b-b3c252d2e5bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:53.916723 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e0c24b-8a3c-438d-a89b-b3c252d2e5bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:29:53.917902 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-bd321554-eb87-4131-b578-854852d47682 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:29:53.918568 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e0c24b-8a3c-438d-a89b-b3c252d2e5bb admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:29:53.919274 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-bd321554-eb87-4131-b578-854852d47682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:29:53.927250 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 772/1552] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:29:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:29:53.928683 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 781/1553] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:29:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:29:53.929873 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db30e8-8b5d-4d72-a1c7-2a1a69c710b2 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:53.930179 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db30e8-8b5d-4d72-a1c7-2a1a69c710b2 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:53.930453 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db30e8-8b5d-4d72-a1c7-2a1a69c710b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:53.932561 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee6b6fb-a019-4a63-9055-1fd523e5a1ed None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:53.932845 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee6b6fb-a019-4a63-9055-1fd523e5a1ed None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:53.933114 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee6b6fb-a019-4a63-9055-1fd523e5a1ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:53.948965 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-14db30e8-8b5d-4d72-a1c7-2a1a69c710b2 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:29:53.950521 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-14db30e8-8b5d-4d72-a1c7-2a1a69c710b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:29:53.951739 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-2ee6b6fb-a019-4a63-9055-1fd523e5a1ed None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:29:53.952886 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2ee6b6fb-a019-4a63-9055-1fd523e5a1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:29:53.958570 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 782/1554] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:29:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:29:53.959417 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db30e8-8b5d-4d72-a1c7-2a1a69c710b2 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:29:53.964407 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 773/1555] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:29:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:29:53.967016 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38998471-0de9-4a73-902f-24505e7cc0d0 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:53.967303 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38998471-0de9-4a73-902f-24505e7cc0d0 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:53.967578 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38998471-0de9-4a73-902f-24505e7cc0d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:53.970141 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db30e8-8b5d-4d72-a1c7-2a1a69c710b2 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:29:53.975665 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f68a6-26c4-40a1-ab14-a5e447179e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:29:53.976483 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f68a6-26c4-40a1-ab14-a5e447179e7b admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:53.976875 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f68a6-26c4-40a1-ab14-a5e447179e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:53.977144 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f68a6-26c4-40a1-ab14-a5e447179e7b admin admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:53.977787 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1f68a6-26c4-40a1-ab14-a5e447179e7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:29:53.978082 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1f68a6-26c4-40a1-ab14-a5e447179e7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:29:53.979831 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1f68a6-26c4-40a1-ab14-a5e447179e7b admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:29:53.989044 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-38998471-0de9-4a73-902f-24505e7cc0d0 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:29:53.990299 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-38998471-0de9-4a73-902f-24505e7cc0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:29:53.991606 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 783/1556] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 01:29:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:29:53.992808 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e460b-52f6-4ec6-b209-c1ba7f779350 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:53.993085 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e460b-52f6-4ec6-b209-c1ba7f779350 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:53.993348 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e460b-52f6-4ec6-b209-c1ba7f779350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:54.004047 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 774/1557] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:29:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:29:54.004837 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38998471-0de9-4a73-902f-24505e7cc0d0 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:29:54.014708 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38998471-0de9-4a73-902f-24505e7cc0d0 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:29:54.015098 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-579e460b-52f6-4ec6-b209-c1ba7f779350 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:29:54.016437 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-579e460b-52f6-4ec6-b209-c1ba7f779350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:29:54.019210 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ac2061-7801-434e-9108-70f846dd0a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:29:54.019813 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac2061-7801-434e-9108-70f846dd0a14 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:54.020087 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac2061-7801-434e-9108-70f846dd0a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:54.020412 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac2061-7801-434e-9108-70f846dd0a14 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:54.020992 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ac2061-7801-434e-9108-70f846dd0a14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:29:54.021289 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ac2061-7801-434e-9108-70f846dd0a14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:29:54.022334 dv-cinder-784815-15-smb devstack@keystone.service[81554]: WARNING py.warnings [None req-49ac2061-7801-434e-9108-70f846dd0a14 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 12 01:29:54.022334 dv-cinder-784815-15-smb devstack@keystone.service[81554]: warnings.warn(msg) Aug 12 01:29:54.022334 dv-cinder-784815-15-smb devstack@keystone.service[81554]: Aug 12 01:29:54.023204 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ac2061-7801-434e-9108-70f846dd0a14 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:29:54.024675 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 784/1558] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:29:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:29:54.025446 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e460b-52f6-4ec6-b209-c1ba7f779350 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:29:54.034800 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e460b-52f6-4ec6-b209-c1ba7f779350 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:29:54.035679 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 775/1559] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 01:29:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:29:54.036540 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ac2061-7801-434e-9108-70f846dd0a14 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:29:54.039600 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0792362e-5ea0-464a-bc3f-252360625a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:29:54.040201 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0792362e-5ea0-464a-bc3f-252360625a8c admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:54.040476 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0792362e-5ea0-464a-bc3f-252360625a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:54.040765 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0792362e-5ea0-464a-bc3f-252360625a8c admin admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:54.041385 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0792362e-5ea0-464a-bc3f-252360625a8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:29:54.041682 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0792362e-5ea0-464a-bc3f-252360625a8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:29:54.043317 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0792362e-5ea0-464a-bc3f-252360625a8c admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:29:54.048295 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ac2061-7801-434e-9108-70f846dd0a14 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:29:54.053762 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7802244f-1195-4fb8-8d95-dde02f4b4b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:29:54.054436 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802244f-1195-4fb8-8d95-dde02f4b4b64 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:54.054709 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802244f-1195-4fb8-8d95-dde02f4b4b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:54.054972 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802244f-1195-4fb8-8d95-dde02f4b4b64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:54.055090 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 785/1560] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 01:29:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:29:54.055603 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7802244f-1195-4fb8-8d95-dde02f4b4b64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:29:54.057239 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7802244f-1195-4fb8-8d95-dde02f4b4b64 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:29:54.063888 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80209a4-ebef-4a2f-9623-b27eb915a055 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:54.064178 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80209a4-ebef-4a2f-9623-b27eb915a055 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:54.064579 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80209a4-ebef-4a2f-9623-b27eb915a055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:54.068510 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 776/1561] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:29:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:29:54.071540 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ea85d-266d-4535-bd39-2ad9f333e4ba None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:54.071826 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ea85d-266d-4535-bd39-2ad9f333e4ba None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:54.072279 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ea85d-266d-4535-bd39-2ad9f333e4ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:54.083919 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-f80209a4-ebef-4a2f-9623-b27eb915a055 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:29:54.085120 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-f80209a4-ebef-4a2f-9623-b27eb915a055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:29:54.092506 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-263ea85d-266d-4535-bd39-2ad9f333e4ba None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:29:54.093001 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 786/1562] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:29:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:29:54.093673 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-263ea85d-266d-4535-bd39-2ad9f333e4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:29:54.093793 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80209a4-ebef-4a2f-9623-b27eb915a055 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:29:54.102545 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 777/1563] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:29:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:29:54.102545 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263ea85d-266d-4535-bd39-2ad9f333e4ba None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:29:54.106476 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80209a4-ebef-4a2f-9623-b27eb915a055 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:29:54.109369 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467875e7-df75-4325-979f-bd4fcd9e00b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:29:54.109982 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467875e7-df75-4325-979f-bd4fcd9e00b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:54.110298 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467875e7-df75-4325-979f-bd4fcd9e00b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:54.110573 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467875e7-df75-4325-979f-bd4fcd9e00b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:54.111203 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467875e7-df75-4325-979f-bd4fcd9e00b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:29:54.112220 dv-cinder-784815-15-smb devstack@keystone.service[81555]: WARNING py.warnings [None req-467875e7-df75-4325-979f-bd4fcd9e00b0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 12 01:29:54.112220 dv-cinder-784815-15-smb devstack@keystone.service[81555]: warnings.warn(msg) Aug 12 01:29:54.112220 dv-cinder-784815-15-smb devstack@keystone.service[81555]: Aug 12 01:29:54.112846 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263ea85d-266d-4535-bd39-2ad9f333e4ba None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:29:54.113461 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467875e7-df75-4325-979f-bd4fcd9e00b0 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:29:54.117301 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ece1e8-62a7-4187-a9dd-09566630ca3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:29:54.117881 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ece1e8-62a7-4187-a9dd-09566630ca3e admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:54.118187 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ece1e8-62a7-4187-a9dd-09566630ca3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:54.118454 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ece1e8-62a7-4187-a9dd-09566630ca3e admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:54.119086 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ece1e8-62a7-4187-a9dd-09566630ca3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:29:54.119380 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ece1e8-62a7-4187-a9dd-09566630ca3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:29:54.120969 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ece1e8-62a7-4187-a9dd-09566630ca3e admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:29:54.132993 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 778/1564] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 01:29:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:29:54.133865 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ece1e8-62a7-4187-a9dd-09566630ca3e admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:29:54.143746 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ece1e8-62a7-4187-a9dd-09566630ca3e admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:29:54.145356 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 787/1565] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:29:54 2022] POST /identity/v3/projects => generated 363 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:29:54.146188 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467875e7-df75-4325-979f-bd4fcd9e00b0 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:29:54.177814 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:29:54.183433 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:29:54.204260 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1038cbd-f926-463b-ad9f-d17383a275b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:29:54.204880 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1038cbd-f926-463b-ad9f-d17383a275b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:54.205152 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1038cbd-f926-463b-ad9f-d17383a275b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:54.205422 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1038cbd-f926-463b-ad9f-d17383a275b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:54.206092 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1038cbd-f926-463b-ad9f-d17383a275b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:29:54.206522 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1038cbd-f926-463b-ad9f-d17383a275b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:29:54.208122 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1038cbd-f926-463b-ad9f-d17383a275b1 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:29:54.208569 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467875e7-df75-4325-979f-bd4fcd9e00b0 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:29:54.213188 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3ab2cf-aaed-43e4-8bdd-910fec28af70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:29:54.213793 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ab2cf-aaed-43e4-8bdd-910fec28af70 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:54.214069 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ab2cf-aaed-43e4-8bdd-910fec28af70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:54.214367 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ab2cf-aaed-43e4-8bdd-910fec28af70 admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:54.215010 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3ab2cf-aaed-43e4-8bdd-910fec28af70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:29:54.217837 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3ab2cf-aaed-43e4-8bdd-910fec28af70 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:29:54.220142 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 779/1566] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 01:29:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:29:54.221076 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1038cbd-f926-463b-ad9f-d17383a275b1 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:29:54.230772 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1038cbd-f926-463b-ad9f-d17383a275b1 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:29:54.235248 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50726890-12d1-469d-b374-94137badb36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:29:54.235837 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50726890-12d1-469d-b374-94137badb36a admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:54.236120 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50726890-12d1-469d-b374-94137badb36a admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:54.236381 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50726890-12d1-469d-b374-94137badb36a admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:54.236991 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50726890-12d1-469d-b374-94137badb36a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:29:54.238922 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50726890-12d1-469d-b374-94137badb36a admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:29:54.257878 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 788/1567] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:29:54 2022] POST /identity/v3/projects => generated 385 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:29:54.258671 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3ab2cf-aaed-43e4-8bdd-910fec28af70 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:29:54.272421 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 780/1568] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:29:54 2022] POST /identity/v3/projects => generated 391 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:29:54.273707 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50726890-12d1-469d-b374-94137badb36a admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:29:54.331121 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3ab2cf-aaed-43e4-8bdd-910fec28af70 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:29:54.335675 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87382757-823f-4697-8d2a-e474c777bcb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:29:54.335922 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50726890-12d1-469d-b374-94137badb36a admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:29:54.336336 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87382757-823f-4697-8d2a-e474c777bcb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:54.336608 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87382757-823f-4697-8d2a-e474c777bcb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:54.336879 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87382757-823f-4697-8d2a-e474c777bcb2 admin admin] PATH_INFO: `/v3/projects/f6a9d9afe84e45189dcd44fb58fd3436/users/04bb1a772b004b1394c19d9dbd306cb0/roles/13af81971c1c428eae0a571a22ea583d` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:54.340611 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54158428-fa6a-4031-99df-507f98c65aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:29:54.341236 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54158428-fa6a-4031-99df-507f98c65aac admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:54.341510 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54158428-fa6a-4031-99df-507f98c65aac admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:54.341777 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54158428-fa6a-4031-99df-507f98c65aac admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:54.342482 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54158428-fa6a-4031-99df-507f98c65aac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:29:54.342780 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54158428-fa6a-4031-99df-507f98c65aac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:29:54.344375 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54158428-fa6a-4031-99df-507f98c65aac admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:29:54.352463 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87382757-823f-4697-8d2a-e474c777bcb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6a9d9afe84e45189dcd44fb58fd3436, user_id=04bb1a772b004b1394c19d9dbd306cb0, role_id=13af81971c1c428eae0a571a22ea583d)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:29:54.353557 dv-cinder-784815-15-smb devstack@keystone.service[81555]: WARNING py.warnings [None req-87382757-823f-4697-8d2a-e474c777bcb2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 12 01:29:54.353557 dv-cinder-784815-15-smb devstack@keystone.service[81555]: warnings.warn(msg) Aug 12 01:29:54.353557 dv-cinder-784815-15-smb devstack@keystone.service[81555]: Aug 12 01:29:54.355578 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87382757-823f-4697-8d2a-e474c777bcb2 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:29:54.356852 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 781/1569] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 01:29:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:29:54.357568 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54158428-fa6a-4031-99df-507f98c65aac admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:29:54.367622 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54158428-fa6a-4031-99df-507f98c65aac admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:29:54.371723 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 789/1570] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:29:54 2022] PUT /identity/v3/projects/f6a9d9afe84e45189dcd44fb58fd3436/users/04bb1a772b004b1394c19d9dbd306cb0/roles/13af81971c1c428eae0a571a22ea583d => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:29:54.373236 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87382757-823f-4697-8d2a-e474c777bcb2 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:29:54.431505 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8c8c3c-376b-4584-863f-d72a96d396b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:29:54.432135 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c8c3c-376b-4584-863f-d72a96d396b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:54.432305 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c8c3c-376b-4584-863f-d72a96d396b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:54.432570 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c8c3c-376b-4584-863f-d72a96d396b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:54.433205 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8c8c3c-376b-4584-863f-d72a96d396b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:29:54.433498 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8c8c3c-376b-4584-863f-d72a96d396b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:29:54.435302 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8c8c3c-376b-4584-863f-d72a96d396b8 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:29:54.441794 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87382757-823f-4697-8d2a-e474c777bcb2 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:29:54.446967 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a4cc0-06f9-4221-845e-e928fc24d66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:29:54.447127 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 782/1571] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 01:29:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:29:54.447706 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a4cc0-06f9-4221-845e-e928fc24d66d admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:54.447805 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8c8c3c-376b-4584-863f-d72a96d396b8 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:29:54.448126 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a4cc0-06f9-4221-845e-e928fc24d66d admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:54.448775 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a4cc0-06f9-4221-845e-e928fc24d66d admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:54.449543 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6a4cc0-06f9-4221-845e-e928fc24d66d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:29:54.452169 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6a4cc0-06f9-4221-845e-e928fc24d66d admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:29:54.463951 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8c8c3c-376b-4584-863f-d72a96d396b8 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:29:54.469355 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff66d2b-4d33-4fcb-84ae-46e4d986d2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:29:54.469962 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff66d2b-4d33-4fcb-84ae-46e4d986d2db admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:54.470297 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff66d2b-4d33-4fcb-84ae-46e4d986d2db admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:54.470593 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff66d2b-4d33-4fcb-84ae-46e4d986d2db admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:54.471618 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff66d2b-4d33-4fcb-84ae-46e4d986d2db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:29:54.472732 dv-cinder-784815-15-smb devstack@keystone.service[81554]: WARNING py.warnings [None req-5ff66d2b-4d33-4fcb-84ae-46e4d986d2db admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 12 01:29:54.472732 dv-cinder-784815-15-smb devstack@keystone.service[81554]: warnings.warn(msg) Aug 12 01:29:54.472732 dv-cinder-784815-15-smb devstack@keystone.service[81554]: Aug 12 01:29:54.474037 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff66d2b-4d33-4fcb-84ae-46e4d986d2db admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:29:54.487985 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 790/1572] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:29:54 2022] POST /identity/v3/projects => generated 403 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:29:54.488781 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a4cc0-06f9-4221-845e-e928fc24d66d admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:29:54.504365 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 783/1573] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:29:54 2022] POST /identity/v3/users => generated 282 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:29:54.505173 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff66d2b-4d33-4fcb-84ae-46e4d986d2db admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:29:54.515786 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff66d2b-4d33-4fcb-84ae-46e4d986d2db admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:29:54.518092 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:29:54.535081 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:29:54.555968 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a4cc0-06f9-4221-845e-e928fc24d66d admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:29:54.562269 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23320798-573f-426f-b68a-f081ceb724db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:29:54.562880 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23320798-573f-426f-b68a-f081ceb724db admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:54.563161 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23320798-573f-426f-b68a-f081ceb724db admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:54.563396 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23320798-573f-426f-b68a-f081ceb724db admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:54.564023 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23320798-573f-426f-b68a-f081ceb724db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:29:54.565956 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23320798-573f-426f-b68a-f081ceb724db admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:29:54.573753 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f149ad-fe8c-4e31-b69d-c0c586beaaa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:29:54.574418 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f149ad-fe8c-4e31-b69d-c0c586beaaa7 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:54.575183 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f149ad-fe8c-4e31-b69d-c0c586beaaa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:54.575323 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f149ad-fe8c-4e31-b69d-c0c586beaaa7 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:54.575860 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f149ad-fe8c-4e31-b69d-c0c586beaaa7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:29:54.577753 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f149ad-fe8c-4e31-b69d-c0c586beaaa7 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:29:54.593946 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 791/1574] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:29:54 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:29:54.598374 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23320798-573f-426f-b68a-f081ceb724db admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:29:54.600213 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 784/1575] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:29:54 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:29:54.601010 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f149ad-fe8c-4e31-b69d-c0c586beaaa7 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:29:54.614185 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f149ad-fe8c-4e31-b69d-c0c586beaaa7 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:29:54.659484 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23320798-573f-426f-b68a-f081ceb724db admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:29:54.664323 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb73ad44-d8e2-443e-a890-6a148ff55aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:29:54.664925 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb73ad44-d8e2-443e-a890-6a148ff55aef admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:54.665184 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb73ad44-d8e2-443e-a890-6a148ff55aef admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:54.665475 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb73ad44-d8e2-443e-a890-6a148ff55aef admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:54.666078 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb73ad44-d8e2-443e-a890-6a148ff55aef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:29:54.668037 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb73ad44-d8e2-443e-a890-6a148ff55aef admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:29:54.674980 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e1827e-f90d-4eef-8ed6-0ecb748c52d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:29:54.675599 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e1827e-f90d-4eef-8ed6-0ecb748c52d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:54.675900 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e1827e-f90d-4eef-8ed6-0ecb748c52d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:54.676192 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e1827e-f90d-4eef-8ed6-0ecb748c52d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:54.676818 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e1827e-f90d-4eef-8ed6-0ecb748c52d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:29:54.678768 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e1827e-f90d-4eef-8ed6-0ecb748c52d0 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:29:54.690902 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 792/1576] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:29:54 2022] POST /identity/v3/users => generated 296 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:29:54.692187 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ca5ac-6619-4fe7-b1a0-5c2c81b49d78 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:54.692615 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ca5ac-6619-4fe7-b1a0-5c2c81b49d78 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:54.692889 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ca5ac-6619-4fe7-b1a0-5c2c81b49d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:54.713884 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 785/1577] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:29:54 2022] POST /identity/v3/projects => generated 367 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:29:54.714083 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-dc8ca5ac-6619-4fe7-b1a0-5c2c81b49d78 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:29:54.714235 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e1827e-f90d-4eef-8ed6-0ecb748c52d0 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:29:54.714347 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-dc8ca5ac-6619-4fe7-b1a0-5c2c81b49d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:29:54.774572 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 793/1578] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:29:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:29:54.775543 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8ca5ac-6619-4fe7-b1a0-5c2c81b49d78 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:29:54.777151 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e1827e-f90d-4eef-8ed6-0ecb748c52d0 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:29:54.784002 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a6fa6c-d08c-4e25-94a8-89d6c18866d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:29:54.784977 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6fa6c-d08c-4e25-94a8-89d6c18866d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:54.785252 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6fa6c-d08c-4e25-94a8-89d6c18866d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:54.785519 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6fa6c-d08c-4e25-94a8-89d6c18866d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:54.786229 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a6fa6c-d08c-4e25-94a8-89d6c18866d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:29:54.786645 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8ca5ac-6619-4fe7-b1a0-5c2c81b49d78 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:29:54.788145 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a6fa6c-d08c-4e25-94a8-89d6c18866d5 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:29:54.791352 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f35112-790c-46ed-b06c-07816c22cad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:29:54.791948 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f35112-790c-46ed-b06c-07816c22cad5 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:54.792223 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f35112-790c-46ed-b06c-07816c22cad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:54.792648 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f35112-790c-46ed-b06c-07816c22cad5 admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:54.793139 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f35112-790c-46ed-b06c-07816c22cad5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:29:54.795642 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f35112-790c-46ed-b06c-07816c22cad5 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:29:54.815961 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 786/1579] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:29:54 2022] POST /identity/v3/projects => generated 379 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:29:54.816949 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a6fa6c-d08c-4e25-94a8-89d6c18866d5 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:29:54.822148 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 794/1580] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:29:54 2022] POST /identity/v3/users => generated 302 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:29:54.822322 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f35112-790c-46ed-b06c-07816c22cad5 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:29:54.832111 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f35112-790c-46ed-b06c-07816c22cad5 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:29:54.848199 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:29:54.852248 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:29:54.888535 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a6fa6c-d08c-4e25-94a8-89d6c18866d5 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:29:54.891664 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf0b248-1ce7-4b45-9a8d-5683e6838448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:29:54.892279 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0b248-1ce7-4b45-9a8d-5683e6838448 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:54.892557 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0b248-1ce7-4b45-9a8d-5683e6838448 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:54.892831 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0b248-1ce7-4b45-9a8d-5683e6838448 admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:54.893485 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf0b248-1ce7-4b45-9a8d-5683e6838448 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:29:54.893587 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f388aa69-9129-4afc-8c55-04860680bbc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:29:54.894226 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f388aa69-9129-4afc-8c55-04860680bbc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:54.894498 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f388aa69-9129-4afc-8c55-04860680bbc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:54.894759 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f388aa69-9129-4afc-8c55-04860680bbc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:54.895400 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f388aa69-9129-4afc-8c55-04860680bbc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:29:54.895498 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf0b248-1ce7-4b45-9a8d-5683e6838448 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:29:54.896973 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f388aa69-9129-4afc-8c55-04860680bbc2 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:29:54.908514 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 787/1581] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:29:54 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:29:54.912742 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f388aa69-9129-4afc-8c55-04860680bbc2 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:29:54.918291 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 795/1582] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:29:54 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:29:54.919805 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf0b248-1ce7-4b45-9a8d-5683e6838448 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:29:54.925237 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f388aa69-9129-4afc-8c55-04860680bbc2 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:29:54.929556 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf0b248-1ce7-4b45-9a8d-5683e6838448 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:29:54.929726 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd703bf-53c2-4f66-9db0-443156e5774b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:29:54.930348 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd703bf-53c2-4f66-9db0-443156e5774b admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:54.930622 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd703bf-53c2-4f66-9db0-443156e5774b admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:54.930890 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd703bf-53c2-4f66-9db0-443156e5774b admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:54.931590 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd703bf-53c2-4f66-9db0-443156e5774b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:29:54.933112 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd703bf-53c2-4f66-9db0-443156e5774b admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:29:54.934684 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4624da4a-060e-430f-91cd-c9baff4f0d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:29:54.935654 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624da4a-060e-430f-91cd-c9baff4f0d17 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:54.935936 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624da4a-060e-430f-91cd-c9baff4f0d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:54.936209 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624da4a-060e-430f-91cd-c9baff4f0d17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:54.936976 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4624da4a-060e-430f-91cd-c9baff4f0d17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:29:54.939041 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4624da4a-060e-430f-91cd-c9baff4f0d17 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:29:54.943154 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 788/1583] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:29:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:29:54.943943 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd703bf-53c2-4f66-9db0-443156e5774b admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:29:54.954725 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 796/1584] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:29:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:29:54.954725 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4624da4a-060e-430f-91cd-c9baff4f0d17 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:29:54.957958 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd703bf-53c2-4f66-9db0-443156e5774b admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:29:54.962691 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ca31c1-63a1-4e11-ac11-3b8e8114596f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:29:54.963293 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca31c1-63a1-4e11-ac11-3b8e8114596f admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:54.963542 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca31c1-63a1-4e11-ac11-3b8e8114596f admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:54.963838 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca31c1-63a1-4e11-ac11-3b8e8114596f admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:54.964480 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ca31c1-63a1-4e11-ac11-3b8e8114596f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:29:54.967179 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ca31c1-63a1-4e11-ac11-3b8e8114596f admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:29:54.990190 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 789/1585] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:29:54 2022] POST /identity/v3/users => generated 284 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:29:54.991434 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ca31c1-63a1-4e11-ac11-3b8e8114596f admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:29:55.001799 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ca31c1-63a1-4e11-ac11-3b8e8114596f admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:29:55.006436 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbab234-b749-41eb-8633-b810b5d3e225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:29:55.007029 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbab234-b749-41eb-8633-b810b5d3e225 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:55.007305 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbab234-b749-41eb-8633-b810b5d3e225 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:55.007574 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbab234-b749-41eb-8633-b810b5d3e225 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:55.008190 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbab234-b749-41eb-8633-b810b5d3e225 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:29:55.009325 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4624da4a-060e-430f-91cd-c9baff4f0d17 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:29:55.010083 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbab234-b749-41eb-8633-b810b5d3e225 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:29:55.013005 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aa0c81-39bd-433c-a565-5077d8e2f848 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:29:55.013600 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa0c81-39bd-433c-a565-5077d8e2f848 service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:55.013871 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa0c81-39bd-433c-a565-5077d8e2f848 service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:55.014164 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa0c81-39bd-433c-a565-5077d8e2f848 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:55.023682 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aa0c81-39bd-433c-a565-5077d8e2f848 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:29:55.025360 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aa0c81-39bd-433c-a565-5077d8e2f848 service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:29:55.035358 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 790/1586] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:29:54 2022] POST /identity/v3/users => generated 290 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:29:55.035358 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbab234-b749-41eb-8633-b810b5d3e225 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:29:55.035866 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 797/1587] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:29:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:29:55.036736 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aa0c81-39bd-433c-a565-5077d8e2f848 service neutron] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:29:55.044804 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbab234-b749-41eb-8633-b810b5d3e225 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:29:55.046356 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aa0c81-39bd-433c-a565-5077d8e2f848 service neutron] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:29:55.049880 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccce9b1f-4713-424d-b712-89f6d0570dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:29:55.050504 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce9b1f-4713-424d-b712-89f6d0570dd3 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:55.050780 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce9b1f-4713-424d-b712-89f6d0570dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:55.051041 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce9b1f-4713-424d-b712-89f6d0570dd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:55.051644 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e88aa5-74a7-45fc-8702-6ba4a0c9816a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:29:55.051776 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccce9b1f-4713-424d-b712-89f6d0570dd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:29:55.052270 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e88aa5-74a7-45fc-8702-6ba4a0c9816a admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:55.052517 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e88aa5-74a7-45fc-8702-6ba4a0c9816a admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:55.052785 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e88aa5-74a7-45fc-8702-6ba4a0c9816a admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:55.053374 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccce9b1f-4713-424d-b712-89f6d0570dd3 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:29:55.054278 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e88aa5-74a7-45fc-8702-6ba4a0c9816a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:29:55.055925 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e88aa5-74a7-45fc-8702-6ba4a0c9816a admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:29:55.066466 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 791/1588] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:29:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:29:55.070828 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 798/1589] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:29:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:29:55.071022 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccce9b1f-4713-424d-b712-89f6d0570dd3 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:29:55.071124 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e88aa5-74a7-45fc-8702-6ba4a0c9816a admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:29:55.081389 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccce9b1f-4713-424d-b712-89f6d0570dd3 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:29:55.082069 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e88aa5-74a7-45fc-8702-6ba4a0c9816a admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:29:55.085999 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa099718-05f4-49b7-a00c-815c6026edba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:29:55.087681 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa099718-05f4-49b7-a00c-815c6026edba admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:55.087681 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa099718-05f4-49b7-a00c-815c6026edba admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:55.087681 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa099718-05f4-49b7-a00c-815c6026edba admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:55.087968 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa099718-05f4-49b7-a00c-815c6026edba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:29:55.089818 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa099718-05f4-49b7-a00c-815c6026edba admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:29:55.090048 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207096e7-f939-45a7-bcc0-013e99563e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:29:55.090786 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207096e7-f939-45a7-bcc0-013e99563e10 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:55.091156 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207096e7-f939-45a7-bcc0-013e99563e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:55.092194 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207096e7-f939-45a7-bcc0-013e99563e10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:55.092384 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207096e7-f939-45a7-bcc0-013e99563e10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:29:55.094133 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207096e7-f939-45a7-bcc0-013e99563e10 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:29:55.105706 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 792/1590] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:29:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:29:55.105706 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa099718-05f4-49b7-a00c-815c6026edba admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:29:55.106018 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 799/1591] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:29:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:29:55.106629 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207096e7-f939-45a7-bcc0-013e99563e10 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:29:55.119536 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa099718-05f4-49b7-a00c-815c6026edba admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:29:55.120921 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207096e7-f939-45a7-bcc0-013e99563e10 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:29:55.124615 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034d9cf9-5c78-4a89-9ffc-cee1566f1c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:29:55.125245 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034d9cf9-5c78-4a89-9ffc-cee1566f1c7b admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:55.125522 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034d9cf9-5c78-4a89-9ffc-cee1566f1c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:55.125960 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034d9cf9-5c78-4a89-9ffc-cee1566f1c7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:55.126482 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034d9cf9-5c78-4a89-9ffc-cee1566f1c7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:29:55.126605 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd30acbd-24f2-43eb-a387-11f952cd6057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:29:55.127109 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30acbd-24f2-43eb-a387-11f952cd6057 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:55.127384 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30acbd-24f2-43eb-a387-11f952cd6057 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:55.128042 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30acbd-24f2-43eb-a387-11f952cd6057 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:55.128194 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034d9cf9-5c78-4a89-9ffc-cee1566f1c7b admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:29:55.128726 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd30acbd-24f2-43eb-a387-11f952cd6057 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:29:55.130726 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd30acbd-24f2-43eb-a387-11f952cd6057 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:29:55.140001 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 793/1592] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:29:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:29:55.140816 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034d9cf9-5c78-4a89-9ffc-cee1566f1c7b admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:29:55.144829 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 800/1593] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:29:55 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:29:55.148314 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd30acbd-24f2-43eb-a387-11f952cd6057 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:29:55.154492 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034d9cf9-5c78-4a89-9ffc-cee1566f1c7b admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:29:55.157525 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd30acbd-24f2-43eb-a387-11f952cd6057 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:29:55.160294 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc0683-c333-4a97-8002-acb40bbbdec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:29:55.161053 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc0683-c333-4a97-8002-acb40bbbdec4 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:55.161375 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc0683-c333-4a97-8002-acb40bbbdec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:55.161719 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc0683-c333-4a97-8002-acb40bbbdec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:55.162257 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c063d53f-b73d-4b24-a189-0d6910afd7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:29:55.162517 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acc0683-c333-4a97-8002-acb40bbbdec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:29:55.162899 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c063d53f-b73d-4b24-a189-0d6910afd7e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:55.163252 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c063d53f-b73d-4b24-a189-0d6910afd7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:55.163520 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c063d53f-b73d-4b24-a189-0d6910afd7e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:55.164315 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c063d53f-b73d-4b24-a189-0d6910afd7e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:29:55.164430 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acc0683-c333-4a97-8002-acb40bbbdec4 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:29:55.166154 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c063d53f-b73d-4b24-a189-0d6910afd7e6 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:29:55.175791 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 794/1594] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:29:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:29:55.176675 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc0683-c333-4a97-8002-acb40bbbdec4 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:29:55.178017 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 801/1595] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:29:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:29:55.178842 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c063d53f-b73d-4b24-a189-0d6910afd7e6 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:29:55.190614 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c063d53f-b73d-4b24-a189-0d6910afd7e6 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:29:55.193430 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc0683-c333-4a97-8002-acb40bbbdec4 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:29:55.196170 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be142c31-1547-488e-99d8-7571768c1924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:29:55.196783 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be142c31-1547-488e-99d8-7571768c1924 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:55.197056 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be142c31-1547-488e-99d8-7571768c1924 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:55.197689 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be142c31-1547-488e-99d8-7571768c1924 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:55.197959 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be142c31-1547-488e-99d8-7571768c1924 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:29:55.199649 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be142c31-1547-488e-99d8-7571768c1924 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:29:55.200286 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d010722e-0286-47dd-92f8-e8962c5a4afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:29:55.201958 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010722e-0286-47dd-92f8-e8962c5a4afd admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:55.202718 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010722e-0286-47dd-92f8-e8962c5a4afd admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:55.203088 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010722e-0286-47dd-92f8-e8962c5a4afd admin admin] PATH_INFO: `/v3/projects/3332442f651e45b894eddfe67f8efd83/users/3368bb14110f4f60a6456584386ec3be/roles/13af81971c1c428eae0a571a22ea583d` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:55.210524 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 802/1596] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:29:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:29:55.214438 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be142c31-1547-488e-99d8-7571768c1924 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:29:55.223555 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d010722e-0286-47dd-92f8-e8962c5a4afd admin admin] RBAC: Authorizing `identity:create_grant(project_id=3332442f651e45b894eddfe67f8efd83, user_id=3368bb14110f4f60a6456584386ec3be, role_id=13af81971c1c428eae0a571a22ea583d)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:29:55.225235 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be142c31-1547-488e-99d8-7571768c1924 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:29:55.226300 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d010722e-0286-47dd-92f8-e8962c5a4afd admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:29:55.230743 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae7ab40-1923-43cc-97b5-bc92934d75f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:29:55.232496 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7ab40-1923-43cc-97b5-bc92934d75f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:55.232828 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7ab40-1923-43cc-97b5-bc92934d75f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:55.233179 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7ab40-1923-43cc-97b5-bc92934d75f5 admin admin] PATH_INFO: `/v3/projects/2a8cc09a214f42e3bcc1a105f450c07d/users/c5a9046c41e7479eb3c29b3f50f6f83f/roles/13af81971c1c428eae0a571a22ea583d` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:55.256097 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 795/1597] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:29:55 2022] PUT /identity/v3/projects/3332442f651e45b894eddfe67f8efd83/users/3368bb14110f4f60a6456584386ec3be/roles/13af81971c1c428eae0a571a22ea583d => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:29:55.256097 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d010722e-0286-47dd-92f8-e8962c5a4afd admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:29:55.262846 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae7ab40-1923-43cc-97b5-bc92934d75f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a8cc09a214f42e3bcc1a105f450c07d, user_id=c5a9046c41e7479eb3c29b3f50f6f83f, role_id=13af81971c1c428eae0a571a22ea583d)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:29:55.265730 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae7ab40-1923-43cc-97b5-bc92934d75f5 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:29:55.281822 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 803/1598] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:29:55 2022] PUT /identity/v3/projects/2a8cc09a214f42e3bcc1a105f450c07d/users/c5a9046c41e7479eb3c29b3f50f6f83f/roles/13af81971c1c428eae0a571a22ea583d => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:29:55.282643 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae7ab40-1923-43cc-97b5-bc92934d75f5 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:29:55.320534 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:29:55.335914 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d010722e-0286-47dd-92f8-e8962c5a4afd admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:29:55.350337 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:29:55.370046 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae7ab40-1923-43cc-97b5-bc92934d75f5 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:29:55.376489 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d984781-3dcc-4fc3-bbad-d93e2329a5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:29:55.377397 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d984781-3dcc-4fc3-bbad-d93e2329a5f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:55.377805 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d984781-3dcc-4fc3-bbad-d93e2329a5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:55.378251 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d984781-3dcc-4fc3-bbad-d93e2329a5f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:55.379038 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d984781-3dcc-4fc3-bbad-d93e2329a5f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:29:55.380959 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d984781-3dcc-4fc3-bbad-d93e2329a5f6 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:29:55.394150 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 804/1599] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:29:55 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:29:55.395146 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d984781-3dcc-4fc3-bbad-d93e2329a5f6 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:29:55.415727 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d984781-3dcc-4fc3-bbad-d93e2329a5f6 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:29:55.419999 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f359a57b-6e09-41e5-9385-92bbbc69ffd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:29:55.420839 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359a57b-6e09-41e5-9385-92bbbc69ffd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:55.421131 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359a57b-6e09-41e5-9385-92bbbc69ffd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:55.421404 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359a57b-6e09-41e5-9385-92bbbc69ffd7 admin admin] PATH_INFO: `/v3/projects/f6b6328ff3e6440cbea089a97d44cef8/users/619b8ee9e99c4d0b9ec1e2f91c19569d/roles/13af81971c1c428eae0a571a22ea583d` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:55.421751 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba61d0e4-0928-4716-9e8c-334377d33cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:29:55.422674 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba61d0e4-0928-4716-9e8c-334377d33cbf admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:55.423211 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba61d0e4-0928-4716-9e8c-334377d33cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:55.423651 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba61d0e4-0928-4716-9e8c-334377d33cbf admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:55.424579 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba61d0e4-0928-4716-9e8c-334377d33cbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:29:55.426661 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba61d0e4-0928-4716-9e8c-334377d33cbf admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:29:55.439231 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f359a57b-6e09-41e5-9385-92bbbc69ffd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6b6328ff3e6440cbea089a97d44cef8, user_id=619b8ee9e99c4d0b9ec1e2f91c19569d, role_id=13af81971c1c428eae0a571a22ea583d)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:29:55.440052 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 805/1600] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:29:55 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:29:55.441049 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba61d0e4-0928-4716-9e8c-334377d33cbf admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:29:55.442224 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f359a57b-6e09-41e5-9385-92bbbc69ffd7 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:29:55.454002 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba61d0e4-0928-4716-9e8c-334377d33cbf admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:29:55.461543 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 796/1601] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:29:55 2022] PUT /identity/v3/projects/f6b6328ff3e6440cbea089a97d44cef8/users/619b8ee9e99c4d0b9ec1e2f91c19569d/roles/13af81971c1c428eae0a571a22ea583d => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:29:55.461543 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f359a57b-6e09-41e5-9385-92bbbc69ffd7 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:29:55.537936 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9bdccc-f0b9-4829-8182-1b72651e5a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:29:55.538772 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9bdccc-f0b9-4829-8182-1b72651e5a80 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:55.539433 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9bdccc-f0b9-4829-8182-1b72651e5a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:55.539433 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9bdccc-f0b9-4829-8182-1b72651e5a80 admin admin] PATH_INFO: `/v3/projects/17eb9458e7fd4b90b2f1960e6c7a1dfb/users/2ee9558d01584497a9dafc59e4fce441/roles/13af81971c1c428eae0a571a22ea583d` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:55.544082 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f359a57b-6e09-41e5-9385-92bbbc69ffd7 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:29:55.549003 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d734b028-128b-40df-a31d-33db5013e111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:29:55.549664 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734b028-128b-40df-a31d-33db5013e111 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:55.549929 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734b028-128b-40df-a31d-33db5013e111 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:55.550275 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734b028-128b-40df-a31d-33db5013e111 admin admin] PATH_INFO: `/v3/projects/cbfe5be0639a4caeb8e2e1cbf5e59122/users/c8e85b77280f4a779c1d2ab66891f948/roles/13af81971c1c428eae0a571a22ea583d` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:55.556380 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9bdccc-f0b9-4829-8182-1b72651e5a80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17eb9458e7fd4b90b2f1960e6c7a1dfb, user_id=2ee9558d01584497a9dafc59e4fce441, role_id=13af81971c1c428eae0a571a22ea583d)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:29:55.559457 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9bdccc-f0b9-4829-8182-1b72651e5a80 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:29:55.567240 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d734b028-128b-40df-a31d-33db5013e111 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbfe5be0639a4caeb8e2e1cbf5e59122, user_id=c8e85b77280f4a779c1d2ab66891f948, role_id=13af81971c1c428eae0a571a22ea583d)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:29:55.569881 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d734b028-128b-40df-a31d-33db5013e111 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:29:55.575621 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 806/1602] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:29:55 2022] PUT /identity/v3/projects/17eb9458e7fd4b90b2f1960e6c7a1dfb/users/2ee9558d01584497a9dafc59e4fce441/roles/13af81971c1c428eae0a571a22ea583d => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:29:55.579521 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b31a6-8a1c-4e3c-b4a4-a4c8403d4121 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:55.579812 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b31a6-8a1c-4e3c-b4a4-a4c8403d4121 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:55.580087 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b31a6-8a1c-4e3c-b4a4-a4c8403d4121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:55.587164 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 797/1603] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:29:55 2022] PUT /identity/v3/projects/cbfe5be0639a4caeb8e2e1cbf5e59122/users/c8e85b77280f4a779c1d2ab66891f948/roles/13af81971c1c428eae0a571a22ea583d => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:29:55.587164 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f4d120-02d9-4d47-a3a0-2a2031b155f7 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:55.587164 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f4d120-02d9-4d47-a3a0-2a2031b155f7 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:55.587164 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f4d120-02d9-4d47-a3a0-2a2031b155f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:55.615279 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-c5f4d120-02d9-4d47-a3a0-2a2031b155f7 None None] MFA Rules not processed for user `c5a9046c41e7479eb3c29b3f50f6f83f`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:29:55.616529 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c5f4d120-02d9-4d47-a3a0-2a2031b155f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:29:55.619040 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-ca4b31a6-8a1c-4e3c-b4a4-a4c8403d4121 None None] MFA Rules not processed for user `3368bb14110f4f60a6456584386ec3be`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:29:55.620212 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-ca4b31a6-8a1c-4e3c-b4a4-a4c8403d4121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:29:55.687963 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 798/1604] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:29:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:29:55.689191 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f4d120-02d9-4d47-a3a0-2a2031b155f7 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:29:55.699152 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:29:55.699516 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 807/1605] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:29:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:29:55.700443 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4b31a6-8a1c-4e3c-b4a4-a4c8403d4121 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:29:55.747517 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:29:55.811677 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4b31a6-8a1c-4e3c-b4a4-a4c8403d4121 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:29:55.812504 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f4d120-02d9-4d47-a3a0-2a2031b155f7 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:29:55.817522 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ce3aab-c9b5-46a0-b983-811c2a6e7c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:29:55.818241 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce3aab-c9b5-46a0-b983-811c2a6e7c13 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:55.818516 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce3aab-c9b5-46a0-b983-811c2a6e7c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:55.818831 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce3aab-c9b5-46a0-b983-811c2a6e7c13 admin admin] PATH_INFO: `/v3/projects/59bf63baacb54f308e34809791f3258d/users/f310c49470854e57a7870a0e317a2e54/roles/13af81971c1c428eae0a571a22ea583d` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:55.819535 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237b763f-14c8-418c-a215-e0a9cbb0a1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:29:55.820498 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b763f-14c8-418c-a215-e0a9cbb0a1ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:55.820925 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b763f-14c8-418c-a215-e0a9cbb0a1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:55.821420 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b763f-14c8-418c-a215-e0a9cbb0a1ff admin admin] PATH_INFO: `/v3/projects/7cc9c33e3127466e832730edbb3897a2/users/71cccc67d55f49c4a1ba869a1d75e4e0/roles/13af81971c1c428eae0a571a22ea583d` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:55.839490 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ce3aab-c9b5-46a0-b983-811c2a6e7c13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59bf63baacb54f308e34809791f3258d, user_id=f310c49470854e57a7870a0e317a2e54, role_id=13af81971c1c428eae0a571a22ea583d)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:29:55.843579 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ce3aab-c9b5-46a0-b983-811c2a6e7c13 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:29:55.843804 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237b763f-14c8-418c-a215-e0a9cbb0a1ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cc9c33e3127466e832730edbb3897a2, user_id=71cccc67d55f49c4a1ba869a1d75e4e0, role_id=13af81971c1c428eae0a571a22ea583d)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:29:55.847776 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237b763f-14c8-418c-a215-e0a9cbb0a1ff admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:29:55.861916 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 808/1606] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:29:55 2022] PUT /identity/v3/projects/59bf63baacb54f308e34809791f3258d/users/f310c49470854e57a7870a0e317a2e54/roles/13af81971c1c428eae0a571a22ea583d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:29:55.863990 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c50e45-47a4-4ffd-b708-2c625fd68b96 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:55.864866 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c50e45-47a4-4ffd-b708-2c625fd68b96 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:55.865135 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c50e45-47a4-4ffd-b708-2c625fd68b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:55.868283 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 799/1607] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:29:55 2022] PUT /identity/v3/projects/7cc9c33e3127466e832730edbb3897a2/users/71cccc67d55f49c4a1ba869a1d75e4e0/roles/13af81971c1c428eae0a571a22ea583d => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:29:55.870182 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3171a975-21f3-41fc-b61f-eb4e375c507a None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:55.870718 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3171a975-21f3-41fc-b61f-eb4e375c507a None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:55.871273 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3171a975-21f3-41fc-b61f-eb4e375c507a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:55.899317 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-3171a975-21f3-41fc-b61f-eb4e375c507a None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:29:55.900691 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-3171a975-21f3-41fc-b61f-eb4e375c507a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:29:55.911985 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-e1c50e45-47a4-4ffd-b708-2c625fd68b96 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:29:55.913563 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-e1c50e45-47a4-4ffd-b708-2c625fd68b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:29:55.973038 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 800/1608] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:29:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:29:55.974200 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216955b7-185f-4fe5-820c-5ec382758ca9 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:55.974554 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216955b7-185f-4fe5-820c-5ec382758ca9 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:55.974894 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216955b7-185f-4fe5-820c-5ec382758ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:55.989723 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 809/1609] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:29:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:29:55.990634 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c50e45-47a4-4ffd-b708-2c625fd68b96 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:29:56.004290 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c50e45-47a4-4ffd-b708-2c625fd68b96 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:29:56.009639 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f3d3a0-4699-4408-bfff-b49f290ca95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:29:56.010469 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3d3a0-4699-4408-bfff-b49f290ca95f admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:56.010822 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3d3a0-4699-4408-bfff-b49f290ca95f admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:56.011088 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3d3a0-4699-4408-bfff-b49f290ca95f admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:56.012597 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f3d3a0-4699-4408-bfff-b49f290ca95f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:29:56.013916 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-216955b7-185f-4fe5-820c-5ec382758ca9 None None] MFA Rules not processed for user `2ee9558d01584497a9dafc59e4fce441`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:29:56.014531 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f3d3a0-4699-4408-bfff-b49f290ca95f admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:29:56.015740 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-216955b7-185f-4fe5-820c-5ec382758ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:29:56.051108 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 810/1610] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:29:55 2022] POST /identity/v3/projects => generated 365 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:29:56.055529 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e858aa-4f4d-404d-93af-7419ca1ada2a None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:56.055808 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e858aa-4f4d-404d-93af-7419ca1ada2a None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:56.056146 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e858aa-4f4d-404d-93af-7419ca1ada2a None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:56.057932 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 811/1611] 10.222.0.26 () {54 vars in 962 bytes} [Fri Aug 12 01:29:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:29:56.059548 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a01994-e947-4c2e-ba7c-52ec675d9c06 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:56.059963 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a01994-e947-4c2e-ba7c-52ec675d9c06 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:56.060324 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a01994-e947-4c2e-ba7c-52ec675d9c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:56.083336 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-87a01994-e947-4c2e-ba7c-52ec675d9c06 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:29:56.085097 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-87a01994-e947-4c2e-ba7c-52ec675d9c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:29:56.110727 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 801/1612] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:29:55 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:29:56.112299 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fbbf23-41b4-42a4-ad34-0b2529a54983 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:56.112585 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fbbf23-41b4-42a4-ad34-0b2529a54983 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:56.112890 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fbbf23-41b4-42a4-ad34-0b2529a54983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:56.146995 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-e0fbbf23-41b4-42a4-ad34-0b2529a54983 None None] MFA Rules not processed for user `71cccc67d55f49c4a1ba869a1d75e4e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:29:56.148207 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-e0fbbf23-41b4-42a4-ad34-0b2529a54983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:29:56.158834 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:29:56.159454 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 812/1613] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:29:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:29:56.160215 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a01994-e947-4c2e-ba7c-52ec675d9c06 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:29:56.192705 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:29:56.226780 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a01994-e947-4c2e-ba7c-52ec675d9c06 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:29:56.231375 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6f3391-f73d-494d-8cf9-384f5d13b76b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:29:56.232005 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f3391-f73d-494d-8cf9-384f5d13b76b service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:56.232279 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f3391-f73d-494d-8cf9-384f5d13b76b service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:56.232546 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f3391-f73d-494d-8cf9-384f5d13b76b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:56.241188 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 802/1614] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:29:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:29:56.242625 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fbbf23-41b4-42a4-ad34-0b2529a54983 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:29:56.244607 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6f3391-f73d-494d-8cf9-384f5d13b76b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:29:56.246986 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6f3391-f73d-494d-8cf9-384f5d13b76b service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:29:56.256038 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fbbf23-41b4-42a4-ad34-0b2529a54983 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:29:56.258905 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 813/1615] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:29:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:29:56.259757 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6f3391-f73d-494d-8cf9-384f5d13b76b service neutron] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:29:56.270618 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6f3391-f73d-494d-8cf9-384f5d13b76b service neutron] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:29:56.273938 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012054f1-6d46-468d-8413-b1b0414e1c8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:29:56.276021 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9842d5-4d05-4a2c-b11b-9ad0912b8e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:29:56.276640 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9842d5-4d05-4a2c-b11b-9ad0912b8e43 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:56.276913 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9842d5-4d05-4a2c-b11b-9ad0912b8e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:56.277179 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9842d5-4d05-4a2c-b11b-9ad0912b8e43 admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:56.277977 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012054f1-6d46-468d-8413-b1b0414e1c8a service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:56.278102 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9842d5-4d05-4a2c-b11b-9ad0912b8e43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:29:56.280182 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9842d5-4d05-4a2c-b11b-9ad0912b8e43 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:29:56.281151 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012054f1-6d46-468d-8413-b1b0414e1c8a service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:56.281633 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012054f1-6d46-468d-8413-b1b0414e1c8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:56.309549 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 814/1616] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:29:56 2022] POST /identity/v3/users => generated 289 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:29:56.310423 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012054f1-6d46-468d-8413-b1b0414e1c8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:29:56.312802 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012054f1-6d46-468d-8413-b1b0414e1c8a service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:29:56.315184 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841cdad4-8c60-4978-a1f2-85e9c99bfed2 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:56.315586 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841cdad4-8c60-4978-a1f2-85e9c99bfed2 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:56.315951 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841cdad4-8c60-4978-a1f2-85e9c99bfed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:56.335106 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 803/1617] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:29:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:29:56.336172 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012054f1-6d46-468d-8413-b1b0414e1c8a service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:29:56.349014 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012054f1-6d46-468d-8413-b1b0414e1c8a service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:29:56.360602 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58614891-9506-4a32-8175-6029934bc650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:29:56.361452 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58614891-9506-4a32-8175-6029934bc650 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:56.361939 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58614891-9506-4a32-8175-6029934bc650 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:56.362556 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58614891-9506-4a32-8175-6029934bc650 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:56.363385 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58614891-9506-4a32-8175-6029934bc650 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:29:56.366386 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58614891-9506-4a32-8175-6029934bc650 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:29:56.404537 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-841cdad4-8c60-4978-a1f2-85e9c99bfed2 None None] MFA Rules not processed for user `fcd5e95467b44175be2478c2c7c89926`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:29:56.408837 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 804/1618] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:29:56 2022] POST /identity/v3/projects => generated 405 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:29:56.408837 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58614891-9506-4a32-8175-6029934bc650 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:29:56.409255 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-841cdad4-8c60-4978-a1f2-85e9c99bfed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:29:56.501330 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58614891-9506-4a32-8175-6029934bc650 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:29:56.513442 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffef3b4-f502-44c2-aa9c-eaac8e1d4d03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:29:56.514982 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffef3b4-f502-44c2-aa9c-eaac8e1d4d03 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:56.515477 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffef3b4-f502-44c2-aa9c-eaac8e1d4d03 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:56.516004 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffef3b4-f502-44c2-aa9c-eaac8e1d4d03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:56.580437 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 815/1619] 10.222.0.26 () {58 vars in 1059 bytes} [Fri Aug 12 01:29:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:29:56.581410 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841cdad4-8c60-4978-a1f2-85e9c99bfed2 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:29:56.669880 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffef3b4-f502-44c2-aa9c-eaac8e1d4d03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:29:56.673296 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffef3b4-f502-44c2-aa9c-eaac8e1d4d03 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:29:56.692651 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 805/1620] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:29:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:29:56.693851 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffef3b4-f502-44c2-aa9c-eaac8e1d4d03 service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:29:56.709149 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841cdad4-8c60-4978-a1f2-85e9c99bfed2 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:29:56.718236 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac6394-0a01-4e15-b693-30b146f19824 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7853d40c29af424c8d7913950d89750b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:29:56.720037 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac6394-0a01-4e15-b693-30b146f19824 service cinder] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:56.720319 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac6394-0a01-4e15-b693-30b146f19824 service cinder] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:56.720625 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac6394-0a01-4e15-b693-30b146f19824 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:56.723976 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffef3b4-f502-44c2-aa9c-eaac8e1d4d03 service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:29:56.736099 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e74897a-68b0-4f02-81eb-9e152aef78a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:29:56.736833 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74897a-68b0-4f02-81eb-9e152aef78a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:56.737217 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74897a-68b0-4f02-81eb-9e152aef78a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:56.737655 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74897a-68b0-4f02-81eb-9e152aef78a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:56.738555 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e74897a-68b0-4f02-81eb-9e152aef78a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:29:56.740535 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e74897a-68b0-4f02-81eb-9e152aef78a1 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:29:56.777951 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 806/1621] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:29:56 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:29:56.779101 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e74897a-68b0-4f02-81eb-9e152aef78a1 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:29:56.802667 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e74897a-68b0-4f02-81eb-9e152aef78a1 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:29:56.808236 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a80491-057b-4da3-9607-8cdf781c73ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:29:56.810722 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a80491-057b-4da3-9607-8cdf781c73ab admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:56.811071 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a80491-057b-4da3-9607-8cdf781c73ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:56.811414 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a80491-057b-4da3-9607-8cdf781c73ab admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:56.812203 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a80491-057b-4da3-9607-8cdf781c73ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:29:56.814370 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a80491-057b-4da3-9607-8cdf781c73ab admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:29:56.823380 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:29:56.831542 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:29:56.850823 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 807/1622] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:29:56 2022] POST /identity/v3/users => generated 309 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:29:56.850823 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a80491-057b-4da3-9607-8cdf781c73ab admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:29:56.856591 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ac6394-0a01-4e15-b693-30b146f19824 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:29:56.858755 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ac6394-0a01-4e15-b693-30b146f19824 service cinder] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:29:56.890302 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a80491-057b-4da3-9607-8cdf781c73ab admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:29:56.894940 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 816/1623] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:29:56 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:29:56.896474 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac6394-0a01-4e15-b693-30b146f19824 service cinder] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:29:56.908038 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d1de7-54ee-4d24-ae8e-3744b3d63b71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd5e95467b44175be2478c2c7c89926', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:29:56.908739 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d1de7-54ee-4d24-ae8e-3744b3d63b71 service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:56.909085 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d1de7-54ee-4d24-ae8e-3744b3d63b71 service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:56.909644 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d1de7-54ee-4d24-ae8e-3744b3d63b71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:56.922300 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac6394-0a01-4e15-b693-30b146f19824 service cinder] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:29:56.939218 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc575ae-4f44-46d9-a20a-340bebc12b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:29:56.940020 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc575ae-4f44-46d9-a20a-340bebc12b91 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:56.941254 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc575ae-4f44-46d9-a20a-340bebc12b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:56.941391 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc575ae-4f44-46d9-a20a-340bebc12b91 admin admin] PATH_INFO: `/v3/projects/9c4d67311a4f4bb6b024fe6c68194e33/users/627c7e9361cc49488db949b261da143a/roles/fb48693810be495fb4b1893a79429b78` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:56.964594 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc575ae-4f44-46d9-a20a-340bebc12b91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c4d67311a4f4bb6b024fe6c68194e33, user_id=627c7e9361cc49488db949b261da143a, role_id=fb48693810be495fb4b1893a79429b78)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:29:56.977244 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc575ae-4f44-46d9-a20a-340bebc12b91 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:29:57.005554 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 817/1624] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:29:56 2022] PUT /identity/v3/projects/9c4d67311a4f4bb6b024fe6c68194e33/users/627c7e9361cc49488db949b261da143a/roles/fb48693810be495fb4b1893a79429b78 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:29:57.009501 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc575ae-4f44-46d9-a20a-340bebc12b91 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:29:57.108513 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103d1de7-54ee-4d24-ae8e-3744b3d63b71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:29:57.108513 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103d1de7-54ee-4d24-ae8e-3744b3d63b71 service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:29:57.108513 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 808/1625] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:29:56 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:29:57.108513 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d1de7-54ee-4d24-ae8e-3744b3d63b71 service nova] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:29:57.108513 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d1de7-54ee-4d24-ae8e-3744b3d63b71 service nova] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:29:57.124794 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc575ae-4f44-46d9-a20a-340bebc12b91 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:29:57.131407 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3f07b7-423f-487f-8d22-a16c05ec633a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:29:57.133126 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f07b7-423f-487f-8d22-a16c05ec633a admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:57.133694 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f07b7-423f-487f-8d22-a16c05ec633a admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:57.133973 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f07b7-423f-487f-8d22-a16c05ec633a admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:57.136184 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3f07b7-423f-487f-8d22-a16c05ec633a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:29:57.154512 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3f07b7-423f-487f-8d22-a16c05ec633a admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:29:57.170179 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 818/1626] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:29:57 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:29:57.173756 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3f07b7-423f-487f-8d22-a16c05ec633a admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:29:57.186494 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2945bf-ef3c-4f64-a0fe-7d23b2ac96fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:29:57.187216 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2945bf-ef3c-4f64-a0fe-7d23b2ac96fc admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:57.187552 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2945bf-ef3c-4f64-a0fe-7d23b2ac96fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:57.187880 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2945bf-ef3c-4f64-a0fe-7d23b2ac96fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:57.188713 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2945bf-ef3c-4f64-a0fe-7d23b2ac96fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:29:57.190747 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2945bf-ef3c-4f64-a0fe-7d23b2ac96fc admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:29:57.197488 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3f07b7-423f-487f-8d22-a16c05ec633a admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:29:57.208182 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 809/1627] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:29:57 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:29:57.209296 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2945bf-ef3c-4f64-a0fe-7d23b2ac96fc admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:29:57.220812 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0394384-e121-4aff-85d5-fe4b93cebcd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:29:57.221860 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0394384-e121-4aff-85d5-fe4b93cebcd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:57.221990 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2945bf-ef3c-4f64-a0fe-7d23b2ac96fc admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:29:57.222205 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0394384-e121-4aff-85d5-fe4b93cebcd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:57.222450 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0394384-e121-4aff-85d5-fe4b93cebcd6 admin admin] PATH_INFO: `/v3/projects/3468dd058c474ff5957a2774145536d6/users/c90e57c59c5e4386a21b6367394f72c6/roles/fb48693810be495fb4b1893a79429b78` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:57.228923 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a4c0cb-1cbd-4def-b5aa-62ebe2c027e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:29:57.230312 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4c0cb-1cbd-4def-b5aa-62ebe2c027e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:57.230312 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4c0cb-1cbd-4def-b5aa-62ebe2c027e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:57.230590 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4c0cb-1cbd-4def-b5aa-62ebe2c027e5 admin admin] PATH_INFO: `/v3/projects/9c4d67311a4f4bb6b024fe6c68194e33/users/627c7e9361cc49488db949b261da143a/roles/fb48693810be495fb4b1893a79429b78` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:57.233312 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a4c0cb-1cbd-4def-b5aa-62ebe2c027e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c4d67311a4f4bb6b024fe6c68194e33, user_id=627c7e9361cc49488db949b261da143a, role_id=fb48693810be495fb4b1893a79429b78)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:29:57.237099 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a4c0cb-1cbd-4def-b5aa-62ebe2c027e5 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:29:57.265273 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0394384-e121-4aff-85d5-fe4b93cebcd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3468dd058c474ff5957a2774145536d6, user_id=c90e57c59c5e4386a21b6367394f72c6, role_id=fb48693810be495fb4b1893a79429b78)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:29:57.267903 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0394384-e121-4aff-85d5-fe4b93cebcd6 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:29:57.269838 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 810/1628] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:29:57 2022] PUT /identity/v3/projects/9c4d67311a4f4bb6b024fe6c68194e33/users/627c7e9361cc49488db949b261da143a/roles/fb48693810be495fb4b1893a79429b78 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:29:57.271528 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7da13-707e-4565-9df6-d1cdbcf05813 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:57.271813 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7da13-707e-4565-9df6-d1cdbcf05813 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:57.272082 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7da13-707e-4565-9df6-d1cdbcf05813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:57.292785 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 819/1629] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:29:57 2022] PUT /identity/v3/projects/3468dd058c474ff5957a2774145536d6/users/c90e57c59c5e4386a21b6367394f72c6/roles/fb48693810be495fb4b1893a79429b78 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:29:57.296707 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0394384-e121-4aff-85d5-fe4b93cebcd6 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:29:57.349496 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-67e7da13-707e-4565-9df6-d1cdbcf05813 None None] MFA Rules not processed for user `627c7e9361cc49488db949b261da143a`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:29:57.350772 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-67e7da13-707e-4565-9df6-d1cdbcf05813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:29:57.437895 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0394384-e121-4aff-85d5-fe4b93cebcd6 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:29:57.451105 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6d28f7-f385-4376-8b93-f1d381868525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:29:57.451436 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d28f7-f385-4376-8b93-f1d381868525 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:57.451717 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d28f7-f385-4376-8b93-f1d381868525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:57.451988 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d28f7-f385-4376-8b93-f1d381868525 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:57.452647 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6d28f7-f385-4376-8b93-f1d381868525 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:29:57.454296 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6d28f7-f385-4376-8b93-f1d381868525 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:29:57.481445 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 820/1630] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:29:57 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:29:57.482659 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6d28f7-f385-4376-8b93-f1d381868525 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:29:57.502641 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6d28f7-f385-4376-8b93-f1d381868525 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:29:57.523675 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b791fc-2f33-448f-88dc-916bc4ba98a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:29:57.524215 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b791fc-2f33-448f-88dc-916bc4ba98a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:57.524498 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b791fc-2f33-448f-88dc-916bc4ba98a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:57.524778 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b791fc-2f33-448f-88dc-916bc4ba98a6 admin admin] PATH_INFO: `/v3/projects/3468dd058c474ff5957a2774145536d6/users/c90e57c59c5e4386a21b6367394f72c6/roles/fb48693810be495fb4b1893a79429b78` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:57.530377 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b791fc-2f33-448f-88dc-916bc4ba98a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3468dd058c474ff5957a2774145536d6, user_id=c90e57c59c5e4386a21b6367394f72c6, role_id=fb48693810be495fb4b1893a79429b78)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:29:57.532632 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b791fc-2f33-448f-88dc-916bc4ba98a6 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:29:57.539033 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 811/1631] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:29:57 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:29:57.548208 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e7da13-707e-4565-9df6-d1cdbcf05813 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:29:57.560416 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:29:57.573549 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 821/1632] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:29:57 2022] PUT /identity/v3/projects/3468dd058c474ff5957a2774145536d6/users/c90e57c59c5e4386a21b6367394f72c6/roles/fb48693810be495fb4b1893a79429b78 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:29:57.584144 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee5d24-d2f8-4375-a9a3-ab6e0558c12a None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:57.584691 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee5d24-d2f8-4375-a9a3-ab6e0558c12a None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:57.585109 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee5d24-d2f8-4375-a9a3-ab6e0558c12a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:57.660766 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:29:57.677777 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-06ee5d24-d2f8-4375-a9a3-ab6e0558c12a None None] MFA Rules not processed for user `c90e57c59c5e4386a21b6367394f72c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:29:57.681294 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-06ee5d24-d2f8-4375-a9a3-ab6e0558c12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:29:57.716889 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e7da13-707e-4565-9df6-d1cdbcf05813 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:29:57.856404 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe2c0bd-dcd5-437d-93a2-ca6df8cb14c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7853d40c29af424c8d7913950d89750b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:29:57.857049 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2c0bd-dcd5-437d-93a2-ca6df8cb14c4 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:57.857326 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2c0bd-dcd5-437d-93a2-ca6df8cb14c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:57.857599 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2c0bd-dcd5-437d-93a2-ca6df8cb14c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:57.867258 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 822/1633] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:29:57 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 01:29:57.868567 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a87188-1774-4620-8f4f-55e7d1767161 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:57.868853 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a87188-1774-4620-8f4f-55e7d1767161 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:57.869128 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a87188-1774-4620-8f4f-55e7d1767161 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:57.872505 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 823/1634] 10.222.0.26 () {54 vars in 912 bytes} [Fri Aug 12 01:29:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:29:57.879666 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c8dec6-a403-43c6-bcf9-8b4e13e39b1a None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:57.880113 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c8dec6-a403-43c6-bcf9-8b4e13e39b1a None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:57.880464 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c8dec6-a403-43c6-bcf9-8b4e13e39b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:57.912220 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-c9c8dec6-a403-43c6-bcf9-8b4e13e39b1a None None] MFA Rules not processed for user `fcd5e95467b44175be2478c2c7c89926`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:29:57.913494 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-c9c8dec6-a403-43c6-bcf9-8b4e13e39b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:29:58.007014 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe2c0bd-dcd5-437d-93a2-ca6df8cb14c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:29:58.009546 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe2c0bd-dcd5-437d-93a2-ca6df8cb14c4 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:29:58.027885 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 812/1635] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:29:57 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:29:58.029459 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe2c0bd-dcd5-437d-93a2-ca6df8cb14c4 service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:29:58.045297 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe2c0bd-dcd5-437d-93a2-ca6df8cb14c4 service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:29:58.054623 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffb9c9d-51ec-4b59-9f5d-5f654d6d3839 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7853d40c29af424c8d7913950d89750b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:29:58.055581 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffb9c9d-51ec-4b59-9f5d-5f654d6d3839 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:58.055911 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffb9c9d-51ec-4b59-9f5d-5f654d6d3839 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:58.056271 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffb9c9d-51ec-4b59-9f5d-5f654d6d3839 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:58.062392 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 824/1636] 10.222.0.26 () {58 vars in 1009 bytes} [Fri Aug 12 01:29:57 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:29:58.079830 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffb9c9d-51ec-4b59-9f5d-5f654d6d3839 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:29:58.082041 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffb9c9d-51ec-4b59-9f5d-5f654d6d3839 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:29:58.103402 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 813/1637] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:29:58 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:29:58.269808 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c8dec6-a403-43c6-bcf9-8b4e13e39b1a None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:29:58.282817 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c8dec6-a403-43c6-bcf9-8b4e13e39b1a None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:29:58.332411 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d672303-a162-4932-8066-f22afca3d08c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7853d40c29af424c8d7913950d89750b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:29:58.333046 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d672303-a162-4932-8066-f22afca3d08c service cinder] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:58.335113 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d672303-a162-4932-8066-f22afca3d08c service cinder] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:58.335441 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d672303-a162-4932-8066-f22afca3d08c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:58.368833 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d672303-a162-4932-8066-f22afca3d08c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:29:58.370315 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d672303-a162-4932-8066-f22afca3d08c service cinder] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:29:58.383669 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 825/1638] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:29:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:29:58.492704 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffb9c9d-51ec-4b59-9f5d-5f654d6d3839 service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:29:58.501940 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffb9c9d-51ec-4b59-9f5d-5f654d6d3839 service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:29:58.519115 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb39a10-9d30-4119-a6a9-6f936305abd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7853d40c29af424c8d7913950d89750b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:29:58.519754 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb39a10-9d30-4119-a6a9-6f936305abd8 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:58.520034 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb39a10-9d30-4119-a6a9-6f936305abd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:58.520295 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb39a10-9d30-4119-a6a9-6f936305abd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:58.665108 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:29:58.674039 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb39a10-9d30-4119-a6a9-6f936305abd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:29:58.675624 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb39a10-9d30-4119-a6a9-6f936305abd8 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:29:58.712183 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 814/1639] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:29:58 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:29:59.182819 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d672303-a162-4932-8066-f22afca3d08c service cinder] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:29:59.407484 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d672303-a162-4932-8066-f22afca3d08c service cinder] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:29:59.416528 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa5b864-3e9b-46c3-9eb0-cb6cfa459b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:29:59.420012 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5b864-3e9b-46c3-9eb0-cb6cfa459b07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:59.420799 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5b864-3e9b-46c3-9eb0-cb6cfa459b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:59.421485 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5b864-3e9b-46c3-9eb0-cb6cfa459b07 admin admin] PATH_INFO: `/v3/users/2ee9558d01584497a9dafc59e4fce441` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:59.435028 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa5b864-3e9b-46c3-9eb0-cb6cfa459b07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ee9558d01584497a9dafc59e4fce441)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:29:59.436079 dv-cinder-784815-15-smb devstack@keystone.service[81555]: WARNING py.warnings [None req-0fa5b864-3e9b-46c3-9eb0-cb6cfa459b07 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 12 01:29:59.436079 dv-cinder-784815-15-smb devstack@keystone.service[81555]: warnings.warn(msg) Aug 12 01:29:59.436079 dv-cinder-784815-15-smb devstack@keystone.service[81555]: Aug 12 01:29:59.437771 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa5b864-3e9b-46c3-9eb0-cb6cfa459b07 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:29:59.503304 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:29:59.557998 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-0fa5b864-3e9b-46c3-9eb0-cb6cfa459b07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ee9558d01584497a9dafc59e4fce441'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:29:59.576993 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-0fa5b864-3e9b-46c3-9eb0-cb6cfa459b07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ee9558d01584497a9dafc59e4fce441'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:29:59.577923 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-0fa5b864-3e9b-46c3-9eb0-cb6cfa459b07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ee9558d01584497a9dafc59e4fce441'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:29:59.625026 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-0fa5b864-3e9b-46c3-9eb0-cb6cfa459b07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ee9558d01584497a9dafc59e4fce441'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:29:59.683667 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-0fa5b864-3e9b-46c3-9eb0-cb6cfa459b07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ee9558d01584497a9dafc59e4fce441'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:29:59.696866 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 826/1640] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:29:59 2022] DELETE /identity/v3/users/2ee9558d01584497a9dafc59e4fce441 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:29:59.699687 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c69b8-6528-4901-8fbb-4194ad34d3e0 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:29:59.700242 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c69b8-6528-4901-8fbb-4194ad34d3e0 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:29:59.700527 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c69b8-6528-4901-8fbb-4194ad34d3e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:29:59.758451 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-cd9c69b8-6528-4901-8fbb-4194ad34d3e0 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:29:59.763068 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-cd9c69b8-6528-4901-8fbb-4194ad34d3e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:29:59.908610 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 815/1641] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:29:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:29:59.937579 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa5b864-3e9b-46c3-9eb0-cb6cfa459b07 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:29:59.941472 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-0fa5b864-3e9b-46c3-9eb0-cb6cfa459b07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:00.028486 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcbab04-5c15-4c14-9717-9159120284c7 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:00.028674 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcbab04-5c15-4c14-9717-9159120284c7 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:00.028896 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcbab04-5c15-4c14-9717-9159120284c7 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:00.030944 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 816/1642] 10.222.0.26 () {54 vars in 962 bytes} [Fri Aug 12 01:30:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 01:30:00.042474 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b889b3f-d390-43b4-af1b-7ae57d434968 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:00.042773 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b889b3f-d390-43b4-af1b-7ae57d434968 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:00.043119 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b889b3f-d390-43b4-af1b-7ae57d434968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:00.091863 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-0b889b3f-d390-43b4-af1b-7ae57d434968 None None] MFA Rules not processed for user `fcd5e95467b44175be2478c2c7c89926`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:00.093123 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-0b889b3f-d390-43b4-af1b-7ae57d434968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:00.129929 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa5b864-3e9b-46c3-9eb0-cb6cfa459b07 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:00.139047 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5436a19d-d7b0-41c5-b67a-ddf63727bb1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:00.139687 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5436a19d-d7b0-41c5-b67a-ddf63727bb1f service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:00.139969 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5436a19d-d7b0-41c5-b67a-ddf63727bb1f service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:00.141076 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5436a19d-d7b0-41c5-b67a-ddf63727bb1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:00.168525 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5436a19d-d7b0-41c5-b67a-ddf63727bb1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:00.170001 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5436a19d-d7b0-41c5-b67a-ddf63727bb1f service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:00.209305 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 827/1643] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:29:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:30:00.212683 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 817/1644] 10.222.0.26 () {58 vars in 1059 bytes} [Fri Aug 12 01:30:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:00.219801 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f180c077-554c-4f7a-9e41-bca197611ec8 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:00.220904 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f180c077-554c-4f7a-9e41-bca197611ec8 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:00.221393 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f180c077-554c-4f7a-9e41-bca197611ec8 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:00.223573 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 828/1645] 10.222.0.26 () {54 vars in 912 bytes} [Fri Aug 12 01:30:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:30:00.229728 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1dddc-b6f7-4dfd-b27c-af3a6174d098 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:00.230066 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1dddc-b6f7-4dfd-b27c-af3a6174d098 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:00.230385 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1dddc-b6f7-4dfd-b27c-af3a6174d098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:00.254227 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-7bc1dddc-b6f7-4dfd-b27c-af3a6174d098 None None] MFA Rules not processed for user `fcd5e95467b44175be2478c2c7c89926`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:00.255503 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-7bc1dddc-b6f7-4dfd-b27c-af3a6174d098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:00.278426 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 818/1646] 10.222.0.26 () {58 vars in 1009 bytes} [Fri Aug 12 01:30:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:00.287085 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f180c077-554c-4f7a-9e41-bca197611ec8 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:00.289575 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-f180c077-554c-4f7a-9e41-bca197611ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:00.375920 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f180c077-554c-4f7a-9e41-bca197611ec8 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:00.381350 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c76213a-7e8b-4907-b7d6-03d5fd77e2c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7853d40c29af424c8d7913950d89750b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:00.382524 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c76213a-7e8b-4907-b7d6-03d5fd77e2c0 service cinder] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:00.383890 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c76213a-7e8b-4907-b7d6-03d5fd77e2c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:00.384270 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c76213a-7e8b-4907-b7d6-03d5fd77e2c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:00.400182 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c76213a-7e8b-4907-b7d6-03d5fd77e2c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:00.402157 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c76213a-7e8b-4907-b7d6-03d5fd77e2c0 service cinder] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:00.432864 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 829/1647] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:30:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 01:30:02.287532 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc1dddc-b6f7-4dfd-b27c-af3a6174d098 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:02.291071 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-7bc1dddc-b6f7-4dfd-b27c-af3a6174d098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:02.330720 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc1dddc-b6f7-4dfd-b27c-af3a6174d098 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:02.337445 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e19f0cd-86d0-4bdc-b72e-d291186296d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:02.339142 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19f0cd-86d0-4bdc-b72e-d291186296d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:02.339712 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19f0cd-86d0-4bdc-b72e-d291186296d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:02.341163 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19f0cd-86d0-4bdc-b72e-d291186296d5 admin admin] PATH_INFO: `/v3/projects/17eb9458e7fd4b90b2f1960e6c7a1dfb` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:02.343508 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e19f0cd-86d0-4bdc-b72e-d291186296d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17eb9458e7fd4b90b2f1960e6c7a1dfb)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:02.344823 dv-cinder-784815-15-smb devstack@keystone.service[81554]: WARNING py.warnings [None req-0e19f0cd-86d0-4bdc-b72e-d291186296d5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 12 01:30:02.344823 dv-cinder-784815-15-smb devstack@keystone.service[81554]: warnings.warn(msg) Aug 12 01:30:02.344823 dv-cinder-784815-15-smb devstack@keystone.service[81554]: Aug 12 01:30:02.347709 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e19f0cd-86d0-4bdc-b72e-d291186296d5 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:02.511644 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68996c9a-ffb4-45f0-902b-2706d8b1b72b None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:02.512837 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68996c9a-ffb4-45f0-902b-2706d8b1b72b None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:02.516048 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68996c9a-ffb4-45f0-902b-2706d8b1b72b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:02.567998 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-0e19f0cd-86d0-4bdc-b72e-d291186296d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17eb9458e7fd4b90b2f1960e6c7a1dfb', 'request_id': 'req-0e19f0cd-86d0-4bdc-b72e-d291186296d5'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:02.583988 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-0e19f0cd-86d0-4bdc-b72e-d291186296d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17eb9458e7fd4b90b2f1960e6c7a1dfb', 'request_id': 'req-0e19f0cd-86d0-4bdc-b72e-d291186296d5'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:02.592837 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-0e19f0cd-86d0-4bdc-b72e-d291186296d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17eb9458e7fd4b90b2f1960e6c7a1dfb', 'request_id': 'req-0e19f0cd-86d0-4bdc-b72e-d291186296d5'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:02.598513 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-68996c9a-ffb4-45f0-902b-2706d8b1b72b None None] MFA Rules not processed for user `04bb1a772b004b1394c19d9dbd306cb0`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:02.600352 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-68996c9a-ffb4-45f0-902b-2706d8b1b72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:02.629290 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-0e19f0cd-86d0-4bdc-b72e-d291186296d5 admin admin] The token cache is being invalidate because project 17eb9458e7fd4b90b2f1960e6c7a1dfb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:30:02.629662 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-0e19f0cd-86d0-4bdc-b72e-d291186296d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:02.631536 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-0e19f0cd-86d0-4bdc-b72e-d291186296d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:02.637319 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 819/1648] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:30:02 2022] DELETE /identity/v3/projects/17eb9458e7fd4b90b2f1960e6c7a1dfb => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:30:02.641904 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e19f0cd-86d0-4bdc-b72e-d291186296d5 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:02.646984 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-0e19f0cd-86d0-4bdc-b72e-d291186296d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:02.656890 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:02.681181 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:02.763578 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 830/1649] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:30:02 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:02.777136 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68996c9a-ffb4-45f0-902b-2706d8b1b72b None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:02.779118 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-68996c9a-ffb4-45f0-902b-2706d8b1b72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:02.804911 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e19f0cd-86d0-4bdc-b72e-d291186296d5 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:02.816668 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7b60dc-63b9-45ea-b4af-bae5fabcf360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:02.818880 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b60dc-63b9-45ea-b4af-bae5fabcf360 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:02.819419 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b60dc-63b9-45ea-b4af-bae5fabcf360 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:02.820393 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b60dc-63b9-45ea-b4af-bae5fabcf360 admin admin] PATH_INFO: `/v3/users/c90e57c59c5e4386a21b6367394f72c6` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:02.823304 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7b60dc-63b9-45ea-b4af-bae5fabcf360 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c90e57c59c5e4386a21b6367394f72c6)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:02.826526 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7b60dc-63b9-45ea-b4af-bae5fabcf360 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:02.921962 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ce7b60dc-63b9-45ea-b4af-bae5fabcf360 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c90e57c59c5e4386a21b6367394f72c6'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:02.937256 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ce7b60dc-63b9-45ea-b4af-bae5fabcf360 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c90e57c59c5e4386a21b6367394f72c6'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:02.938032 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ce7b60dc-63b9-45ea-b4af-bae5fabcf360 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c90e57c59c5e4386a21b6367394f72c6'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:02.952259 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ce7b60dc-63b9-45ea-b4af-bae5fabcf360 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c90e57c59c5e4386a21b6367394f72c6'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:02.958344 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68996c9a-ffb4-45f0-902b-2706d8b1b72b None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:02.976301 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e85204-cd5b-4b5f-9d96-2d4cfcd11b6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd5e95467b44175be2478c2c7c89926', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:02.977428 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e85204-cd5b-4b5f-9d96-2d4cfcd11b6d service nova] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:02.978320 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e85204-cd5b-4b5f-9d96-2d4cfcd11b6d service nova] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:02.978588 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e85204-cd5b-4b5f-9d96-2d4cfcd11b6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:02.983994 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-13e85204-cd5b-4b5f-9d96-2d4cfcd11b6d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:02.987416 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ce7b60dc-63b9-45ea-b4af-bae5fabcf360 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c90e57c59c5e4386a21b6367394f72c6'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:03.002036 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 820/1650] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:30:02 2022] DELETE /identity/v3/users/c90e57c59c5e4386a21b6367394f72c6 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:30:03.010082 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e85204-cd5b-4b5f-9d96-2d4cfcd11b6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:03.015731 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e85204-cd5b-4b5f-9d96-2d4cfcd11b6d service nova] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:03.030002 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 831/1651] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:30:02 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:30:03.750689 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7b60dc-63b9-45ea-b4af-bae5fabcf360 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:03.753017 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-ce7b60dc-63b9-45ea-b4af-bae5fabcf360 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:04.023736 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7b60dc-63b9-45ea-b4af-bae5fabcf360 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:04.045728 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6382dd94-301f-417b-a983-714874f8957f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:04.046444 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382dd94-301f-417b-a983-714874f8957f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:04.046719 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382dd94-301f-417b-a983-714874f8957f admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:04.046990 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382dd94-301f-417b-a983-714874f8957f admin admin] PATH_INFO: `/v3/users/c5a9046c41e7479eb3c29b3f50f6f83f` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:04.049864 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6382dd94-301f-417b-a983-714874f8957f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5a9046c41e7479eb3c29b3f50f6f83f)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:04.056266 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6382dd94-301f-417b-a983-714874f8957f admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:04.157394 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:04.202702 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-6382dd94-301f-417b-a983-714874f8957f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5a9046c41e7479eb3c29b3f50f6f83f'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:04.233568 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-6382dd94-301f-417b-a983-714874f8957f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5a9046c41e7479eb3c29b3f50f6f83f'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:04.233568 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-6382dd94-301f-417b-a983-714874f8957f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5a9046c41e7479eb3c29b3f50f6f83f'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:04.242730 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-6382dd94-301f-417b-a983-714874f8957f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5a9046c41e7479eb3c29b3f50f6f83f'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:04.258722 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-6382dd94-301f-417b-a983-714874f8957f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5a9046c41e7479eb3c29b3f50f6f83f'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:04.277485 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 821/1652] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:30:03 2022] DELETE /identity/v3/users/c5a9046c41e7479eb3c29b3f50f6f83f => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:30:04.281740 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6443a1-6c03-493d-9f94-fcabfe08ed16 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:04.282261 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6443a1-6c03-493d-9f94-fcabfe08ed16 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:04.282755 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6443a1-6c03-493d-9f94-fcabfe08ed16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:04.307820 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-4f6443a1-6c03-493d-9f94-fcabfe08ed16 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:04.310041 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-4f6443a1-6c03-493d-9f94-fcabfe08ed16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:04.507713 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 832/1653] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:30:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:04.591683 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6382dd94-301f-417b-a983-714874f8957f admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:04.593521 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-6382dd94-301f-417b-a983-714874f8957f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:04.741044 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6443a1-6c03-493d-9f94-fcabfe08ed16 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:04.743738 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-4f6443a1-6c03-493d-9f94-fcabfe08ed16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:04.783509 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6443a1-6c03-493d-9f94-fcabfe08ed16 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:04.796120 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6382dd94-301f-417b-a983-714874f8957f admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:04.799946 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c2b4d8-ab18-4cc7-bac1-61270e972197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:04.800608 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2b4d8-ab18-4cc7-bac1-61270e972197 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:04.800880 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2b4d8-ab18-4cc7-bac1-61270e972197 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:04.801147 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2b4d8-ab18-4cc7-bac1-61270e972197 admin admin] PATH_INFO: `/v3/projects/3468dd058c474ff5957a2774145536d6` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:04.812499 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c2b4d8-ab18-4cc7-bac1-61270e972197 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3468dd058c474ff5957a2774145536d6)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:04.813359 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d05d3e3-82b2-4a90-aba0-a79ad9a0d28c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:04.816583 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d05d3e3-82b2-4a90-aba0-a79ad9a0d28c service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:04.817240 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d05d3e3-82b2-4a90-aba0-a79ad9a0d28c service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:04.818754 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d05d3e3-82b2-4a90-aba0-a79ad9a0d28c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:04.824031 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c2b4d8-ab18-4cc7-bac1-61270e972197 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:04.870298 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d05d3e3-82b2-4a90-aba0-a79ad9a0d28c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:04.873680 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d05d3e3-82b2-4a90-aba0-a79ad9a0d28c service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:04.927032 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 822/1654] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:30:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:30:05.056394 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-e7c2b4d8-ab18-4cc7-bac1-61270e972197 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3468dd058c474ff5957a2774145536d6', 'request_id': 'req-e7c2b4d8-ab18-4cc7-bac1-61270e972197'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:05.060956 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:05.078402 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-e7c2b4d8-ab18-4cc7-bac1-61270e972197 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3468dd058c474ff5957a2774145536d6', 'request_id': 'req-e7c2b4d8-ab18-4cc7-bac1-61270e972197'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:05.111521 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-e7c2b4d8-ab18-4cc7-bac1-61270e972197 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3468dd058c474ff5957a2774145536d6', 'request_id': 'req-e7c2b4d8-ab18-4cc7-bac1-61270e972197'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:05.189059 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-e7c2b4d8-ab18-4cc7-bac1-61270e972197 admin admin] The token cache is being invalidate because project 3468dd058c474ff5957a2774145536d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:30:05.189749 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-e7c2b4d8-ab18-4cc7-bac1-61270e972197 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:05.190788 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-e7c2b4d8-ab18-4cc7-bac1-61270e972197 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:05.193794 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 833/1655] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:30:04 2022] DELETE /identity/v3/projects/3468dd058c474ff5957a2774145536d6 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:30:05.200937 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f56c5f-0aca-4dbc-b541-9f5e8226e275 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:05.201554 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f56c5f-0aca-4dbc-b541-9f5e8226e275 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:05.205634 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f56c5f-0aca-4dbc-b541-9f5e8226e275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:05.253223 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-82f56c5f-0aca-4dbc-b541-9f5e8226e275 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:05.257060 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-82f56c5f-0aca-4dbc-b541-9f5e8226e275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:05.436224 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 823/1656] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:30:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:05.441254 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e189f4ef-1d84-4352-b68c-6a5f9b7c3a77 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:05.441806 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e189f4ef-1d84-4352-b68c-6a5f9b7c3a77 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:05.441947 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e189f4ef-1d84-4352-b68c-6a5f9b7c3a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:05.500492 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-e189f4ef-1d84-4352-b68c-6a5f9b7c3a77 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:05.507595 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-e189f4ef-1d84-4352-b68c-6a5f9b7c3a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:05.539715 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 834/1657] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:30:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:05.545499 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f56c5f-0aca-4dbc-b541-9f5e8226e275 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:05.560098 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f56c5f-0aca-4dbc-b541-9f5e8226e275 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:05.580462 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99872b7-ee3d-43fd-9193-e03172570315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:05.581160 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99872b7-ee3d-43fd-9193-e03172570315 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:05.581436 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99872b7-ee3d-43fd-9193-e03172570315 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:05.581705 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99872b7-ee3d-43fd-9193-e03172570315 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:05.582390 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99872b7-ee3d-43fd-9193-e03172570315 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:30:05.582685 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99872b7-ee3d-43fd-9193-e03172570315 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:05.605058 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99872b7-ee3d-43fd-9193-e03172570315 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:05.661024 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e189f4ef-1d84-4352-b68c-6a5f9b7c3a77 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:05.662237 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 824/1658] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 01:30:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:30:05.674144 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e189f4ef-1d84-4352-b68c-6a5f9b7c3a77 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:05.707952 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4590685f-42bd-4b15-b44e-84ee626aa2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:05.749715 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4590685f-42bd-4b15-b44e-84ee626aa2f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:05.751977 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4590685f-42bd-4b15-b44e-84ee626aa2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:05.754072 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4590685f-42bd-4b15-b44e-84ee626aa2f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:05.759601 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4590685f-42bd-4b15-b44e-84ee626aa2f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:05.775619 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4590685f-42bd-4b15-b44e-84ee626aa2f2 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:05.921688 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 835/1659] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:30:05 2022] POST /identity/v3/projects => generated 367 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 01:30:05.927611 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99872b7-ee3d-43fd-9193-e03172570315 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:05.953768 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99872b7-ee3d-43fd-9193-e03172570315 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:06.056363 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:06.144180 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a949d1-3e86-48d5-a831-835c50689211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:06.145799 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a949d1-3e86-48d5-a831-835c50689211 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:06.146428 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a949d1-3e86-48d5-a831-835c50689211 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:06.146770 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a949d1-3e86-48d5-a831-835c50689211 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:06.150333 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a949d1-3e86-48d5-a831-835c50689211 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:06.152565 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a949d1-3e86-48d5-a831-835c50689211 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:06.200870 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4590685f-42bd-4b15-b44e-84ee626aa2f2 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:06.209717 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 825/1660] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:30:05 2022] POST /identity/v3/users => generated 284 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:30:06.219743 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4590685f-42bd-4b15-b44e-84ee626aa2f2 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:06.234315 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a34411c-31fc-4446-9392-7ba6d490718b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:06.238310 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34411c-31fc-4446-9392-7ba6d490718b admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:06.238721 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34411c-31fc-4446-9392-7ba6d490718b admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:06.239001 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34411c-31fc-4446-9392-7ba6d490718b admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:06.239707 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a34411c-31fc-4446-9392-7ba6d490718b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:06.246449 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a34411c-31fc-4446-9392-7ba6d490718b admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:06.277962 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 836/1661] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:30:06 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:30:06.278431 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a949d1-3e86-48d5-a831-835c50689211 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:06.295330 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a949d1-3e86-48d5-a831-835c50689211 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:06.305703 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64271973-912e-49fc-a2a7-15b44ed09d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:06.306980 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64271973-912e-49fc-a2a7-15b44ed09d12 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:06.307434 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64271973-912e-49fc-a2a7-15b44ed09d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:06.307782 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64271973-912e-49fc-a2a7-15b44ed09d12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:06.309246 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64271973-912e-49fc-a2a7-15b44ed09d12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:06.310466 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64271973-912e-49fc-a2a7-15b44ed09d12 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:06.345536 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 826/1662] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:30:06 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:30:06.347815 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a34411c-31fc-4446-9392-7ba6d490718b admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:06.368472 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a34411c-31fc-4446-9392-7ba6d490718b admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:06.374195 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfe276d-d31d-410a-97ec-1eba8640228d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:06.375205 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe276d-d31d-410a-97ec-1eba8640228d admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:06.375756 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe276d-d31d-410a-97ec-1eba8640228d admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:06.376377 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe276d-d31d-410a-97ec-1eba8640228d admin admin] PATH_INFO: `/v3/projects/5a07d6bc099a4dd2869c6ad3aee3a218/users/40d19df489eb443183cd69b01da30dda/roles/13af81971c1c428eae0a571a22ea583d` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:06.403879 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfe276d-d31d-410a-97ec-1eba8640228d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a07d6bc099a4dd2869c6ad3aee3a218, user_id=40d19df489eb443183cd69b01da30dda, role_id=13af81971c1c428eae0a571a22ea583d)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:06.406969 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfe276d-d31d-410a-97ec-1eba8640228d admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:06.442301 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 837/1663] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:30:06 2022] PUT /identity/v3/projects/5a07d6bc099a4dd2869c6ad3aee3a218/users/40d19df489eb443183cd69b01da30dda/roles/13af81971c1c428eae0a571a22ea583d => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:30:06.444440 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9906c6-3881-40a6-a3bf-fcc9c1b53a06 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:06.444821 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9906c6-3881-40a6-a3bf-fcc9c1b53a06 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:06.445189 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9906c6-3881-40a6-a3bf-fcc9c1b53a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:06.508267 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-fd9906c6-3881-40a6-a3bf-fcc9c1b53a06 None None] MFA Rules not processed for user `40d19df489eb443183cd69b01da30dda`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:06.512084 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-fd9906c6-3881-40a6-a3bf-fcc9c1b53a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:06.616222 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfe276d-d31d-410a-97ec-1eba8640228d admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:06.618806 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 827/1664] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:30:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:06.707289 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfe276d-d31d-410a-97ec-1eba8640228d admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:06.714704 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdea6fb7-7be4-4911-b69e-bb2c304da37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:06.715691 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdea6fb7-7be4-4911-b69e-bb2c304da37e admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:06.716059 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdea6fb7-7be4-4911-b69e-bb2c304da37e admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:06.716558 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdea6fb7-7be4-4911-b69e-bb2c304da37e admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:06.717557 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdea6fb7-7be4-4911-b69e-bb2c304da37e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:06.720747 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdea6fb7-7be4-4911-b69e-bb2c304da37e admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:06.772127 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 838/1665] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:30:06 2022] POST /identity/v3/projects => generated 369 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:30:06.774260 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9906c6-3881-40a6-a3bf-fcc9c1b53a06 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:06.789275 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9906c6-3881-40a6-a3bf-fcc9c1b53a06 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:06.883717 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8cdaa1-21aa-4112-be7f-e20511bd5a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:06.884426 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8cdaa1-21aa-4112-be7f-e20511bd5a2d admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:06.884712 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8cdaa1-21aa-4112-be7f-e20511bd5a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:06.884991 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8cdaa1-21aa-4112-be7f-e20511bd5a2d admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:06.885870 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8cdaa1-21aa-4112-be7f-e20511bd5a2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:06.892823 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8cdaa1-21aa-4112-be7f-e20511bd5a2d admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:06.957069 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdea6fb7-7be4-4911-b69e-bb2c304da37e admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:06.965158 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 828/1666] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:30:06 2022] POST /identity/v3/users => generated 291 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:30:06.973250 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdea6fb7-7be4-4911-b69e-bb2c304da37e admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:06.981312 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a73b51-90d0-4fe1-85db-630b2ee0db57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:06.982639 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a73b51-90d0-4fe1-85db-630b2ee0db57 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:06.983343 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a73b51-90d0-4fe1-85db-630b2ee0db57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:06.983716 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a73b51-90d0-4fe1-85db-630b2ee0db57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:06.985848 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a73b51-90d0-4fe1-85db-630b2ee0db57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:06.988458 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a73b51-90d0-4fe1-85db-630b2ee0db57 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:07.014706 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8cdaa1-21aa-4112-be7f-e20511bd5a2d admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:07.016409 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 839/1667] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:30:06 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:30:07.025961 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8cdaa1-21aa-4112-be7f-e20511bd5a2d admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:07.038796 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f1a9bc-e48f-4100-b5c2-583edccd4457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:07.039717 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f1a9bc-e48f-4100-b5c2-583edccd4457 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:07.039717 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f1a9bc-e48f-4100-b5c2-583edccd4457 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:07.040028 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f1a9bc-e48f-4100-b5c2-583edccd4457 admin admin] PATH_INFO: `/v3/projects/2d2d3efbd2c24dbab698db31abaeceba/users/7e2fa60501b249f1bdc85ae51ee12242/roles/fb48693810be495fb4b1893a79429b78` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:07.082782 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f1a9bc-e48f-4100-b5c2-583edccd4457 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d2d3efbd2c24dbab698db31abaeceba, user_id=7e2fa60501b249f1bdc85ae51ee12242, role_id=fb48693810be495fb4b1893a79429b78)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:07.085658 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f1a9bc-e48f-4100-b5c2-583edccd4457 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:07.116219 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 829/1668] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:30:07 2022] PUT /identity/v3/projects/2d2d3efbd2c24dbab698db31abaeceba/users/7e2fa60501b249f1bdc85ae51ee12242/roles/fb48693810be495fb4b1893a79429b78 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 01:30:07.122867 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a73b51-90d0-4fe1-85db-630b2ee0db57 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:07.137376 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a73b51-90d0-4fe1-85db-630b2ee0db57 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:07.275979 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f1a9bc-e48f-4100-b5c2-583edccd4457 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:07.278020 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-03f1a9bc-e48f-4100-b5c2-583edccd4457 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:07.285293 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:07.312387 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:07.350903 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cb4139-2a46-4ca2-86fa-585f940d5146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:07.353688 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb4139-2a46-4ca2-86fa-585f940d5146 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:07.356272 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb4139-2a46-4ca2-86fa-585f940d5146 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:07.356746 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb4139-2a46-4ca2-86fa-585f940d5146 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:07.358143 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cb4139-2a46-4ca2-86fa-585f940d5146 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:07.361439 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cb4139-2a46-4ca2-86fa-585f940d5146 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:07.404854 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 840/1669] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:30:07 2022] GET /identity/v3/roles => generated 1420 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:30:07.410322 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cb4139-2a46-4ca2-86fa-585f940d5146 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:07.415976 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f1a9bc-e48f-4100-b5c2-583edccd4457 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:07.429469 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e25e2e5-594a-444c-b4a0-8b672ac849c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:07.431634 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e25e2e5-594a-444c-b4a0-8b672ac849c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:07.432242 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e25e2e5-594a-444c-b4a0-8b672ac849c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:07.432684 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e25e2e5-594a-444c-b4a0-8b672ac849c1 admin admin] PATH_INFO: `/v3/projects/2a8cc09a214f42e3bcc1a105f450c07d` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:07.434318 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e25e2e5-594a-444c-b4a0-8b672ac849c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a8cc09a214f42e3bcc1a105f450c07d)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:07.435230 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cb4139-2a46-4ca2-86fa-585f940d5146 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:07.436702 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e25e2e5-594a-444c-b4a0-8b672ac849c1 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:07.440811 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a37545-0769-4c22-9922-7996d19679a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:07.441561 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a37545-0769-4c22-9922-7996d19679a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:07.442216 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a37545-0769-4c22-9922-7996d19679a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:07.442599 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a37545-0769-4c22-9922-7996d19679a6 admin admin] PATH_INFO: `/v3/projects/2d2d3efbd2c24dbab698db31abaeceba/users/7e2fa60501b249f1bdc85ae51ee12242/roles/fb48693810be495fb4b1893a79429b78` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:07.445183 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a37545-0769-4c22-9922-7996d19679a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d2d3efbd2c24dbab698db31abaeceba, user_id=7e2fa60501b249f1bdc85ae51ee12242, role_id=fb48693810be495fb4b1893a79429b78)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:07.449465 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a37545-0769-4c22-9922-7996d19679a6 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:07.473453 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 841/1670] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:30:07 2022] PUT /identity/v3/projects/2d2d3efbd2c24dbab698db31abaeceba/users/7e2fa60501b249f1bdc85ae51ee12242/roles/fb48693810be495fb4b1893a79429b78 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:30:07.479812 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044a59d3-51fb-4c50-b3c5-4b825ac04dae None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:07.479812 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044a59d3-51fb-4c50-b3c5-4b825ac04dae None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:07.479812 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044a59d3-51fb-4c50-b3c5-4b825ac04dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:07.525317 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-044a59d3-51fb-4c50-b3c5-4b825ac04dae None None] MFA Rules not processed for user `7e2fa60501b249f1bdc85ae51ee12242`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:07.527909 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-044a59d3-51fb-4c50-b3c5-4b825ac04dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:07.557465 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-2e25e2e5-594a-444c-b4a0-8b672ac849c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a8cc09a214f42e3bcc1a105f450c07d', 'request_id': 'req-2e25e2e5-594a-444c-b4a0-8b672ac849c1'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:07.576859 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-2e25e2e5-594a-444c-b4a0-8b672ac849c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a8cc09a214f42e3bcc1a105f450c07d', 'request_id': 'req-2e25e2e5-594a-444c-b4a0-8b672ac849c1'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:07.586875 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-2e25e2e5-594a-444c-b4a0-8b672ac849c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a8cc09a214f42e3bcc1a105f450c07d', 'request_id': 'req-2e25e2e5-594a-444c-b4a0-8b672ac849c1'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:07.616919 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-2e25e2e5-594a-444c-b4a0-8b672ac849c1 admin admin] The token cache is being invalidate because project 2a8cc09a214f42e3bcc1a105f450c07d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:30:07.617266 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-2e25e2e5-594a-444c-b4a0-8b672ac849c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:07.618575 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-2e25e2e5-594a-444c-b4a0-8b672ac849c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:07.623826 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 830/1671] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:30:07 2022] DELETE /identity/v3/projects/2a8cc09a214f42e3bcc1a105f450c07d => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:30:07.629684 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98147ed9-31d8-4476-9199-4ee1fbe7fb1f None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:07.629978 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98147ed9-31d8-4476-9199-4ee1fbe7fb1f None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:07.630383 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98147ed9-31d8-4476-9199-4ee1fbe7fb1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:07.694761 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-98147ed9-31d8-4476-9199-4ee1fbe7fb1f None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:07.700792 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-98147ed9-31d8-4476-9199-4ee1fbe7fb1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:07.724664 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 842/1672] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:30:07 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 01:30:07.744864 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044a59d3-51fb-4c50-b3c5-4b825ac04dae None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:07.748408 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-044a59d3-51fb-4c50-b3c5-4b825ac04dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:07.846867 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 831/1673] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:30:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:07.855495 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c9e823-b8ca-4717-9753-d27d2f5b057a None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:07.855857 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c9e823-b8ca-4717-9753-d27d2f5b057a None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:07.856111 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c9e823-b8ca-4717-9753-d27d2f5b057a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:07.901578 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-52c9e823-b8ca-4717-9753-d27d2f5b057a None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:07.905510 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-52c9e823-b8ca-4717-9753-d27d2f5b057a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:07.915463 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044a59d3-51fb-4c50-b3c5-4b825ac04dae None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:07.922269 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba1bb5d-77e6-497e-aeec-96698f01ed91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7853d40c29af424c8d7913950d89750b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:07.923527 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba1bb5d-77e6-497e-aeec-96698f01ed91 service cinder] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:07.924054 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba1bb5d-77e6-497e-aeec-96698f01ed91 service cinder] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:07.924519 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba1bb5d-77e6-497e-aeec-96698f01ed91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:07.938079 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba1bb5d-77e6-497e-aeec-96698f01ed91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:07.940170 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba1bb5d-77e6-497e-aeec-96698f01ed91 service cinder] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:07.940526 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 832/1674] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:30:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:07.946226 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e50cf0-7d11-4701-9fbc-ab7c192697ca None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:07.946516 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e50cf0-7d11-4701-9fbc-ab7c192697ca None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:07.946797 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e50cf0-7d11-4701-9fbc-ab7c192697ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:07.963146 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 843/1675] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:30:07 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 01:30:07.964746 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba1bb5d-77e6-497e-aeec-96698f01ed91 service cinder] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:07.978415 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba1bb5d-77e6-497e-aeec-96698f01ed91 service cinder] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:07.994148 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe36a909-55ea-407b-8ea3-853f2ffe9a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:07.994907 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe36a909-55ea-407b-8ea3-853f2ffe9a7f admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:07.995330 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe36a909-55ea-407b-8ea3-853f2ffe9a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:07.995797 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe36a909-55ea-407b-8ea3-853f2ffe9a7f admin admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:07.996482 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe36a909-55ea-407b-8ea3-853f2ffe9a7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:30:07.996844 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe36a909-55ea-407b-8ea3-853f2ffe9a7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:08.000964 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe36a909-55ea-407b-8ea3-853f2ffe9a7f admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:08.016478 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-10e50cf0-7d11-4701-9fbc-ab7c192697ca None None] MFA Rules not processed for user `04bb1a772b004b1394c19d9dbd306cb0`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:08.020284 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-10e50cf0-7d11-4701-9fbc-ab7c192697ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:08.040179 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 844/1676] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 01:30:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:30:08.047209 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe36a909-55ea-407b-8ea3-853f2ffe9a7f admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:08.086905 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:08.088983 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe36a909-55ea-407b-8ea3-853f2ffe9a7f admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:08.094070 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072081bb-3aa4-475e-b41f-cbf666a62188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:08.095100 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072081bb-3aa4-475e-b41f-cbf666a62188 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:08.095383 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072081bb-3aa4-475e-b41f-cbf666a62188 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:08.095690 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072081bb-3aa4-475e-b41f-cbf666a62188 admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:08.096715 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072081bb-3aa4-475e-b41f-cbf666a62188 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:08.098727 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072081bb-3aa4-475e-b41f-cbf666a62188 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:08.147457 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 845/1677] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:30:08 2022] POST /identity/v3/projects => generated 405 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:30:08.151635 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072081bb-3aa4-475e-b41f-cbf666a62188 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:08.172557 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 833/1678] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:30:07 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:08.229618 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:08.476091 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072081bb-3aa4-475e-b41f-cbf666a62188 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:08.523551 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5abce5-6741-424a-a9cc-c515c6bc0e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:08.525650 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5abce5-6741-424a-a9cc-c515c6bc0e24 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:08.526380 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5abce5-6741-424a-a9cc-c515c6bc0e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:08.527051 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5abce5-6741-424a-a9cc-c515c6bc0e24 admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:08.527943 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5abce5-6741-424a-a9cc-c515c6bc0e24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:08.533932 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5abce5-6741-424a-a9cc-c515c6bc0e24 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:08.599269 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 846/1679] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:30:08 2022] POST /identity/v3/users => generated 303 bytes in 448 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:30:08.604744 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e50cf0-7d11-4701-9fbc-ab7c192697ca None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:08.625418 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e50cf0-7d11-4701-9fbc-ab7c192697ca None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:08.655644 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533206a7-7e17-4811-852b-ff86a669137b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:08.660619 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533206a7-7e17-4811-852b-ff86a669137b admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:08.661347 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533206a7-7e17-4811-852b-ff86a669137b admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:08.664063 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533206a7-7e17-4811-852b-ff86a669137b admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:08.665591 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533206a7-7e17-4811-852b-ff86a669137b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:08.671813 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533206a7-7e17-4811-852b-ff86a669137b admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:08.702259 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 834/1680] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 01:30:08.706614 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5abce5-6741-424a-a9cc-c515c6bc0e24 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:08.722475 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5abce5-6741-424a-a9cc-c515c6bc0e24 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:08.741065 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334c73fc-e386-4186-8270-7491192c388b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:08.745398 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c73fc-e386-4186-8270-7491192c388b admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:08.745769 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c73fc-e386-4186-8270-7491192c388b admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:08.746058 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c73fc-e386-4186-8270-7491192c388b admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:08.751445 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334c73fc-e386-4186-8270-7491192c388b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:08.753974 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334c73fc-e386-4186-8270-7491192c388b admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:08.785235 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 847/1681] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:30:08.799058 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533206a7-7e17-4811-852b-ff86a669137b admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:08.819802 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533206a7-7e17-4811-852b-ff86a669137b admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:08.836076 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affcfede-c92f-4121-af29-726b92571770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:08.838400 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affcfede-c92f-4121-af29-726b92571770 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:08.838889 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affcfede-c92f-4121-af29-726b92571770 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:08.840040 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affcfede-c92f-4121-af29-726b92571770 admin admin] PATH_INFO: `/v3/projects/390d4f51719446699fdcd052ffaa423a/users/ee478987376b459b885c5386f4cdae25/roles/13af81971c1c428eae0a571a22ea583d` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:08.882955 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affcfede-c92f-4121-af29-726b92571770 admin admin] RBAC: Authorizing `identity:create_grant(project_id=390d4f51719446699fdcd052ffaa423a, user_id=ee478987376b459b885c5386f4cdae25, role_id=13af81971c1c428eae0a571a22ea583d)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:08.890641 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affcfede-c92f-4121-af29-726b92571770 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:08.927385 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 835/1682] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:30:08 2022] PUT /identity/v3/projects/390d4f51719446699fdcd052ffaa423a/users/ee478987376b459b885c5386f4cdae25/roles/13af81971c1c428eae0a571a22ea583d => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:30:08.933430 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d659fac0-5a31-4afd-b4ff-4a2111738f98 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:08.933766 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d659fac0-5a31-4afd-b4ff-4a2111738f98 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:08.934048 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d659fac0-5a31-4afd-b4ff-4a2111738f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:08.988218 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-d659fac0-5a31-4afd-b4ff-4a2111738f98 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:08.992130 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-d659fac0-5a31-4afd-b4ff-4a2111738f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:09.161702 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 848/1683] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:30:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:09.183657 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affcfede-c92f-4121-af29-726b92571770 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:09.185567 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-affcfede-c92f-4121-af29-726b92571770 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:09.295196 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d659fac0-5a31-4afd-b4ff-4a2111738f98 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:09.298497 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-d659fac0-5a31-4afd-b4ff-4a2111738f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:09.320483 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d659fac0-5a31-4afd-b4ff-4a2111738f98 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:09.334611 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0133fc2-48c1-4c86-86f2-9da52f595062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:09.335272 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0133fc2-48c1-4c86-86f2-9da52f595062 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:09.335886 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0133fc2-48c1-4c86-86f2-9da52f595062 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:09.335886 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0133fc2-48c1-4c86-86f2-9da52f595062 admin admin] PATH_INFO: `/v3/users/3368bb14110f4f60a6456584386ec3be` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:09.338010 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0133fc2-48c1-4c86-86f2-9da52f595062 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3368bb14110f4f60a6456584386ec3be)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:09.341088 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0133fc2-48c1-4c86-86f2-9da52f595062 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:09.372732 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affcfede-c92f-4121-af29-726b92571770 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:09.388349 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f924f7-c98f-43db-a1b3-d4634741accc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:09.388349 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f924f7-c98f-43db-a1b3-d4634741accc service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:09.388624 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f924f7-c98f-43db-a1b3-d4634741accc service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:09.388834 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f924f7-c98f-43db-a1b3-d4634741accc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:09.430529 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f924f7-c98f-43db-a1b3-d4634741accc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:09.431525 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-f0133fc2-48c1-4c86-86f2-9da52f595062 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3368bb14110f4f60a6456584386ec3be'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:09.437176 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f924f7-c98f-43db-a1b3-d4634741accc service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:09.449183 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-f0133fc2-48c1-4c86-86f2-9da52f595062 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3368bb14110f4f60a6456584386ec3be'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:09.449947 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-f0133fc2-48c1-4c86-86f2-9da52f595062 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3368bb14110f4f60a6456584386ec3be'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:09.466179 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-f0133fc2-48c1-4c86-86f2-9da52f595062 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3368bb14110f4f60a6456584386ec3be'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:09.497430 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 836/1684] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:30:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:30:09.502638 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-f0133fc2-48c1-4c86-86f2-9da52f595062 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3368bb14110f4f60a6456584386ec3be'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:09.512675 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 849/1685] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:30:09 2022] DELETE /identity/v3/users/3368bb14110f4f60a6456584386ec3be => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:30:09.517163 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f36e7a-ae6d-4f84-8986-6d9d2df95422 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:09.518031 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f36e7a-ae6d-4f84-8986-6d9d2df95422 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:09.518366 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f36e7a-ae6d-4f84-8986-6d9d2df95422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:09.571794 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-f3f36e7a-ae6d-4f84-8986-6d9d2df95422 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:09.573292 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f3f36e7a-ae6d-4f84-8986-6d9d2df95422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:09.674708 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 837/1686] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:30:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:09.751422 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0133fc2-48c1-4c86-86f2-9da52f595062 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:09.754336 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-f0133fc2-48c1-4c86-86f2-9da52f595062 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:09.809123 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:09.846363 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446b7750-35a8-437a-a627-291c6d113e85 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:09.847041 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446b7750-35a8-437a-a627-291c6d113e85 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:09.847460 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446b7750-35a8-437a-a627-291c6d113e85 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:09.849783 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 838/1687] 10.222.0.26 () {54 vars in 912 bytes} [Fri Aug 12 01:30:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 01:30:09.860192 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b76980-9664-4c96-b22c-f287eddadb5f None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:09.860725 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b76980-9664-4c96-b22c-f287eddadb5f None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:09.861201 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b76980-9664-4c96-b22c-f287eddadb5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:09.915011 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0133fc2-48c1-4c86-86f2-9da52f595062 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:09.924905 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82725b4-cb3a-41dc-80e7-b5beb10b5aba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:09.925208 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82725b4-cb3a-41dc-80e7-b5beb10b5aba service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:09.925485 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82725b4-cb3a-41dc-80e7-b5beb10b5aba service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:09.926042 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82725b4-cb3a-41dc-80e7-b5beb10b5aba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:09.952643 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82725b4-cb3a-41dc-80e7-b5beb10b5aba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:09.954218 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82725b4-cb3a-41dc-80e7-b5beb10b5aba service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:09.972429 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 850/1688] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:30:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:30:09.973326 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82725b4-cb3a-41dc-80e7-b5beb10b5aba service neutron] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:09.974704 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-f82725b4-cb3a-41dc-80e7-b5beb10b5aba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:10.007988 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82725b4-cb3a-41dc-80e7-b5beb10b5aba service neutron] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:10.014290 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8664244-2863-46e4-a4cd-f0e883e0455f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:10.014945 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8664244-2863-46e4-a4cd-f0e883e0455f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:10.015227 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8664244-2863-46e4-a4cd-f0e883e0455f admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:10.015508 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8664244-2863-46e4-a4cd-f0e883e0455f admin admin] PATH_INFO: `/v3/users/71cccc67d55f49c4a1ba869a1d75e4e0` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:10.016742 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8664244-2863-46e4-a4cd-f0e883e0455f admin admin] RBAC: Authorizing `identity:delete_user(user_id=71cccc67d55f49c4a1ba869a1d75e4e0)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:10.018880 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8664244-2863-46e4-a4cd-f0e883e0455f admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:10.020748 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-96b76980-9664-4c96-b22c-f287eddadb5f None None] MFA Rules not processed for user `a80678458dc9405285b70da707a399c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:10.023163 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-96b76980-9664-4c96-b22c-f287eddadb5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:10.050242 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 839/1689] 10.222.0.26 () {58 vars in 1009 bytes} [Fri Aug 12 01:30:09 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 01:30:10.122187 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-b8664244-2863-46e4-a4cd-f0e883e0455f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71cccc67d55f49c4a1ba869a1d75e4e0'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:10.149192 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-b8664244-2863-46e4-a4cd-f0e883e0455f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71cccc67d55f49c4a1ba869a1d75e4e0'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:10.151039 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-b8664244-2863-46e4-a4cd-f0e883e0455f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71cccc67d55f49c4a1ba869a1d75e4e0'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:10.165411 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-b8664244-2863-46e4-a4cd-f0e883e0455f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71cccc67d55f49c4a1ba869a1d75e4e0'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:10.192854 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-b8664244-2863-46e4-a4cd-f0e883e0455f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71cccc67d55f49c4a1ba869a1d75e4e0'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:10.205797 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 851/1690] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:30:09 2022] DELETE /identity/v3/users/71cccc67d55f49c4a1ba869a1d75e4e0 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:30:10.210562 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2c3a5-e004-4a84-9686-77183f1b0a77 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:10.211005 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2c3a5-e004-4a84-9686-77183f1b0a77 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:10.211106 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2c3a5-e004-4a84-9686-77183f1b0a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:10.250312 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-c8e2c3a5-e004-4a84-9686-77183f1b0a77 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:10.253113 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c8e2c3a5-e004-4a84-9686-77183f1b0a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:10.292335 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:10.394592 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8664244-2863-46e4-a4cd-f0e883e0455f admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:10.396067 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-b8664244-2863-46e4-a4cd-f0e883e0455f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:10.439089 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 840/1691] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:30:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:10.539353 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8664244-2863-46e4-a4cd-f0e883e0455f admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:10.552021 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5a6fc2-bbe5-4095-9e08-83078774314b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:10.553380 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a6fc2-bbe5-4095-9e08-83078774314b service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:10.555102 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a6fc2-bbe5-4095-9e08-83078774314b service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:10.556355 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a6fc2-bbe5-4095-9e08-83078774314b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:10.563545 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-fa5a6fc2-bbe5-4095-9e08-83078774314b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:10.605414 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5a6fc2-bbe5-4095-9e08-83078774314b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:10.614192 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5a6fc2-bbe5-4095-9e08-83078774314b service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:10.640009 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 852/1692] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:30:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:30:10.664671 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e2c3a5-e004-4a84-9686-77183f1b0a77 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:10.681888 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e2c3a5-e004-4a84-9686-77183f1b0a77 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:10.691667 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41efc8f-6f86-40fd-8c97-e2f6965b3f0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:10.699838 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41efc8f-6f86-40fd-8c97-e2f6965b3f0e service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:10.700191 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41efc8f-6f86-40fd-8c97-e2f6965b3f0e service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:10.700469 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41efc8f-6f86-40fd-8c97-e2f6965b3f0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:10.736325 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41efc8f-6f86-40fd-8c97-e2f6965b3f0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:10.738789 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41efc8f-6f86-40fd-8c97-e2f6965b3f0e service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:10.768147 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 841/1693] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:30:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:30:11.184199 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5a6fc2-bbe5-4095-9e08-83078774314b service neutron] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:11.185655 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-fa5a6fc2-bbe5-4095-9e08-83078774314b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:11.220148 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5a6fc2-bbe5-4095-9e08-83078774314b service neutron] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:11.238936 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d3be3-8778-46d3-b947-1cec8c3ae05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:11.239954 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d3be3-8778-46d3-b947-1cec8c3ae05a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:11.240283 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d3be3-8778-46d3-b947-1cec8c3ae05a admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:11.240624 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d3be3-8778-46d3-b947-1cec8c3ae05a admin admin] PATH_INFO: `/v3/users/40d19df489eb443183cd69b01da30dda` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:11.242828 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0d3be3-8778-46d3-b947-1cec8c3ae05a admin admin] RBAC: Authorizing `identity:delete_user(user_id=40d19df489eb443183cd69b01da30dda)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:11.248757 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0d3be3-8778-46d3-b947-1cec8c3ae05a admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:11.328667 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:11.379609 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-8b0d3be3-8778-46d3-b947-1cec8c3ae05a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40d19df489eb443183cd69b01da30dda'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:11.396969 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-8b0d3be3-8778-46d3-b947-1cec8c3ae05a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40d19df489eb443183cd69b01da30dda'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:11.397608 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-8b0d3be3-8778-46d3-b947-1cec8c3ae05a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40d19df489eb443183cd69b01da30dda'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:11.427332 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-8b0d3be3-8778-46d3-b947-1cec8c3ae05a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40d19df489eb443183cd69b01da30dda'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:11.460314 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-8b0d3be3-8778-46d3-b947-1cec8c3ae05a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40d19df489eb443183cd69b01da30dda'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:11.477710 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 853/1694] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:30:11 2022] DELETE /identity/v3/users/40d19df489eb443183cd69b01da30dda => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:30:11.482986 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc09dccd-31ce-4ee6-bfbf-131a17426d7b None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:11.483544 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc09dccd-31ce-4ee6-bfbf-131a17426d7b None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:11.483544 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc09dccd-31ce-4ee6-bfbf-131a17426d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:11.519450 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-dc09dccd-31ce-4ee6-bfbf-131a17426d7b None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:11.520682 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-dc09dccd-31ce-4ee6-bfbf-131a17426d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:11.613167 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 842/1695] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:30:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:11.652023 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d3be3-8778-46d3-b947-1cec8c3ae05a admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:11.654300 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-8b0d3be3-8778-46d3-b947-1cec8c3ae05a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:11.788233 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d3be3-8778-46d3-b947-1cec8c3ae05a admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:11.794251 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f1e009-8229-4d20-bd14-19a5d6de35e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:11.795008 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1e009-8229-4d20-bd14-19a5d6de35e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:11.795379 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1e009-8229-4d20-bd14-19a5d6de35e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:11.795814 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1e009-8229-4d20-bd14-19a5d6de35e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:11.809742 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f1e009-8229-4d20-bd14-19a5d6de35e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:11.811999 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f1e009-8229-4d20-bd14-19a5d6de35e2 service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:11.850566 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 854/1696] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:30:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:30:12.178198 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ce5fd-5089-419d-a34b-8a93fcf85e46 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:12.178697 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ce5fd-5089-419d-a34b-8a93fcf85e46 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:12.181793 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ce5fd-5089-419d-a34b-8a93fcf85e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:12.264098 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f1e009-8229-4d20-bd14-19a5d6de35e2 service neutron] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:12.269066 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-e2f1e009-8229-4d20-bd14-19a5d6de35e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:12.313244 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f1e009-8229-4d20-bd14-19a5d6de35e2 service neutron] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:12.315002 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-f15ce5fd-5089-419d-a34b-8a93fcf85e46 None None] MFA Rules not processed for user `ee478987376b459b885c5386f4cdae25`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:12.315918 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f15ce5fd-5089-419d-a34b-8a93fcf85e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:12.334042 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec19a1-17b6-4a6f-9bec-a91800441f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:12.334586 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec19a1-17b6-4a6f-9bec-a91800441f76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:12.334928 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec19a1-17b6-4a6f-9bec-a91800441f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:12.336257 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec19a1-17b6-4a6f-9bec-a91800441f76 admin admin] PATH_INFO: `/v3/projects/3332442f651e45b894eddfe67f8efd83` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:12.340651 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ec19a1-17b6-4a6f-9bec-a91800441f76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3332442f651e45b894eddfe67f8efd83)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:12.342894 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ec19a1-17b6-4a6f-9bec-a91800441f76 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:12.500653 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-a1ec19a1-17b6-4a6f-9bec-a91800441f76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3332442f651e45b894eddfe67f8efd83', 'request_id': 'req-a1ec19a1-17b6-4a6f-9bec-a91800441f76'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:12.516528 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 843/1697] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:30:12 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:12.517832 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a22610-d9a1-4f90-9fe4-3addc0002b46 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:12.518176 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a22610-d9a1-4f90-9fe4-3addc0002b46 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:12.518414 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a22610-d9a1-4f90-9fe4-3addc0002b46 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:12.519666 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 844/1698] 10.222.0.26 () {54 vars in 961 bytes} [Fri Aug 12 01:30:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:30:12.522263 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-a1ec19a1-17b6-4a6f-9bec-a91800441f76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3332442f651e45b894eddfe67f8efd83', 'request_id': 'req-a1ec19a1-17b6-4a6f-9bec-a91800441f76'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:12.526851 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a22610-d9a1-4f90-9fe4-3addc0002b46 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:12.531316 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-a1ec19a1-17b6-4a6f-9bec-a91800441f76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3332442f651e45b894eddfe67f8efd83', 'request_id': 'req-a1ec19a1-17b6-4a6f-9bec-a91800441f76'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:12.533282 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-05a22610-d9a1-4f90-9fe4-3addc0002b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:12.552730 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-a1ec19a1-17b6-4a6f-9bec-a91800441f76 admin admin] The token cache is being invalidate because project 3332442f651e45b894eddfe67f8efd83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:30:12.553021 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-a1ec19a1-17b6-4a6f-9bec-a91800441f76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:12.561003 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-a1ec19a1-17b6-4a6f-9bec-a91800441f76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:12.568496 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 855/1699] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:30:12 2022] DELETE /identity/v3/projects/3332442f651e45b894eddfe67f8efd83 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:30:12.569418 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec19a1-17b6-4a6f-9bec-a91800441f76 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:12.572485 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-a1ec19a1-17b6-4a6f-9bec-a91800441f76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:12.657165 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:12.700289 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a22610-d9a1-4f90-9fe4-3addc0002b46 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:12.707175 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691d8c39-8cd6-43cf-b3bc-b6783747796a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:12.711667 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691d8c39-8cd6-43cf-b3bc-b6783747796a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:12.715335 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691d8c39-8cd6-43cf-b3bc-b6783747796a admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:12.716086 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691d8c39-8cd6-43cf-b3bc-b6783747796a admin admin] PATH_INFO: `/v3/projects/7cc9c33e3127466e832730edbb3897a2` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:12.720806 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691d8c39-8cd6-43cf-b3bc-b6783747796a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cc9c33e3127466e832730edbb3897a2)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:12.723144 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691d8c39-8cd6-43cf-b3bc-b6783747796a admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:12.729480 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:12.803392 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec19a1-17b6-4a6f-9bec-a91800441f76 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:12.811401 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ba3e22-1fad-4608-ba28-16890e232309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:12.812532 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba3e22-1fad-4608-ba28-16890e232309 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:12.812989 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba3e22-1fad-4608-ba28-16890e232309 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:12.813336 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba3e22-1fad-4608-ba28-16890e232309 admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:12.814530 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ba3e22-1fad-4608-ba28-16890e232309 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:12.833113 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ba3e22-1fad-4608-ba28-16890e232309 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:12.865431 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-691d8c39-8cd6-43cf-b3bc-b6783747796a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cc9c33e3127466e832730edbb3897a2', 'request_id': 'req-691d8c39-8cd6-43cf-b3bc-b6783747796a'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:12.886597 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 856/1700] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:30:12 2022] POST /identity/v3/projects => generated 403 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:30:12.888376 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-691d8c39-8cd6-43cf-b3bc-b6783747796a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cc9c33e3127466e832730edbb3897a2', 'request_id': 'req-691d8c39-8cd6-43cf-b3bc-b6783747796a'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:12.890661 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9598e6-7021-40b3-831f-30fbbcbc4bba None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:12.891611 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9598e6-7021-40b3-831f-30fbbcbc4bba None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:12.892111 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9598e6-7021-40b3-831f-30fbbcbc4bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:12.899588 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-691d8c39-8cd6-43cf-b3bc-b6783747796a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cc9c33e3127466e832730edbb3897a2', 'request_id': 'req-691d8c39-8cd6-43cf-b3bc-b6783747796a'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:12.925230 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-691d8c39-8cd6-43cf-b3bc-b6783747796a admin admin] The token cache is being invalidate because project 7cc9c33e3127466e832730edbb3897a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:30:12.925581 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-691d8c39-8cd6-43cf-b3bc-b6783747796a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:12.927208 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-4c9598e6-7021-40b3-831f-30fbbcbc4bba None None] MFA Rules not processed for user `06dccf61c686414d904bdf1ecf19d53d`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:12.928448 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-4c9598e6-7021-40b3-831f-30fbbcbc4bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:12.929554 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-691d8c39-8cd6-43cf-b3bc-b6783747796a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:12.935860 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 845/1701] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:30:12 2022] DELETE /identity/v3/projects/7cc9c33e3127466e832730edbb3897a2 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:30:12.937502 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691d8c39-8cd6-43cf-b3bc-b6783747796a admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:12.943961 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-691d8c39-8cd6-43cf-b3bc-b6783747796a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:13.146342 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 857/1702] 10.222.0.26 () {58 vars in 1058 bytes} [Fri Aug 12 01:30:12 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:13.147298 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9598e6-7021-40b3-831f-30fbbcbc4bba None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:13.149586 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-4c9598e6-7021-40b3-831f-30fbbcbc4bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:13.165420 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691d8c39-8cd6-43cf-b3bc-b6783747796a admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:13.300245 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37906bff-df43-4cb8-866f-f5a891926b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:13.301334 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37906bff-df43-4cb8-866f-f5a891926b06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:13.301619 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37906bff-df43-4cb8-866f-f5a891926b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:13.301992 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37906bff-df43-4cb8-866f-f5a891926b06 admin admin] PATH_INFO: `/v3/users/627c7e9361cc49488db949b261da143a` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:13.303763 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37906bff-df43-4cb8-866f-f5a891926b06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=627c7e9361cc49488db949b261da143a)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:13.305890 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37906bff-df43-4cb8-866f-f5a891926b06 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:13.349953 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9598e6-7021-40b3-831f-30fbbcbc4bba None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:13.353426 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:13.359277 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9764781-21e4-48da-8ad3-2c7c9fe6836b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:13.360744 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9764781-21e4-48da-8ad3-2c7c9fe6836b admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:13.360855 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9764781-21e4-48da-8ad3-2c7c9fe6836b admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:13.361135 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9764781-21e4-48da-8ad3-2c7c9fe6836b admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:13.362868 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9764781-21e4-48da-8ad3-2c7c9fe6836b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:13.366050 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9764781-21e4-48da-8ad3-2c7c9fe6836b admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:13.408082 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-37906bff-df43-4cb8-866f-f5a891926b06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '627c7e9361cc49488db949b261da143a'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:13.430353 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-37906bff-df43-4cb8-866f-f5a891926b06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '627c7e9361cc49488db949b261da143a'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:13.436464 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 858/1703] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:30:13 2022] POST /identity/v3/users => generated 308 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:30:13.436464 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5a1f9-1ead-4021-8e97-3cf4702168cf None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:13.436464 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5a1f9-1ead-4021-8e97-3cf4702168cf None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:13.436464 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5a1f9-1ead-4021-8e97-3cf4702168cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:13.454092 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-37906bff-df43-4cb8-866f-f5a891926b06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '627c7e9361cc49488db949b261da143a'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:13.463908 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-6de5a1f9-1ead-4021-8e97-3cf4702168cf None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:13.465635 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-6de5a1f9-1ead-4021-8e97-3cf4702168cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:13.489164 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 859/1704] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:30:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:13.489164 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de5a1f9-1ead-4021-8e97-3cf4702168cf None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:13.490495 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-6de5a1f9-1ead-4021-8e97-3cf4702168cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:13.510516 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de5a1f9-1ead-4021-8e97-3cf4702168cf None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:13.517187 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5745baf8-9908-469a-8179-c35a675b3357 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06dccf61c686414d904bdf1ecf19d53d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:13.517813 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745baf8-9908-469a-8179-c35a675b3357 service placement] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:13.518087 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745baf8-9908-469a-8179-c35a675b3357 service placement] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:13.520488 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745baf8-9908-469a-8179-c35a675b3357 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:13.528917 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-37906bff-df43-4cb8-866f-f5a891926b06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '627c7e9361cc49488db949b261da143a'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:13.531672 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-5745baf8-9908-469a-8179-c35a675b3357 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:13.570737 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5745baf8-9908-469a-8179-c35a675b3357 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:13.573663 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5745baf8-9908-469a-8179-c35a675b3357 service placement] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:13.583737 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-37906bff-df43-4cb8-866f-f5a891926b06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '627c7e9361cc49488db949b261da143a'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:13.600169 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 846/1705] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:30:12 2022] DELETE /identity/v3/users/627c7e9361cc49488db949b261da143a => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:30:13.601198 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37906bff-df43-4cb8-866f-f5a891926b06 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:13.605038 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-37906bff-df43-4cb8-866f-f5a891926b06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:13.607468 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 860/1706] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:30:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:30:13.608821 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b1a73-1ae0-4b08-a278-2fcb450a85ca None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:13.609271 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b1a73-1ae0-4b08-a278-2fcb450a85ca None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:13.609548 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b1a73-1ae0-4b08-a278-2fcb450a85ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:13.659926 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-758b1a73-1ae0-4b08-a278-2fcb450a85ca None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:13.662946 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-758b1a73-1ae0-4b08-a278-2fcb450a85ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:13.817464 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:13.862333 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37906bff-df43-4cb8-866f-f5a891926b06 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:13.872498 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d94d367-efcf-4f0d-b37b-4509d1ee012e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:13.873751 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94d367-efcf-4f0d-b37b-4509d1ee012e admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:13.874310 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94d367-efcf-4f0d-b37b-4509d1ee012e admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:13.875011 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94d367-efcf-4f0d-b37b-4509d1ee012e admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:13.876681 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d94d367-efcf-4f0d-b37b-4509d1ee012e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:13.879847 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d94d367-efcf-4f0d-b37b-4509d1ee012e admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:13.919791 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 847/1707] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:30:13 2022] GET /identity/v3/roles => generated 1420 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:30:13.922142 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d94d367-efcf-4f0d-b37b-4509d1ee012e admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:13.945450 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d94d367-efcf-4f0d-b37b-4509d1ee012e admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:13.959095 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda25b3e-f2c3-4301-b616-475cb28cd510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:13.959856 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda25b3e-f2c3-4301-b616-475cb28cd510 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:13.960142 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda25b3e-f2c3-4301-b616-475cb28cd510 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:13.960410 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda25b3e-f2c3-4301-b616-475cb28cd510 admin admin] PATH_INFO: `/v3/projects/b2155277fa054e69b692ae3c66ffda8f/users/feefdb22832f41029bc9fa5a0a84e6d7/roles/fb48693810be495fb4b1893a79429b78` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:13.990512 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 861/1708] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:30:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:13.997960 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758b1a73-1ae0-4b08-a278-2fcb450a85ca None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:14.007046 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda25b3e-f2c3-4301-b616-475cb28cd510 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2155277fa054e69b692ae3c66ffda8f, user_id=feefdb22832f41029bc9fa5a0a84e6d7, role_id=fb48693810be495fb4b1893a79429b78)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:14.013136 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda25b3e-f2c3-4301-b616-475cb28cd510 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:14.015706 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758b1a73-1ae0-4b08-a278-2fcb450a85ca None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:14.041758 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8d066d-194f-439c-8704-2a21a83715bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:14.042469 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d066d-194f-439c-8704-2a21a83715bd admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:14.042782 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d066d-194f-439c-8704-2a21a83715bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:14.043242 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d066d-194f-439c-8704-2a21a83715bd admin admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:14.043773 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8d066d-194f-439c-8704-2a21a83715bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:30:14.044083 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8d066d-194f-439c-8704-2a21a83715bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:14.045748 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8d066d-194f-439c-8704-2a21a83715bd admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:14.061118 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 848/1709] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:30:13 2022] PUT /identity/v3/projects/b2155277fa054e69b692ae3c66ffda8f/users/feefdb22832f41029bc9fa5a0a84e6d7/roles/fb48693810be495fb4b1893a79429b78 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:30:14.066574 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda25b3e-f2c3-4301-b616-475cb28cd510 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:14.106276 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 862/1710] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 01:30:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:30:14.111186 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8d066d-194f-439c-8704-2a21a83715bd admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:14.144996 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8d066d-194f-439c-8704-2a21a83715bd admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:14.326733 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda25b3e-f2c3-4301-b616-475cb28cd510 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:14.356202 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535c1652-c5bd-49df-a30a-dbb1d50f48bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:14.359082 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c1652-c5bd-49df-a30a-dbb1d50f48bd admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:14.360182 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c1652-c5bd-49df-a30a-dbb1d50f48bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:14.361403 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c1652-c5bd-49df-a30a-dbb1d50f48bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:14.364756 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535c1652-c5bd-49df-a30a-dbb1d50f48bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:14.374830 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535c1652-c5bd-49df-a30a-dbb1d50f48bd admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:14.426854 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 849/1711] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:30:14 2022] GET /identity/v3/roles => generated 1420 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:30:14.428364 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535c1652-c5bd-49df-a30a-dbb1d50f48bd admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:14.434521 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-535c1652-c5bd-49df-a30a-dbb1d50f48bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:14.480766 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:14.487870 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e43f5d-3384-46c5-9053-711ec3d1100a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:14.488517 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e43f5d-3384-46c5-9053-711ec3d1100a admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:14.488799 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e43f5d-3384-46c5-9053-711ec3d1100a admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:14.489074 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e43f5d-3384-46c5-9053-711ec3d1100a admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:14.489720 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e43f5d-3384-46c5-9053-711ec3d1100a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:14.503592 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e43f5d-3384-46c5-9053-711ec3d1100a admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:14.529745 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535c1652-c5bd-49df-a30a-dbb1d50f48bd admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:14.577259 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6706b9e-f9e7-41b9-906e-e1765093b1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:14.589528 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6706b9e-f9e7-41b9-906e-e1765093b1de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:14.592679 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6706b9e-f9e7-41b9-906e-e1765093b1de admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:14.612240 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6706b9e-f9e7-41b9-906e-e1765093b1de admin admin] PATH_INFO: `/v3/projects/5a07d6bc099a4dd2869c6ad3aee3a218` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:14.644203 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6706b9e-f9e7-41b9-906e-e1765093b1de admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a07d6bc099a4dd2869c6ad3aee3a218)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:14.651306 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6706b9e-f9e7-41b9-906e-e1765093b1de admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:14.969641 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-c6706b9e-f9e7-41b9-906e-e1765093b1de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a07d6bc099a4dd2869c6ad3aee3a218', 'request_id': 'req-c6706b9e-f9e7-41b9-906e-e1765093b1de'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:14.978469 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-c6706b9e-f9e7-41b9-906e-e1765093b1de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a07d6bc099a4dd2869c6ad3aee3a218', 'request_id': 'req-c6706b9e-f9e7-41b9-906e-e1765093b1de'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:14.990864 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-c6706b9e-f9e7-41b9-906e-e1765093b1de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a07d6bc099a4dd2869c6ad3aee3a218', 'request_id': 'req-c6706b9e-f9e7-41b9-906e-e1765093b1de'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:15.006808 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 863/1712] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:30:14 2022] POST /identity/v3/projects => generated 375 bytes in 900 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 01:30:15.019443 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e43f5d-3384-46c5-9053-711ec3d1100a admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:15.027556 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-c6706b9e-f9e7-41b9-906e-e1765093b1de admin admin] The token cache is being invalidate because project 5a07d6bc099a4dd2869c6ad3aee3a218 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:30:15.028200 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-c6706b9e-f9e7-41b9-906e-e1765093b1de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:15.029713 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-c6706b9e-f9e7-41b9-906e-e1765093b1de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:15.031491 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 850/1713] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:30:14 2022] DELETE /identity/v3/projects/5a07d6bc099a4dd2869c6ad3aee3a218 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:30:15.035731 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6706b9e-f9e7-41b9-906e-e1765093b1de admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:15.037839 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c6706b9e-f9e7-41b9-906e-e1765093b1de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:15.184656 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6706b9e-f9e7-41b9-906e-e1765093b1de admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:15.187001 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e43f5d-3384-46c5-9053-711ec3d1100a admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:15.199341 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339fa15b-9df3-4e7c-b967-b733c41505af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:15.200232 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339fa15b-9df3-4e7c-b967-b733c41505af admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:15.200598 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87139dfd-a41d-4019-be27-4b32e9d9c1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:15.201011 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339fa15b-9df3-4e7c-b967-b733c41505af admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:15.202293 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87139dfd-a41d-4019-be27-4b32e9d9c1dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:15.202429 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87139dfd-a41d-4019-be27-4b32e9d9c1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:15.202789 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339fa15b-9df3-4e7c-b967-b733c41505af admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:15.203530 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339fa15b-9df3-4e7c-b967-b733c41505af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:15.204005 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87139dfd-a41d-4019-be27-4b32e9d9c1dd admin admin] PATH_INFO: `/v3/projects/b2155277fa054e69b692ae3c66ffda8f/users/feefdb22832f41029bc9fa5a0a84e6d7/roles/fb48693810be495fb4b1893a79429b78` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:15.211447 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339fa15b-9df3-4e7c-b967-b733c41505af admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:15.211933 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87139dfd-a41d-4019-be27-4b32e9d9c1dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2155277fa054e69b692ae3c66ffda8f, user_id=feefdb22832f41029bc9fa5a0a84e6d7, role_id=fb48693810be495fb4b1893a79429b78)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:15.221302 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87139dfd-a41d-4019-be27-4b32e9d9c1dd admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:15.258242 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 864/1714] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:30:15 2022] PUT /identity/v3/projects/b2155277fa054e69b692ae3c66ffda8f/users/feefdb22832f41029bc9fa5a0a84e6d7/roles/fb48693810be495fb4b1893a79429b78 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:30:15.258242 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87139dfd-a41d-4019-be27-4b32e9d9c1dd admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:15.263838 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 851/1715] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:30:15 2022] POST /identity/v3/users => generated 288 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:30:15.265312 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-87139dfd-a41d-4019-be27-4b32e9d9c1dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:15.267884 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339fa15b-9df3-4e7c-b967-b733c41505af admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:15.289680 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339fa15b-9df3-4e7c-b967-b733c41505af admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:15.383926 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f429d3-e4ff-4dff-9330-60e7e8331876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:15.384694 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f429d3-e4ff-4dff-9330-60e7e8331876 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:15.385005 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f429d3-e4ff-4dff-9330-60e7e8331876 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:15.393679 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f429d3-e4ff-4dff-9330-60e7e8331876 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:15.394804 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f429d3-e4ff-4dff-9330-60e7e8331876 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:15.409546 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f429d3-e4ff-4dff-9330-60e7e8331876 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:15.424836 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 852/1716] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:30:15 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:30:15.428520 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f429d3-e4ff-4dff-9330-60e7e8331876 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:15.430633 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:15.482085 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f429d3-e4ff-4dff-9330-60e7e8331876 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:15.495669 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea369802-6b8a-4e24-aa41-b380b1abd0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:15.496585 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea369802-6b8a-4e24-aa41-b380b1abd0f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:15.496917 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea369802-6b8a-4e24-aa41-b380b1abd0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:15.497255 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea369802-6b8a-4e24-aa41-b380b1abd0f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:15.508145 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea369802-6b8a-4e24-aa41-b380b1abd0f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:15.510157 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea369802-6b8a-4e24-aa41-b380b1abd0f2 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:15.525966 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 853/1717] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:30:15 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 01:30:15.530408 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea369802-6b8a-4e24-aa41-b380b1abd0f2 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:15.539592 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87139dfd-a41d-4019-be27-4b32e9d9c1dd admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:15.557519 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:15.559407 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d2c0b-822a-4f68-82ba-f7b332ec724a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:15.560402 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d2c0b-822a-4f68-82ba-f7b332ec724a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:15.560949 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d2c0b-822a-4f68-82ba-f7b332ec724a admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:15.561526 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d2c0b-822a-4f68-82ba-f7b332ec724a admin admin] PATH_INFO: `/v3/users/7e2fa60501b249f1bdc85ae51ee12242` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:15.563392 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7d2c0b-822a-4f68-82ba-f7b332ec724a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e2fa60501b249f1bdc85ae51ee12242)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:15.566409 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7d2c0b-822a-4f68-82ba-f7b332ec724a admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:15.576190 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea369802-6b8a-4e24-aa41-b380b1abd0f2 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:15.594936 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9f7dbc-2f68-4135-a5ef-b9d3a20b6302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:15.595652 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f7dbc-2f68-4135-a5ef-b9d3a20b6302 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:15.595996 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f7dbc-2f68-4135-a5ef-b9d3a20b6302 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:15.596332 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f7dbc-2f68-4135-a5ef-b9d3a20b6302 admin admin] PATH_INFO: `/v3/projects/147614ef332941568d940653fd45a213/users/0598ec8a7c35462b8630c64f14741eee/roles/13af81971c1c428eae0a571a22ea583d` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:15.638914 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9f7dbc-2f68-4135-a5ef-b9d3a20b6302 admin admin] RBAC: Authorizing `identity:create_grant(project_id=147614ef332941568d940653fd45a213, user_id=0598ec8a7c35462b8630c64f14741eee, role_id=13af81971c1c428eae0a571a22ea583d)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:15.657229 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9f7dbc-2f68-4135-a5ef-b9d3a20b6302 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:15.698224 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 854/1718] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:30:15 2022] PUT /identity/v3/projects/147614ef332941568d940653fd45a213/users/0598ec8a7c35462b8630c64f14741eee/roles/13af81971c1c428eae0a571a22ea583d => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 01:30:15.699136 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-0e7d2c0b-822a-4f68-82ba-f7b332ec724a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e2fa60501b249f1bdc85ae51ee12242'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:15.699651 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9f7dbc-2f68-4135-a5ef-b9d3a20b6302 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:15.706084 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-5f9f7dbc-2f68-4135-a5ef-b9d3a20b6302 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:15.715176 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-0e7d2c0b-822a-4f68-82ba-f7b332ec724a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e2fa60501b249f1bdc85ae51ee12242'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:15.715829 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-0e7d2c0b-822a-4f68-82ba-f7b332ec724a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e2fa60501b249f1bdc85ae51ee12242'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:15.732365 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-0e7d2c0b-822a-4f68-82ba-f7b332ec724a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e2fa60501b249f1bdc85ae51ee12242'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:15.762644 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-0e7d2c0b-822a-4f68-82ba-f7b332ec724a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e2fa60501b249f1bdc85ae51ee12242'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:15.776202 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 865/1719] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:30:15 2022] DELETE /identity/v3/users/7e2fa60501b249f1bdc85ae51ee12242 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:30:15.777678 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f40ee-3422-4d4d-bdcd-265459bf3de6 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:15.778780 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f40ee-3422-4d4d-bdcd-265459bf3de6 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:15.779192 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f40ee-3422-4d4d-bdcd-265459bf3de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:15.893120 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-fa1f40ee-3422-4d4d-bdcd-265459bf3de6 None None] MFA Rules not processed for user `0598ec8a7c35462b8630c64f14741eee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:15.894587 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-fa1f40ee-3422-4d4d-bdcd-265459bf3de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:15.925825 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9f7dbc-2f68-4135-a5ef-b9d3a20b6302 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:16.106402 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 866/1720] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:30:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:16.123637 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1f40ee-3422-4d4d-bdcd-265459bf3de6 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:16.125630 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-fa1f40ee-3422-4d4d-bdcd-265459bf3de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:16.231273 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606885af-9ce4-465d-90ce-f3914d5a4dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:16.231931 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606885af-9ce4-465d-90ce-f3914d5a4dba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:16.232207 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606885af-9ce4-465d-90ce-f3914d5a4dba admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:16.232473 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606885af-9ce4-465d-90ce-f3914d5a4dba admin admin] PATH_INFO: `/v3/projects/9c4d67311a4f4bb6b024fe6c68194e33` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:16.238504 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606885af-9ce4-465d-90ce-f3914d5a4dba admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c4d67311a4f4bb6b024fe6c68194e33)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:16.241801 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606885af-9ce4-465d-90ce-f3914d5a4dba admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:16.268483 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:16.352640 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-606885af-9ce4-465d-90ce-f3914d5a4dba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c4d67311a4f4bb6b024fe6c68194e33', 'request_id': 'req-606885af-9ce4-465d-90ce-f3914d5a4dba'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:16.368601 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-606885af-9ce4-465d-90ce-f3914d5a4dba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c4d67311a4f4bb6b024fe6c68194e33', 'request_id': 'req-606885af-9ce4-465d-90ce-f3914d5a4dba'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:16.389755 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1f40ee-3422-4d4d-bdcd-265459bf3de6 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:16.390046 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-606885af-9ce4-465d-90ce-f3914d5a4dba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c4d67311a4f4bb6b024fe6c68194e33', 'request_id': 'req-606885af-9ce4-465d-90ce-f3914d5a4dba'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:16.421583 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-606885af-9ce4-465d-90ce-f3914d5a4dba admin admin] The token cache is being invalidate because project 9c4d67311a4f4bb6b024fe6c68194e33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:30:16.423922 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-606885af-9ce4-465d-90ce-f3914d5a4dba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:16.426330 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-606885af-9ce4-465d-90ce-f3914d5a4dba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:16.428912 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 855/1721] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:30:15 2022] DELETE /identity/v3/projects/9c4d67311a4f4bb6b024fe6c68194e33 => generated 0 bytes in 730 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:30:16.435572 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58ea31-01e1-4221-bea5-fd2a00977462 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:16.435852 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58ea31-01e1-4221-bea5-fd2a00977462 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:16.436121 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58ea31-01e1-4221-bea5-fd2a00977462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:16.517790 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-ed58ea31-01e1-4221-bea5-fd2a00977462 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:16.519205 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-ed58ea31-01e1-4221-bea5-fd2a00977462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:16.544724 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:16.574100 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c5e398-16ce-4d44-8c4e-9616a5b9d23c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd5e95467b44175be2478c2c7c89926', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:16.575049 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5e398-16ce-4d44-8c4e-9616a5b9d23c service nova] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:16.575472 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5e398-16ce-4d44-8c4e-9616a5b9d23c service nova] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:16.575876 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5e398-16ce-4d44-8c4e-9616a5b9d23c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:16.582142 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-f5c5e398-16ce-4d44-8c4e-9616a5b9d23c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:16.692477 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 856/1722] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:30:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:16.693803 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ab938-77f5-4835-a226-3f430a0090fd None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:16.694086 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ab938-77f5-4835-a226-3f430a0090fd None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:16.699639 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ab938-77f5-4835-a226-3f430a0090fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:16.740830 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c5e398-16ce-4d44-8c4e-9616a5b9d23c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:16.746589 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c5e398-16ce-4d44-8c4e-9616a5b9d23c service nova] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:16.764124 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-663ab938-77f5-4835-a226-3f430a0090fd None None] MFA Rules not processed for user `619b8ee9e99c4d0b9ec1e2f91c19569d`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:16.766241 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-663ab938-77f5-4835-a226-3f430a0090fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:16.782432 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 867/1723] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:30:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 664 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 01:30:16.783952 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477dbe19-997b-4c8c-8286-28fc281db6a8 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:16.784235 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477dbe19-997b-4c8c-8286-28fc281db6a8 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:16.784506 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477dbe19-997b-4c8c-8286-28fc281db6a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:16.847276 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-477dbe19-997b-4c8c-8286-28fc281db6a8 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:16.851206 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-477dbe19-997b-4c8c-8286-28fc281db6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:16.886685 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 868/1724] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:30:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:16.893577 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477dbe19-997b-4c8c-8286-28fc281db6a8 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:16.911390 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477dbe19-997b-4c8c-8286-28fc281db6a8 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:16.925912 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f565702-46e4-482a-81bb-3558c3d9043b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:16.926594 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f565702-46e4-482a-81bb-3558c3d9043b admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:16.926869 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f565702-46e4-482a-81bb-3558c3d9043b admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:16.927138 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f565702-46e4-482a-81bb-3558c3d9043b admin admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:16.928784 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f565702-46e4-482a-81bb-3558c3d9043b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:30:16.929083 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f565702-46e4-482a-81bb-3558c3d9043b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:16.930734 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f565702-46e4-482a-81bb-3558c3d9043b admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:17.001607 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 857/1725] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:30:16 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:17.003332 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a8da5-024e-4ea3-95bf-e9907fec9bc5 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:17.003602 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a8da5-024e-4ea3-95bf-e9907fec9bc5 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:17.003874 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a8da5-024e-4ea3-95bf-e9907fec9bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:17.017931 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 869/1726] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 01:30:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:30:17.019324 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f565702-46e4-482a-81bb-3558c3d9043b admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:17.034295 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-4b0a8da5-024e-4ea3-95bf-e9907fec9bc5 None None] MFA Rules not processed for user `619b8ee9e99c4d0b9ec1e2f91c19569d`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:17.035419 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-4b0a8da5-024e-4ea3-95bf-e9907fec9bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:17.050978 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 858/1727] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:30:17 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:17.055025 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0a8da5-024e-4ea3-95bf-e9907fec9bc5 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:17.056888 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-4b0a8da5-024e-4ea3-95bf-e9907fec9bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:17.081538 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f565702-46e4-482a-81bb-3558c3d9043b admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:17.101870 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0a8da5-024e-4ea3-95bf-e9907fec9bc5 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:17.109953 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57701c36-ebff-495b-8d7c-861f50c1b34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:17.110627 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57701c36-ebff-495b-8d7c-861f50c1b34c admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:17.110912 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57701c36-ebff-495b-8d7c-861f50c1b34c admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:17.111183 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57701c36-ebff-495b-8d7c-861f50c1b34c admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:17.111825 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57701c36-ebff-495b-8d7c-861f50c1b34c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:17.117521 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6304d7-de4e-421a-9f12-d69e9094f27b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd5e95467b44175be2478c2c7c89926', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:17.117787 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57701c36-ebff-495b-8d7c-861f50c1b34c admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:17.118471 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6304d7-de4e-421a-9f12-d69e9094f27b service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:17.118757 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6304d7-de4e-421a-9f12-d69e9094f27b service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:17.119025 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6304d7-de4e-421a-9f12-d69e9094f27b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:17.139059 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6304d7-de4e-421a-9f12-d69e9094f27b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:17.142662 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6304d7-de4e-421a-9f12-d69e9094f27b service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:17.168780 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 859/1728] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:30:17 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:30:17.260996 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6304d7-de4e-421a-9f12-d69e9094f27b service nova] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:17.262005 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 870/1729] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:30:17 2022] POST /identity/v3/projects => generated 385 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:30:17.291231 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57701c36-ebff-495b-8d7c-861f50c1b34c admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:17.293238 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-57701c36-ebff-495b-8d7c-861f50c1b34c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:17.303642 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6304d7-de4e-421a-9f12-d69e9094f27b service nova] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:17.387470 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b17186-a150-487d-9e1e-0c8a0f4ea37a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:17.389812 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b17186-a150-487d-9e1e-0c8a0f4ea37a admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:17.390316 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b17186-a150-487d-9e1e-0c8a0f4ea37a admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:17.391083 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b17186-a150-487d-9e1e-0c8a0f4ea37a admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:17.393314 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b17186-a150-487d-9e1e-0c8a0f4ea37a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:17.401394 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b17186-a150-487d-9e1e-0c8a0f4ea37a admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:17.444487 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:17.474403 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 860/1730] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:30:17 2022] POST /identity/v3/users => generated 293 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:30:17.490536 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b17186-a150-487d-9e1e-0c8a0f4ea37a admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:17.519840 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b17186-a150-487d-9e1e-0c8a0f4ea37a admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:17.539738 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60187a9c-d80f-4278-b221-45e20caee15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:17.540059 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60187a9c-d80f-4278-b221-45e20caee15d admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:17.540654 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60187a9c-d80f-4278-b221-45e20caee15d admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:17.541050 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60187a9c-d80f-4278-b221-45e20caee15d admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:17.541827 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60187a9c-d80f-4278-b221-45e20caee15d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:17.543618 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60187a9c-d80f-4278-b221-45e20caee15d admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:17.578837 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 861/1731] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:30:17 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:30:17.582692 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60187a9c-d80f-4278-b221-45e20caee15d admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:17.602518 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:17.604366 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57701c36-ebff-495b-8d7c-861f50c1b34c admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:17.608616 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60187a9c-d80f-4278-b221-45e20caee15d admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:17.612958 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d94ba1-a65a-4d75-bc5a-0ff1746f1bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:17.613801 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d94ba1-a65a-4d75-bc5a-0ff1746f1bb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:17.614619 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d94ba1-a65a-4d75-bc5a-0ff1746f1bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:17.615039 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d94ba1-a65a-4d75-bc5a-0ff1746f1bb1 admin admin] PATH_INFO: `/v3/users/0598ec8a7c35462b8630c64f14741eee` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:17.619028 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d94ba1-a65a-4d75-bc5a-0ff1746f1bb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0598ec8a7c35462b8630c64f14741eee)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:17.621241 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d94ba1-a65a-4d75-bc5a-0ff1746f1bb1 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:17.622891 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e70f07-fb41-47f4-8c5b-5d2659a65dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:17.623761 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e70f07-fb41-47f4-8c5b-5d2659a65dc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:17.624110 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e70f07-fb41-47f4-8c5b-5d2659a65dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:17.625687 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e70f07-fb41-47f4-8c5b-5d2659a65dc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:17.626487 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e70f07-fb41-47f4-8c5b-5d2659a65dc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:17.629450 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e70f07-fb41-47f4-8c5b-5d2659a65dc5 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:17.667652 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 862/1732] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:30:17 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:30:17.669450 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e70f07-fb41-47f4-8c5b-5d2659a65dc5 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:17.726886 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e70f07-fb41-47f4-8c5b-5d2659a65dc5 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:17.738157 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-63d94ba1-a65a-4d75-bc5a-0ff1746f1bb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0598ec8a7c35462b8630c64f14741eee'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:17.760643 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-63d94ba1-a65a-4d75-bc5a-0ff1746f1bb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0598ec8a7c35462b8630c64f14741eee'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:17.760885 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312ae52e-8343-4ef2-98b5-1df725065644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:17.761632 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ae52e-8343-4ef2-98b5-1df725065644 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:17.761907 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ae52e-8343-4ef2-98b5-1df725065644 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:17.762077 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-63d94ba1-a65a-4d75-bc5a-0ff1746f1bb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0598ec8a7c35462b8630c64f14741eee'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:17.762254 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ae52e-8343-4ef2-98b5-1df725065644 admin admin] PATH_INFO: `/v3/projects/1ed7fc2daa4246129e2d02b6fca03399/users/de7c34a4ad84428080d9737f3b9207d6/roles/13af81971c1c428eae0a571a22ea583d` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:17.779380 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-63d94ba1-a65a-4d75-bc5a-0ff1746f1bb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0598ec8a7c35462b8630c64f14741eee'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:17.813862 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-63d94ba1-a65a-4d75-bc5a-0ff1746f1bb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0598ec8a7c35462b8630c64f14741eee'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:17.816078 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312ae52e-8343-4ef2-98b5-1df725065644 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ed7fc2daa4246129e2d02b6fca03399, user_id=de7c34a4ad84428080d9737f3b9207d6, role_id=13af81971c1c428eae0a571a22ea583d)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:17.825783 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 871/1733] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:30:17 2022] DELETE /identity/v3/users/0598ec8a7c35462b8630c64f14741eee => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:30:17.828884 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312ae52e-8343-4ef2-98b5-1df725065644 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:17.830512 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc752d-1ab7-47e2-9f52-74f8c60e36d7 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:17.835590 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc752d-1ab7-47e2-9f52-74f8c60e36d7 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:17.836077 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc752d-1ab7-47e2-9f52-74f8c60e36d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:17.894810 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-20dc752d-1ab7-47e2-9f52-74f8c60e36d7 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:17.896352 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 863/1734] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:30:17 2022] PUT /identity/v3/projects/1ed7fc2daa4246129e2d02b6fca03399/users/de7c34a4ad84428080d9737f3b9207d6/roles/13af81971c1c428eae0a571a22ea583d => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:30:17.901702 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-20dc752d-1ab7-47e2-9f52-74f8c60e36d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:17.907106 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a3cc96-077d-4b29-8434-c6c1e40e60fa None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:17.907647 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a3cc96-077d-4b29-8434-c6c1e40e60fa None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:17.908181 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a3cc96-077d-4b29-8434-c6c1e40e60fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:17.989864 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-28a3cc96-077d-4b29-8434-c6c1e40e60fa None None] MFA Rules not processed for user `de7c34a4ad84428080d9737f3b9207d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:17.991258 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-28a3cc96-077d-4b29-8434-c6c1e40e60fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:18.060033 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 872/1735] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:30:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:18.065102 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a3588-58da-4ac5-bd09-53d800aa8262 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:18.065408 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a3588-58da-4ac5-bd09-53d800aa8262 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:18.065776 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a3588-58da-4ac5-bd09-53d800aa8262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:18.150149 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-8f0a3588-58da-4ac5-bd09-53d800aa8262 None None] MFA Rules not processed for user `c8e85b77280f4a779c1d2ab66891f948`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:18.151379 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-8f0a3588-58da-4ac5-bd09-53d800aa8262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:18.209744 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 864/1736] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:30:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 01:30:18.212712 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b631945-f048-40a5-9ddf-4280e23085eb None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:18.213294 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b631945-f048-40a5-9ddf-4280e23085eb None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:18.213813 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b631945-f048-40a5-9ddf-4280e23085eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:18.317685 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:18.389660 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-5b631945-f048-40a5-9ddf-4280e23085eb None None] MFA Rules not processed for user `f3643631cf2d4a9592d465bdeba99669`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:18.389970 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 873/1737] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:30:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:18.389970 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a3588-58da-4ac5-bd09-53d800aa8262 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:18.392150 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-5b631945-f048-40a5-9ddf-4280e23085eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:18.393358 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-8f0a3588-58da-4ac5-bd09-53d800aa8262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:18.495389 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a3588-58da-4ac5-bd09-53d800aa8262 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:18.499955 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff662b7-0013-4517-9d85-de65f7c9d6cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:18.500893 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff662b7-0013-4517-9d85-de65f7c9d6cf service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:18.501555 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff662b7-0013-4517-9d85-de65f7c9d6cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:18.502032 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff662b7-0013-4517-9d85-de65f7c9d6cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:18.512569 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff662b7-0013-4517-9d85-de65f7c9d6cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:18.514173 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff662b7-0013-4517-9d85-de65f7c9d6cf service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:18.527182 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 874/1738] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:30:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:30:18.527939 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff662b7-0013-4517-9d85-de65f7c9d6cf service neutron] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:18.535357 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-bff662b7-0013-4517-9d85-de65f7c9d6cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:18.545481 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 865/1739] 10.222.0.26 () {58 vars in 1009 bytes} [Fri Aug 12 01:30:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:18.558540 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b631945-f048-40a5-9ddf-4280e23085eb None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:18.561316 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff662b7-0013-4517-9d85-de65f7c9d6cf service neutron] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:18.563004 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-5b631945-f048-40a5-9ddf-4280e23085eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:18.581517 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be643965-938c-468e-8351-8d7c9c3fda93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:18.582283 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be643965-938c-468e-8351-8d7c9c3fda93 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:18.588079 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be643965-938c-468e-8351-8d7c9c3fda93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:18.591107 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be643965-938c-468e-8351-8d7c9c3fda93 admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:18.592870 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be643965-938c-468e-8351-8d7c9c3fda93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:18.597819 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be643965-938c-468e-8351-8d7c9c3fda93 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:18.637063 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:18.677922 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 875/1740] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:30:18 2022] POST /identity/v3/projects => generated 387 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:30:18.678868 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be643965-938c-468e-8351-8d7c9c3fda93 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:18.681058 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-be643965-938c-468e-8351-8d7c9c3fda93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:18.719977 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b631945-f048-40a5-9ddf-4280e23085eb None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:18.842447 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be643965-938c-468e-8351-8d7c9c3fda93 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:18.855325 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85757389-7a6e-45ce-8eb7-6c9b87a4fe92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:18.856227 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85757389-7a6e-45ce-8eb7-6c9b87a4fe92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:18.856671 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85757389-7a6e-45ce-8eb7-6c9b87a4fe92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:18.857083 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85757389-7a6e-45ce-8eb7-6c9b87a4fe92 admin admin] PATH_INFO: `/v3/projects/2d2d3efbd2c24dbab698db31abaeceba` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:18.858483 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85757389-7a6e-45ce-8eb7-6c9b87a4fe92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d2d3efbd2c24dbab698db31abaeceba)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:18.867901 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85757389-7a6e-45ce-8eb7-6c9b87a4fe92 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:18.955386 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc633d36-0b83-44fe-b847-aa0567b47991 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd5e95467b44175be2478c2c7c89926', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:18.957227 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc633d36-0b83-44fe-b847-aa0567b47991 service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:18.959266 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc633d36-0b83-44fe-b847-aa0567b47991 service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:18.959904 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc633d36-0b83-44fe-b847-aa0567b47991 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:18.979907 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-85757389-7a6e-45ce-8eb7-6c9b87a4fe92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d2d3efbd2c24dbab698db31abaeceba', 'request_id': 'req-85757389-7a6e-45ce-8eb7-6c9b87a4fe92'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:18.989864 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-85757389-7a6e-45ce-8eb7-6c9b87a4fe92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d2d3efbd2c24dbab698db31abaeceba', 'request_id': 'req-85757389-7a6e-45ce-8eb7-6c9b87a4fe92'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:18.999877 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-85757389-7a6e-45ce-8eb7-6c9b87a4fe92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d2d3efbd2c24dbab698db31abaeceba', 'request_id': 'req-85757389-7a6e-45ce-8eb7-6c9b87a4fe92'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:19.003812 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:19.024819 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-85757389-7a6e-45ce-8eb7-6c9b87a4fe92 admin admin] The token cache is being invalidate because project 2d2d3efbd2c24dbab698db31abaeceba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:30:19.025205 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-85757389-7a6e-45ce-8eb7-6c9b87a4fe92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:19.026186 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-85757389-7a6e-45ce-8eb7-6c9b87a4fe92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:19.029539 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 876/1741] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:30:18 2022] DELETE /identity/v3/projects/2d2d3efbd2c24dbab698db31abaeceba => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:30:19.031709 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17acf206-03d1-43b6-a7b6-a27ebb2c872a None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:19.031995 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17acf206-03d1-43b6-a7b6-a27ebb2c872a None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:19.034210 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17acf206-03d1-43b6-a7b6-a27ebb2c872a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:19.132807 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-17acf206-03d1-43b6-a7b6-a27ebb2c872a None None] MFA Rules not processed for user `f310c49470854e57a7870a0e317a2e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:19.137156 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-17acf206-03d1-43b6-a7b6-a27ebb2c872a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:19.151430 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc633d36-0b83-44fe-b847-aa0567b47991 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:19.158700 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc633d36-0b83-44fe-b847-aa0567b47991 service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:19.184945 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 866/1742] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:30:18 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 639 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:30:19.197391 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc633d36-0b83-44fe-b847-aa0567b47991 service nova] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:19.234640 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc633d36-0b83-44fe-b847-aa0567b47991 service nova] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:19.385397 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 877/1743] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:30:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:19.388149 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17acf206-03d1-43b6-a7b6-a27ebb2c872a None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:19.388534 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-17acf206-03d1-43b6-a7b6-a27ebb2c872a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:19.410745 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8093f445-97d7-4b5b-8bb3-209037edee11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:19.412517 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8093f445-97d7-4b5b-8bb3-209037edee11 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:19.413014 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8093f445-97d7-4b5b-8bb3-209037edee11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:19.413421 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8093f445-97d7-4b5b-8bb3-209037edee11 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:19.414217 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8093f445-97d7-4b5b-8bb3-209037edee11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:19.416615 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8093f445-97d7-4b5b-8bb3-209037edee11 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:19.453415 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:19.474452 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 867/1744] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:30:19 2022] POST /identity/v3/users => generated 300 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:30:19.476198 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4093e-1531-4419-81ad-8176f61634fe None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:19.476694 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4093e-1531-4419-81ad-8176f61634fe None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:19.476823 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4093e-1531-4419-81ad-8176f61634fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:19.506703 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-62f4093e-1531-4419-81ad-8176f61634fe None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:19.508439 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-62f4093e-1531-4419-81ad-8176f61634fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:19.519913 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 868/1745] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:30:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:19.521333 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2987acbe-f335-4028-aa1e-41652200c63d None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:19.521665 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2987acbe-f335-4028-aa1e-41652200c63d None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:19.521940 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2987acbe-f335-4028-aa1e-41652200c63d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:19.568498 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-2987acbe-f335-4028-aa1e-41652200c63d None None] MFA Rules not processed for user `feefdb22832f41029bc9fa5a0a84e6d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:19.570095 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2987acbe-f335-4028-aa1e-41652200c63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:19.649605 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17acf206-03d1-43b6-a7b6-a27ebb2c872a None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:19.664555 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa822b18-15c5-4019-81f7-7e0b29020e2b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32c1ba237f864b5d9699cb817e42e647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:19.665445 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa822b18-15c5-4019-81f7-7e0b29020e2b service swift] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:19.665962 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa822b18-15c5-4019-81f7-7e0b29020e2b service swift] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:19.666418 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa822b18-15c5-4019-81f7-7e0b29020e2b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:19.673012 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-aa822b18-15c5-4019-81f7-7e0b29020e2b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:19.685517 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 869/1746] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:30:19 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:19.686582 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2987acbe-f335-4028-aa1e-41652200c63d None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:19.696472 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2987acbe-f335-4028-aa1e-41652200c63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:19.734248 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2987acbe-f335-4028-aa1e-41652200c63d None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:19.747671 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005ab174-03ff-4668-9f7a-8b8c6404ef0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:19.749224 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ab174-03ff-4668-9f7a-8b8c6404ef0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:19.749909 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ab174-03ff-4668-9f7a-8b8c6404ef0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:19.750080 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ab174-03ff-4668-9f7a-8b8c6404ef0d admin admin] PATH_INFO: `/v3/projects/147614ef332941568d940653fd45a213` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:19.752448 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005ab174-03ff-4668-9f7a-8b8c6404ef0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=147614ef332941568d940653fd45a213)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:19.755829 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005ab174-03ff-4668-9f7a-8b8c6404ef0d admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:19.805155 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa822b18-15c5-4019-81f7-7e0b29020e2b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:19.808044 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa822b18-15c5-4019-81f7-7e0b29020e2b service swift] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:19.821544 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 878/1747] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Aug 12 01:30:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 12 01:30:19.825316 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b5439-9f29-4c2a-88e5-a9c229ba5dec None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:19.825794 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b5439-9f29-4c2a-88e5-a9c229ba5dec None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:19.826522 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b5439-9f29-4c2a-88e5-a9c229ba5dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:19.845619 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:19.890787 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-005ab174-03ff-4668-9f7a-8b8c6404ef0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '147614ef332941568d940653fd45a213', 'request_id': 'req-005ab174-03ff-4668-9f7a-8b8c6404ef0d'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:19.918596 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-510b5439-9f29-4c2a-88e5-a9c229ba5dec None None] MFA Rules not processed for user `f310c49470854e57a7870a0e317a2e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:19.921885 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-005ab174-03ff-4668-9f7a-8b8c6404ef0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '147614ef332941568d940653fd45a213', 'request_id': 'req-005ab174-03ff-4668-9f7a-8b8c6404ef0d'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:19.925127 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-510b5439-9f29-4c2a-88e5-a9c229ba5dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:19.962478 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-005ab174-03ff-4668-9f7a-8b8c6404ef0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '147614ef332941568d940653fd45a213', 'request_id': 'req-005ab174-03ff-4668-9f7a-8b8c6404ef0d'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:20.025635 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-005ab174-03ff-4668-9f7a-8b8c6404ef0d admin admin] The token cache is being invalidate because project 147614ef332941568d940653fd45a213 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:30:20.032581 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-005ab174-03ff-4668-9f7a-8b8c6404ef0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:20.034531 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-005ab174-03ff-4668-9f7a-8b8c6404ef0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:20.046814 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 870/1748] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:30:19 2022] DELETE /identity/v3/projects/147614ef332941568d940653fd45a213 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:30:20.048736 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005ab174-03ff-4668-9f7a-8b8c6404ef0d admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:20.054225 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-005ab174-03ff-4668-9f7a-8b8c6404ef0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:20.107447 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 879/1749] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:30:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:20.110486 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ccfc40-1719-4413-a9fa-548e320db81a None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:20.111873 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ccfc40-1719-4413-a9fa-548e320db81a None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:20.113091 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ccfc40-1719-4413-a9fa-548e320db81a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:20.164601 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-d6ccfc40-1719-4413-a9fa-548e320db81a None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:20.168442 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-d6ccfc40-1719-4413-a9fa-548e320db81a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:20.288860 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:20.302681 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005ab174-03ff-4668-9f7a-8b8c6404ef0d admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:20.316682 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4720b78f-3443-4911-9590-014c52982428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:20.317647 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4720b78f-3443-4911-9590-014c52982428 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:20.320267 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4720b78f-3443-4911-9590-014c52982428 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:20.320747 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4720b78f-3443-4911-9590-014c52982428 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:20.322739 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4720b78f-3443-4911-9590-014c52982428 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:20.327216 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4720b78f-3443-4911-9590-014c52982428 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:20.366613 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 871/1750] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:30:20 2022] GET /identity/v3/roles => generated 1420 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:30:20.370465 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a025f5-015f-49c1-8da2-5c6aa47d764c None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:20.370750 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a025f5-015f-49c1-8da2-5c6aa47d764c None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:20.371039 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 880/1751] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:30:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:20.371177 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a025f5-015f-49c1-8da2-5c6aa47d764c None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:20.372582 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc77d6ce-2a47-490a-a3b7-10b54c92c32a None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:20.374062 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc77d6ce-2a47-490a-a3b7-10b54c92c32a None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:20.374482 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc77d6ce-2a47-490a-a3b7-10b54c92c32a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:20.375769 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 872/1752] 10.222.0.26 () {54 vars in 912 bytes} [Fri Aug 12 01:30:20 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:30:20.376646 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a025f5-015f-49c1-8da2-5c6aa47d764c None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:20.383563 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-51a025f5-015f-49c1-8da2-5c6aa47d764c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:20.425110 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-cc77d6ce-2a47-490a-a3b7-10b54c92c32a None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:20.431491 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-cc77d6ce-2a47-490a-a3b7-10b54c92c32a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:20.458693 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 881/1753] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:30:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:20.458693 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc77d6ce-2a47-490a-a3b7-10b54c92c32a None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:20.492573 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc77d6ce-2a47-490a-a3b7-10b54c92c32a None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:20.523276 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f973706-3250-46e9-aa9d-05719b78978e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:20.528757 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f973706-3250-46e9-aa9d-05719b78978e admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:20.534147 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f973706-3250-46e9-aa9d-05719b78978e admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:20.536496 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f973706-3250-46e9-aa9d-05719b78978e admin admin] PATH_INFO: `/v3/projects/fc4d15d9bd7a4db88a847aea425f9584/users/7e534ab56f5643ec891ed9ff9d705994/roles/fb48693810be495fb4b1893a79429b78` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:20.596811 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f973706-3250-46e9-aa9d-05719b78978e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc4d15d9bd7a4db88a847aea425f9584, user_id=7e534ab56f5643ec891ed9ff9d705994, role_id=fb48693810be495fb4b1893a79429b78)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:20.605706 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f973706-3250-46e9-aa9d-05719b78978e admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:20.625250 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a025f5-015f-49c1-8da2-5c6aa47d764c None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:20.633084 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 882/1754] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:30:20 2022] PUT /identity/v3/projects/fc4d15d9bd7a4db88a847aea425f9584/users/7e534ab56f5643ec891ed9ff9d705994/roles/fb48693810be495fb4b1893a79429b78 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:30:20.634717 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f973706-3250-46e9-aa9d-05719b78978e admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:20.792499 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f973706-3250-46e9-aa9d-05719b78978e admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:20.807805 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd2041b-e976-44cf-8167-ebeaea2fe47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:20.808843 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2041b-e976-44cf-8167-ebeaea2fe47a admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:20.809329 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2041b-e976-44cf-8167-ebeaea2fe47a admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:20.809822 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2041b-e976-44cf-8167-ebeaea2fe47a admin admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:20.810740 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd2041b-e976-44cf-8167-ebeaea2fe47a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:30:20.811270 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd2041b-e976-44cf-8167-ebeaea2fe47a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:20.814689 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd2041b-e976-44cf-8167-ebeaea2fe47a admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:20.844937 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 883/1755] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 01:30:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:30:20.846840 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4fd81-c176-4cec-b46e-f47e39dad899 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:20.847333 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4fd81-c176-4cec-b46e-f47e39dad899 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:20.848046 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4fd81-c176-4cec-b46e-f47e39dad899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:20.897398 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-40e4fd81-c176-4cec-b46e-f47e39dad899 None None] MFA Rules not processed for user `a80678458dc9405285b70da707a399c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:20.899126 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-40e4fd81-c176-4cec-b46e-f47e39dad899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:20.917304 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3423ac9-9803-4e29-9bda-e6ef445f0cab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd5e95467b44175be2478c2c7c89926', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:20.917886 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3423ac9-9803-4e29-9bda-e6ef445f0cab service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:20.922311 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3423ac9-9803-4e29-9bda-e6ef445f0cab service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:20.922464 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:20.922682 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3423ac9-9803-4e29-9bda-e6ef445f0cab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:20.932783 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f3423ac9-9803-4e29-9bda-e6ef445f0cab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:21.060826 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 884/1756] 10.222.0.26 () {58 vars in 1009 bytes} [Fri Aug 12 01:30:20 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:21.070358 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4aaa4f-9f01-4402-a3c9-5d87df254708 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:21.071326 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4aaa4f-9f01-4402-a3c9-5d87df254708 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:21.071910 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4aaa4f-9f01-4402-a3c9-5d87df254708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:21.085472 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3423ac9-9803-4e29-9bda-e6ef445f0cab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:21.089230 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3423ac9-9803-4e29-9bda-e6ef445f0cab service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:21.128849 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 873/1757] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:30:20 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 752 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:30:21.130687 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3423ac9-9803-4e29-9bda-e6ef445f0cab service nova] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:21.160655 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-6f4aaa4f-9f01-4402-a3c9-5d87df254708 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:21.164051 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-6f4aaa4f-9f01-4402-a3c9-5d87df254708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:21.170576 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3423ac9-9803-4e29-9bda-e6ef445f0cab service nova] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:21.184732 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bafc92-f9a8-4aa1-8026-340f36a5561c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:21.185389 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bafc92-f9a8-4aa1-8026-340f36a5561c admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:21.185669 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bafc92-f9a8-4aa1-8026-340f36a5561c admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:21.186473 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bafc92-f9a8-4aa1-8026-340f36a5561c admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:21.186609 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bafc92-f9a8-4aa1-8026-340f36a5561c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:21.196249 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bafc92-f9a8-4aa1-8026-340f36a5561c admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:21.205616 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 885/1758] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:30:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:21.210290 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4aaa4f-9f01-4402-a3c9-5d87df254708 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:21.246960 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4aaa4f-9f01-4402-a3c9-5d87df254708 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:21.252746 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 874/1759] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:30:21 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:30:21.253349 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bafc92-f9a8-4aa1-8026-340f36a5561c admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:21.256887 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-e6bafc92-f9a8-4aa1-8026-340f36a5561c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:21.267357 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318fba99-172b-4ccd-bad7-a5c8410b93da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:21.270638 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318fba99-172b-4ccd-bad7-a5c8410b93da admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:21.271606 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318fba99-172b-4ccd-bad7-a5c8410b93da admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:21.274315 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318fba99-172b-4ccd-bad7-a5c8410b93da admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:21.276026 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318fba99-172b-4ccd-bad7-a5c8410b93da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:21.284435 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318fba99-172b-4ccd-bad7-a5c8410b93da admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:21.309296 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bafc92-f9a8-4aa1-8026-340f36a5561c admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:21.320462 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbddb0b-e7ef-474c-b05a-a99bbab037c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:21.321183 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbddb0b-e7ef-474c-b05a-a99bbab037c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:21.321459 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbddb0b-e7ef-474c-b05a-a99bbab037c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:21.321731 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbddb0b-e7ef-474c-b05a-a99bbab037c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:21.364787 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbddb0b-e7ef-474c-b05a-a99bbab037c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:21.367271 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbddb0b-e7ef-474c-b05a-a99bbab037c4 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:21.382609 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 886/1760] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:30:21 2022] POST /identity/v3/projects => generated 369 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:30:21.384562 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318fba99-172b-4ccd-bad7-a5c8410b93da admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:21.431019 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 875/1761] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:30:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:30:21.441540 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbddb0b-e7ef-474c-b05a-a99bbab037c4 service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:21.477799 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:21.499417 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbddb0b-e7ef-474c-b05a-a99bbab037c4 service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:21.667084 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318fba99-172b-4ccd-bad7-a5c8410b93da admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:21.683972 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7634874-b395-4bd4-ad75-b823933e1d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:21.684970 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7634874-b395-4bd4-ad75-b823933e1d9d admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:21.686492 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7634874-b395-4bd4-ad75-b823933e1d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:21.686931 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7634874-b395-4bd4-ad75-b823933e1d9d admin admin] PATH_INFO: `/v3/projects/fc4d15d9bd7a4db88a847aea425f9584/users/7e534ab56f5643ec891ed9ff9d705994/roles/fb48693810be495fb4b1893a79429b78` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:21.687406 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5a01a1-9593-4c5e-b80c-bbcd7eab34bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:21.688156 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5a01a1-9593-4c5e-b80c-bbcd7eab34bf admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:21.688543 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5a01a1-9593-4c5e-b80c-bbcd7eab34bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:21.688922 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5a01a1-9593-4c5e-b80c-bbcd7eab34bf admin admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:21.689710 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5a01a1-9593-4c5e-b80c-bbcd7eab34bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:30:21.695167 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7634874-b395-4bd4-ad75-b823933e1d9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc4d15d9bd7a4db88a847aea425f9584, user_id=7e534ab56f5643ec891ed9ff9d705994, role_id=fb48693810be495fb4b1893a79429b78)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:21.696147 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5a01a1-9593-4c5e-b80c-bbcd7eab34bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:21.697814 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5a01a1-9593-4c5e-b80c-bbcd7eab34bf admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:21.700008 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7634874-b395-4bd4-ad75-b823933e1d9d admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:21.744076 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 876/1762] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:30:21 2022] PUT /identity/v3/projects/fc4d15d9bd7a4db88a847aea425f9584/users/7e534ab56f5643ec891ed9ff9d705994/roles/fb48693810be495fb4b1893a79429b78 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:30:21.745667 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7634874-b395-4bd4-ad75-b823933e1d9d admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:21.754314 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 887/1763] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 01:30:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:30:21.760433 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b30ce0a-ef57-4666-bccd-2e2d80da8569 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:21.760774 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b30ce0a-ef57-4666-bccd-2e2d80da8569 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:21.760987 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b30ce0a-ef57-4666-bccd-2e2d80da8569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:21.850245 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-1b30ce0a-ef57-4666-bccd-2e2d80da8569 None None] MFA Rules not processed for user `7e534ab56f5643ec891ed9ff9d705994`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:21.851529 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-1b30ce0a-ef57-4666-bccd-2e2d80da8569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:22.039489 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7634874-b395-4bd4-ad75-b823933e1d9d admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:22.062097 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a006b52f-6862-4aba-aed9-ea9b05c51c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:22.066676 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006b52f-6862-4aba-aed9-ea9b05c51c96 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:22.068693 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006b52f-6862-4aba-aed9-ea9b05c51c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:22.069205 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006b52f-6862-4aba-aed9-ea9b05c51c96 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:22.070163 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a006b52f-6862-4aba-aed9-ea9b05c51c96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:22.077485 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a006b52f-6862-4aba-aed9-ea9b05c51c96 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:22.088041 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 888/1764] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:30:21 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:22.088902 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b30ce0a-ef57-4666-bccd-2e2d80da8569 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:22.134472 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b30ce0a-ef57-4666-bccd-2e2d80da8569 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:22.157372 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 877/1765] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:30:21 2022] POST /identity/v3/users => generated 285 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:30:22.158556 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb71a67-28f5-48ad-9634-eb461687fdc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:22.159595 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb71a67-28f5-48ad-9634-eb461687fdc3 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:22.159881 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb71a67-28f5-48ad-9634-eb461687fdc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:22.160161 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb71a67-28f5-48ad-9634-eb461687fdc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:22.160962 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb71a67-28f5-48ad-9634-eb461687fdc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:22.162686 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a006b52f-6862-4aba-aed9-ea9b05c51c96 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:22.162960 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb71a67-28f5-48ad-9634-eb461687fdc3 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:22.169199 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-a006b52f-6862-4aba-aed9-ea9b05c51c96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:22.196516 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:22.233446 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 889/1766] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:30:22 2022] POST /identity/v3/projects => generated 371 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:30:22.234523 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb71a67-28f5-48ad-9634-eb461687fdc3 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:22.347576 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a006b52f-6862-4aba-aed9-ea9b05c51c96 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:22.400065 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb71a67-28f5-48ad-9634-eb461687fdc3 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:22.431671 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9135e8-4531-4766-9fda-a592d39309ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:22.432401 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9135e8-4531-4766-9fda-a592d39309ed admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:22.432744 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9135e8-4531-4766-9fda-a592d39309ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:22.433203 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9135e8-4531-4766-9fda-a592d39309ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:22.433811 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9135e8-4531-4766-9fda-a592d39309ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:22.458375 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9135e8-4531-4766-9fda-a592d39309ed admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:22.469362 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:22.493282 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72a7829-80ae-4210-bf47-7955efe4be37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7853d40c29af424c8d7913950d89750b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:22.493943 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a7829-80ae-4210-bf47-7955efe4be37 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:22.494241 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a7829-80ae-4210-bf47-7955efe4be37 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:22.494510 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a7829-80ae-4210-bf47-7955efe4be37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:22.536233 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 890/1767] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:30:22 2022] GET /identity/v3/roles => generated 1420 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:30:22.548616 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9135e8-4531-4766-9fda-a592d39309ed admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:22.605206 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9135e8-4531-4766-9fda-a592d39309ed admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:22.628170 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ed8e1-f3bc-4384-9177-06955763645f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:22.628937 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ed8e1-f3bc-4384-9177-06955763645f admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:22.629197 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ed8e1-f3bc-4384-9177-06955763645f admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:22.629615 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ed8e1-f3bc-4384-9177-06955763645f admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:22.630190 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7ed8e1-f3bc-4384-9177-06955763645f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:22.632710 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7ed8e1-f3bc-4384-9177-06955763645f admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:22.696220 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 891/1768] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:30:22 2022] POST /identity/v3/users => generated 286 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:30:22.697489 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ed8e1-f3bc-4384-9177-06955763645f admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:22.733888 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ed8e1-f3bc-4384-9177-06955763645f admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:22.766685 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2dbd73-162d-4b68-916e-23d83542f3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:22.767323 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2dbd73-162d-4b68-916e-23d83542f3af admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:22.767591 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2dbd73-162d-4b68-916e-23d83542f3af admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:22.767861 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2dbd73-162d-4b68-916e-23d83542f3af admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:22.768677 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2dbd73-162d-4b68-916e-23d83542f3af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:22.770468 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2dbd73-162d-4b68-916e-23d83542f3af admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:22.811054 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 892/1769] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:30:22 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:30:22.823701 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2dbd73-162d-4b68-916e-23d83542f3af admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:22.856424 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72a7829-80ae-4210-bf47-7955efe4be37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:22.867738 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72a7829-80ae-4210-bf47-7955efe4be37 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:22.878192 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2dbd73-162d-4b68-916e-23d83542f3af admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:22.896741 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a69340-4d3c-4ddf-9658-e6203ba5dfb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:22.898563 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a69340-4d3c-4ddf-9658-e6203ba5dfb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:22.898934 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a69340-4d3c-4ddf-9658-e6203ba5dfb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:22.899988 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a69340-4d3c-4ddf-9658-e6203ba5dfb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:22.902835 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a69340-4d3c-4ddf-9658-e6203ba5dfb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:22.904764 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a69340-4d3c-4ddf-9658-e6203ba5dfb1 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:22.906364 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 878/1770] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:30:22 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 748 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:30:22.907361 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72a7829-80ae-4210-bf47-7955efe4be37 service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:22.938839 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 893/1771] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:30:22 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:30:22.954932 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72a7829-80ae-4210-bf47-7955efe4be37 service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:22.959326 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a69340-4d3c-4ddf-9658-e6203ba5dfb1 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:22.979762 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e5d55-4865-488d-886f-d27d90481517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:22.980470 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e5d55-4865-488d-886f-d27d90481517 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:22.980746 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e5d55-4865-488d-886f-d27d90481517 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:22.981016 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e5d55-4865-488d-886f-d27d90481517 admin admin] PATH_INFO: `/v3/projects/17e2768e45ec42bd993132ab28bf6bf9/users/592314c6658a455d824c283f920d01a7/roles/13af81971c1c428eae0a571a22ea583d` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:22.988793 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a69340-4d3c-4ddf-9658-e6203ba5dfb1 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:23.024790 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38526dce-6e01-4c2d-b288-96c9251d7733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:23.025476 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38526dce-6e01-4c2d-b288-96c9251d7733 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:23.025753 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38526dce-6e01-4c2d-b288-96c9251d7733 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:23.026022 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38526dce-6e01-4c2d-b288-96c9251d7733 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:23.027133 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38526dce-6e01-4c2d-b288-96c9251d7733 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:23.028713 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38526dce-6e01-4c2d-b288-96c9251d7733 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:23.072207 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4e5d55-4865-488d-886f-d27d90481517 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17e2768e45ec42bd993132ab28bf6bf9, user_id=592314c6658a455d824c283f920d01a7, role_id=13af81971c1c428eae0a571a22ea583d)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:23.075316 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4e5d55-4865-488d-886f-d27d90481517 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:23.129525 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 879/1772] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:30:22 2022] PUT /identity/v3/projects/17e2768e45ec42bd993132ab28bf6bf9/users/592314c6658a455d824c283f920d01a7/roles/13af81971c1c428eae0a571a22ea583d => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:30:23.134456 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 894/1773] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:30:22 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:30:23.142249 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e5d55-4865-488d-886f-d27d90481517 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:23.142455 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38526dce-6e01-4c2d-b288-96c9251d7733 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:23.267426 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38526dce-6e01-4c2d-b288-96c9251d7733 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:23.369154 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e5d55-4865-488d-886f-d27d90481517 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:23.402993 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0747fca8-4c09-4aac-a96e-e0566a773549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:23.404117 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0747fca8-4c09-4aac-a96e-e0566a773549 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:23.404561 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0747fca8-4c09-4aac-a96e-e0566a773549 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:23.410797 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0747fca8-4c09-4aac-a96e-e0566a773549 admin admin] PATH_INFO: `/v3/users/de7c34a4ad84428080d9737f3b9207d6` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:23.417474 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0747fca8-4c09-4aac-a96e-e0566a773549 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de7c34a4ad84428080d9737f3b9207d6)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:23.419766 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0747fca8-4c09-4aac-a96e-e0566a773549 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:23.613343 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-0747fca8-4c09-4aac-a96e-e0566a773549 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de7c34a4ad84428080d9737f3b9207d6'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:23.646671 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-0747fca8-4c09-4aac-a96e-e0566a773549 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de7c34a4ad84428080d9737f3b9207d6'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:23.648235 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-0747fca8-4c09-4aac-a96e-e0566a773549 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de7c34a4ad84428080d9737f3b9207d6'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:23.681574 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-0747fca8-4c09-4aac-a96e-e0566a773549 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de7c34a4ad84428080d9737f3b9207d6'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:23.704649 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:23.727690 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae9504-25f9-4d71-8341-e2d5ef1e955b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:23.731459 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae9504-25f9-4d71-8341-e2d5ef1e955b admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:23.731887 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-0747fca8-4c09-4aac-a96e-e0566a773549 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de7c34a4ad84428080d9737f3b9207d6'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:23.733293 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae9504-25f9-4d71-8341-e2d5ef1e955b admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:23.734008 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae9504-25f9-4d71-8341-e2d5ef1e955b admin admin] PATH_INFO: `/v3/projects/03707b964ae44586a7d862e5013da246/users/b7f745a19ed3434599b5adc07c989aca/roles/13af81971c1c428eae0a571a22ea583d` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:23.742875 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 880/1774] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:30:23 2022] DELETE /identity/v3/users/de7c34a4ad84428080d9737f3b9207d6 => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:30:23.744465 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec72503-7929-49d4-98f4-d03b0647c7a7 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:23.744821 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec72503-7929-49d4-98f4-d03b0647c7a7 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:23.746278 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec72503-7929-49d4-98f4-d03b0647c7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:23.825345 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ae9504-25f9-4d71-8341-e2d5ef1e955b admin admin] RBAC: Authorizing `identity:create_grant(project_id=03707b964ae44586a7d862e5013da246, user_id=b7f745a19ed3434599b5adc07c989aca, role_id=13af81971c1c428eae0a571a22ea583d)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:23.834545 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ae9504-25f9-4d71-8341-e2d5ef1e955b admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:23.847656 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-0ec72503-7929-49d4-98f4-d03b0647c7a7 None None] MFA Rules not processed for user `592314c6658a455d824c283f920d01a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:23.859481 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-0ec72503-7929-49d4-98f4-d03b0647c7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:23.881543 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 895/1775] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:30:23 2022] PUT /identity/v3/projects/03707b964ae44586a7d862e5013da246/users/b7f745a19ed3434599b5adc07c989aca/roles/13af81971c1c428eae0a571a22ea583d => generated 0 bytes in 731 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 01:30:23.883232 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b12ba1c-f762-4e2d-8fee-5f5eea19139d None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:23.883523 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b12ba1c-f762-4e2d-8fee-5f5eea19139d None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:23.883807 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b12ba1c-f762-4e2d-8fee-5f5eea19139d None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:23.890460 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 896/1776] 10.222.0.26 () {54 vars in 921 bytes} [Fri Aug 12 01:30:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:30:23.891890 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a62b3-3f35-4257-a73b-8484d9d9f946 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:23.892178 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a62b3-3f35-4257-a73b-8484d9d9f946 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:23.892453 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a62b3-3f35-4257-a73b-8484d9d9f946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:23.935131 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-511a62b3-3f35-4257-a73b-8484d9d9f946 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:23.936375 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-511a62b3-3f35-4257-a73b-8484d9d9f946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:23.973386 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:24.070593 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 897/1777] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:30:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:24.075592 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8364be0-e098-45ff-a056-bf791ca8df3e None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:24.075996 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8364be0-e098-45ff-a056-bf791ca8df3e None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:24.076174 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8364be0-e098-45ff-a056-bf791ca8df3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:24.095187 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 881/1778] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:30:23 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:24.096801 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec72503-7929-49d4-98f4-d03b0647c7a7 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:24.106819 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-0ec72503-7929-49d4-98f4-d03b0647c7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:24.132190 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec72503-7929-49d4-98f4-d03b0647c7a7 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:24.137578 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3263ea40-a739-490f-b6f0-a430d3e3dd5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:24.138566 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263ea40-a739-490f-b6f0-a430d3e3dd5d admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:24.139041 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263ea40-a739-490f-b6f0-a430d3e3dd5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:24.139738 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263ea40-a739-490f-b6f0-a430d3e3dd5d admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:24.141331 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3263ea40-a739-490f-b6f0-a430d3e3dd5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:24.146896 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3263ea40-a739-490f-b6f0-a430d3e3dd5d admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:24.155122 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-d8364be0-e098-45ff-a056-bf791ca8df3e None None] MFA Rules not processed for user `b7f745a19ed3434599b5adc07c989aca`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:24.156336 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-d8364be0-e098-45ff-a056-bf791ca8df3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:24.287167 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 898/1779] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:30:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:24.296822 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 882/1780] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:30:24 2022] POST /identity/v3/projects => generated 367 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:30:24.309713 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3263ea40-a739-490f-b6f0-a430d3e3dd5d admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:24.312875 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-3263ea40-a739-490f-b6f0-a430d3e3dd5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:24.315212 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a161c-aead-467e-8528-d545930d8413 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:24.316405 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a161c-aead-467e-8528-d545930d8413 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:24.317558 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a161c-aead-467e-8528-d545930d8413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:24.395199 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-e12a161c-aead-467e-8528-d545930d8413 None None] MFA Rules not processed for user `a80678458dc9405285b70da707a399c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:24.396435 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-e12a161c-aead-467e-8528-d545930d8413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:24.520192 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3263ea40-a739-490f-b6f0-a430d3e3dd5d admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:24.524268 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ce0e55-2b8d-4cee-897b-a7c277456156 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:24.524898 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce0e55-2b8d-4cee-897b-a7c277456156 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:24.525187 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce0e55-2b8d-4cee-897b-a7c277456156 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:24.526055 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce0e55-2b8d-4cee-897b-a7c277456156 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:24.642900 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 899/1781] 10.222.0.17 () {58 vars in 1015 bytes} [Fri Aug 12 01:30:24 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:24.644228 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4849858-01a1-4852-b840-8b024e183b97 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:24.644512 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4849858-01a1-4852-b840-8b024e183b97 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:24.644788 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4849858-01a1-4852-b840-8b024e183b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:24.726300 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ce0e55-2b8d-4cee-897b-a7c277456156 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:24.727776 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ce0e55-2b8d-4cee-897b-a7c277456156 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:24.734063 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-a4849858-01a1-4852-b840-8b024e183b97 None None] MFA Rules not processed for user `06dccf61c686414d904bdf1ecf19d53d`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:24.748565 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-a4849858-01a1-4852-b840-8b024e183b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:24.772024 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 883/1782] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:30:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:30:24.774827 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ce0e55-2b8d-4cee-897b-a7c277456156 service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:24.813962 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ce0e55-2b8d-4cee-897b-a7c277456156 service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:24.825267 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631af832-400a-4105-ba1d-0ff81aa0df16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:24.825911 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631af832-400a-4105-ba1d-0ff81aa0df16 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:24.826875 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631af832-400a-4105-ba1d-0ff81aa0df16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:24.827213 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631af832-400a-4105-ba1d-0ff81aa0df16 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:24.827879 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631af832-400a-4105-ba1d-0ff81aa0df16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:24.829822 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631af832-400a-4105-ba1d-0ff81aa0df16 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:24.874317 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:24.914753 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:24.919728 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 884/1783] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:30:24 2022] POST /identity/v3/users => generated 290 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:30:24.929222 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631af832-400a-4105-ba1d-0ff81aa0df16 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:24.935305 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-631af832-400a-4105-ba1d-0ff81aa0df16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:24.982649 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 900/1784] 10.222.0.26 () {58 vars in 1018 bytes} [Fri Aug 12 01:30:24 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:24.984050 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1e09b-55ae-4cf1-a9e2-d9c8bf103447 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:24.984344 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1e09b-55ae-4cf1-a9e2-d9c8bf103447 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:24.984617 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1e09b-55ae-4cf1-a9e2-d9c8bf103447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:25.053645 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-e6d1e09b-55ae-4cf1-a9e2-d9c8bf103447 None None] MFA Rules not processed for user `619b8ee9e99c4d0b9ec1e2f91c19569d`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:25.055253 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-e6d1e09b-55ae-4cf1-a9e2-d9c8bf103447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:25.164384 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631af832-400a-4105-ba1d-0ff81aa0df16 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:25.200339 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a7b65f-a530-472c-828e-faf411f61de6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7853d40c29af424c8d7913950d89750b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:25.208463 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7b65f-a530-472c-828e-faf411f61de6 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:25.208870 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7b65f-a530-472c-828e-faf411f61de6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:25.209122 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7b65f-a530-472c-828e-faf411f61de6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:25.228272 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 901/1785] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:30:24 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:25.230161 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d1e09b-55ae-4cf1-a9e2-d9c8bf103447 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:25.246183 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d1e09b-55ae-4cf1-a9e2-d9c8bf103447 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:25.257561 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa21358-123c-4420-8388-6f8ea76deb52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:25.259583 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa21358-123c-4420-8388-6f8ea76deb52 service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:25.260078 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa21358-123c-4420-8388-6f8ea76deb52 service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:25.260537 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa21358-123c-4420-8388-6f8ea76deb52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:25.278958 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa21358-123c-4420-8388-6f8ea76deb52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:25.286570 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa21358-123c-4420-8388-6f8ea76deb52 service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:25.305301 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 902/1786] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:30:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:30:25.310336 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa21358-123c-4420-8388-6f8ea76deb52 service neutron] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:25.337988 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa21358-123c-4420-8388-6f8ea76deb52 service neutron] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:25.351912 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f85de-17c3-49b4-b5fb-57ec8e849c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:25.353250 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f85de-17c3-49b4-b5fb-57ec8e849c54 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:25.355040 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f85de-17c3-49b4-b5fb-57ec8e849c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:25.356090 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f85de-17c3-49b4-b5fb-57ec8e849c54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:25.356943 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94f85de-17c3-49b4-b5fb-57ec8e849c54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:25.360927 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94f85de-17c3-49b4-b5fb-57ec8e849c54 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:25.380144 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a7b65f-a530-472c-828e-faf411f61de6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:25.380144 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a7b65f-a530-472c-828e-faf411f61de6 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:25.391379 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 903/1787] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:30:25 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:30:25.392371 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f85de-17c3-49b4-b5fb-57ec8e849c54 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:25.396188 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-c94f85de-17c3-49b4-b5fb-57ec8e849c54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:25.401043 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 885/1788] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:30:24 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:30:25.402723 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a7b65f-a530-472c-828e-faf411f61de6 service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:25.429543 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a7b65f-a530-472c-828e-faf411f61de6 service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:25.432228 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f85de-17c3-49b4-b5fb-57ec8e849c54 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:25.439717 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159796d9-7c32-4e86-ae51-305e9d24f35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:25.440555 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159796d9-7c32-4e86-ae51-305e9d24f35c admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:25.440842 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159796d9-7c32-4e86-ae51-305e9d24f35c admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:25.441114 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159796d9-7c32-4e86-ae51-305e9d24f35c admin admin] PATH_INFO: `/v3/projects/140a1fb4583547339c3fec5a9b173cc3/users/18289aa1c2394c49b2b8bea254dede71/roles/fb48693810be495fb4b1893a79429b78` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:25.452452 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7952aaef-0d95-420f-878e-3c8c7862fd7a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06dccf61c686414d904bdf1ecf19d53d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:25.452601 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7952aaef-0d95-420f-878e-3c8c7862fd7a service placement] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:25.452880 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7952aaef-0d95-420f-878e-3c8c7862fd7a service placement] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:25.453145 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7952aaef-0d95-420f-878e-3c8c7862fd7a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:25.478046 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7952aaef-0d95-420f-878e-3c8c7862fd7a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:25.478046 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7952aaef-0d95-420f-878e-3c8c7862fd7a service placement] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:25.488310 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159796d9-7c32-4e86-ae51-305e9d24f35c admin admin] RBAC: Authorizing `identity:create_grant(project_id=140a1fb4583547339c3fec5a9b173cc3, user_id=18289aa1c2394c49b2b8bea254dede71, role_id=fb48693810be495fb4b1893a79429b78)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:25.504660 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159796d9-7c32-4e86-ae51-305e9d24f35c admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:25.515413 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 904/1789] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:30:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:30:25.517212 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7952aaef-0d95-420f-878e-3c8c7862fd7a service placement] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:25.522180 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-7952aaef-0d95-420f-878e-3c8c7862fd7a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:25.540555 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 886/1790] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:30:25 2022] PUT /identity/v3/projects/140a1fb4583547339c3fec5a9b173cc3/users/18289aa1c2394c49b2b8bea254dede71/roles/fb48693810be495fb4b1893a79429b78 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:30:25.543306 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159796d9-7c32-4e86-ae51-305e9d24f35c admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:25.579398 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7952aaef-0d95-420f-878e-3c8c7862fd7a service placement] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:25.676529 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159796d9-7c32-4e86-ae51-305e9d24f35c admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:25.684978 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6eb6bd-8ccd-4b60-a04c-faed01f74070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:25.686233 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6eb6bd-8ccd-4b60-a04c-faed01f74070 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:25.686519 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6eb6bd-8ccd-4b60-a04c-faed01f74070 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:25.686794 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6eb6bd-8ccd-4b60-a04c-faed01f74070 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:25.687457 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6eb6bd-8ccd-4b60-a04c-faed01f74070 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:25.694788 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6eb6bd-8ccd-4b60-a04c-faed01f74070 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:25.707633 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 887/1791] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:30:25 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:30:25.711810 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6eb6bd-8ccd-4b60-a04c-faed01f74070 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:25.729439 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6eb6bd-8ccd-4b60-a04c-faed01f74070 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:25.741706 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aedd8e2-af00-4110-9ed9-8c96b0648bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:25.742822 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aedd8e2-af00-4110-9ed9-8c96b0648bce admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:25.743235 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aedd8e2-af00-4110-9ed9-8c96b0648bce admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:25.743511 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aedd8e2-af00-4110-9ed9-8c96b0648bce admin admin] PATH_INFO: `/v3/projects/140a1fb4583547339c3fec5a9b173cc3/users/18289aa1c2394c49b2b8bea254dede71/roles/fb48693810be495fb4b1893a79429b78` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:25.746385 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aedd8e2-af00-4110-9ed9-8c96b0648bce admin admin] RBAC: Authorizing `identity:create_grant(project_id=140a1fb4583547339c3fec5a9b173cc3, user_id=18289aa1c2394c49b2b8bea254dede71, role_id=fb48693810be495fb4b1893a79429b78)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:25.749727 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aedd8e2-af00-4110-9ed9-8c96b0648bce admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:25.766089 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30545c0b-7c75-4f1d-928f-a46bd38d4aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:25.767926 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30545c0b-7c75-4f1d-928f-a46bd38d4aa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:25.768885 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30545c0b-7c75-4f1d-928f-a46bd38d4aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:25.771656 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30545c0b-7c75-4f1d-928f-a46bd38d4aa0 admin admin] PATH_INFO: `/v3/users/b7f745a19ed3434599b5adc07c989aca` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:25.771973 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 888/1792] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:30:25 2022] PUT /identity/v3/projects/140a1fb4583547339c3fec5a9b173cc3/users/18289aa1c2394c49b2b8bea254dede71/roles/fb48693810be495fb4b1893a79429b78 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:30:25.782856 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30545c0b-7c75-4f1d-928f-a46bd38d4aa0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7f745a19ed3434599b5adc07c989aca)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:25.785258 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30545c0b-7c75-4f1d-928f-a46bd38d4aa0 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:25.785705 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d456e-6230-4e4b-8d1b-f810843eebec None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:25.786511 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d456e-6230-4e4b-8d1b-f810843eebec None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:25.787502 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d456e-6230-4e4b-8d1b-f810843eebec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:25.816285 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:25.852142 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-e71d456e-6230-4e4b-8d1b-f810843eebec None None] MFA Rules not processed for user `18289aa1c2394c49b2b8bea254dede71`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:25.861514 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-e71d456e-6230-4e4b-8d1b-f810843eebec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:25.899768 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-30545c0b-7c75-4f1d-928f-a46bd38d4aa0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7f745a19ed3434599b5adc07c989aca'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:25.915909 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-30545c0b-7c75-4f1d-928f-a46bd38d4aa0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7f745a19ed3434599b5adc07c989aca'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:25.921147 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-30545c0b-7c75-4f1d-928f-a46bd38d4aa0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7f745a19ed3434599b5adc07c989aca'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:25.945536 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-30545c0b-7c75-4f1d-928f-a46bd38d4aa0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7f745a19ed3434599b5adc07c989aca'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:25.949820 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:25.978798 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-30545c0b-7c75-4f1d-928f-a46bd38d4aa0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7f745a19ed3434599b5adc07c989aca'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:25.996074 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 905/1793] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:30:25 2022] DELETE /identity/v3/users/b7f745a19ed3434599b5adc07c989aca => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:30:26.000793 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc6af7b-d621-4d5f-9fe9-faa36a896a8a None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:26.001100 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc6af7b-d621-4d5f-9fe9-faa36a896a8a None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:26.001331 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc6af7b-d621-4d5f-9fe9-faa36a896a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:26.051292 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-1fc6af7b-d621-4d5f-9fe9-faa36a896a8a None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:26.052520 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-1fc6af7b-d621-4d5f-9fe9-faa36a896a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:26.055783 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 889/1794] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:30:25 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:26.084961 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71d456e-6230-4e4b-8d1b-f810843eebec None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:26.086797 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-e71d456e-6230-4e4b-8d1b-f810843eebec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:26.226647 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 906/1795] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:30:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:26.231351 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71d456e-6230-4e4b-8d1b-f810843eebec None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:26.293180 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4796c30b-121b-4779-afcf-e2c386fbba21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7853d40c29af424c8d7913950d89750b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:26.294137 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4796c30b-121b-4779-afcf-e2c386fbba21 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:26.294491 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4796c30b-121b-4779-afcf-e2c386fbba21 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:26.295326 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4796c30b-121b-4779-afcf-e2c386fbba21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:26.354253 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc6af7b-d621-4d5f-9fe9-faa36a896a8a None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:26.356003 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-1fc6af7b-d621-4d5f-9fe9-faa36a896a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:26.432881 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:26.443013 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4796c30b-121b-4779-afcf-e2c386fbba21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:26.445931 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4796c30b-121b-4779-afcf-e2c386fbba21 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:26.474068 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 890/1796] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:30:26 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 01:30:26.492939 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc6af7b-d621-4d5f-9fe9-faa36a896a8a None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:26.497380 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d2d48-967f-4c93-a37f-a085d2bd960a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:26.498013 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d2d48-967f-4c93-a37f-a085d2bd960a service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:26.498359 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d2d48-967f-4c93-a37f-a085d2bd960a service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:26.498660 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d2d48-967f-4c93-a37f-a085d2bd960a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:26.516690 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386d2d48-967f-4c93-a37f-a085d2bd960a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:26.519175 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386d2d48-967f-4c93-a37f-a085d2bd960a service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:26.576764 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 907/1797] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:30:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:30:26.616337 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4796c30b-121b-4779-afcf-e2c386fbba21 service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:26.618067 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-4796c30b-121b-4779-afcf-e2c386fbba21 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:26.648014 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4796c30b-121b-4779-afcf-e2c386fbba21 service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:26.653657 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6867a77-5f81-4ff3-907e-130c073ca65f None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:26.653657 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6867a77-5f81-4ff3-907e-130c073ca65f None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:26.653657 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6867a77-5f81-4ff3-907e-130c073ca65f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:26.658090 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f336658-2558-4c7f-ba39-a5e8ca224142 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7853d40c29af424c8d7913950d89750b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:26.659053 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f336658-2558-4c7f-ba39-a5e8ca224142 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:26.660510 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f336658-2558-4c7f-ba39-a5e8ca224142 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:26.661571 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f336658-2558-4c7f-ba39-a5e8ca224142 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:26.665457 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-5f336658-2558-4c7f-ba39-a5e8ca224142 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:26.703701 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-c6867a77-5f81-4ff3-907e-130c073ca65f None None] MFA Rules not processed for user `c8e85b77280f4a779c1d2ab66891f948`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:26.705009 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-c6867a77-5f81-4ff3-907e-130c073ca65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:26.882997 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f336658-2558-4c7f-ba39-a5e8ca224142 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:26.888770 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f336658-2558-4c7f-ba39-a5e8ca224142 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:26.911822 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 908/1798] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:30:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:26.912815 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6867a77-5f81-4ff3-907e-130c073ca65f None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:26.917759 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-c6867a77-5f81-4ff3-907e-130c073ca65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:26.922869 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 891/1799] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:30:26 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:30:26.941235 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6867a77-5f81-4ff3-907e-130c073ca65f None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:26.950558 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bfef71-4c2a-4809-900c-1837421c8dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:26.951387 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bfef71-4c2a-4809-900c-1837421c8dbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:26.951693 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bfef71-4c2a-4809-900c-1837421c8dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:26.952114 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bfef71-4c2a-4809-900c-1837421c8dbb admin admin] PATH_INFO: `/v3/users/ee478987376b459b885c5386f4cdae25` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:26.954076 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bfef71-4c2a-4809-900c-1837421c8dbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee478987376b459b885c5386f4cdae25)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:26.956753 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bfef71-4c2a-4809-900c-1837421c8dbb admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:27.004444 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:27.049914 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-56bfef71-4c2a-4809-900c-1837421c8dbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee478987376b459b885c5386f4cdae25'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:27.078445 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-56bfef71-4c2a-4809-900c-1837421c8dbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee478987376b459b885c5386f4cdae25'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:27.079478 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-56bfef71-4c2a-4809-900c-1837421c8dbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee478987376b459b885c5386f4cdae25'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:27.102759 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-56bfef71-4c2a-4809-900c-1837421c8dbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee478987376b459b885c5386f4cdae25'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:27.130217 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-56bfef71-4c2a-4809-900c-1837421c8dbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee478987376b459b885c5386f4cdae25'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:27.143516 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 909/1800] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:30:26 2022] DELETE /identity/v3/users/ee478987376b459b885c5386f4cdae25 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:30:28.340068 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f336658-2558-4c7f-ba39-a5e8ca224142 service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:28.342411 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-5f336658-2558-4c7f-ba39-a5e8ca224142 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:28.403275 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f336658-2558-4c7f-ba39-a5e8ca224142 service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:28.650301 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d94efb-60c2-48ca-aab3-9820a9227f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:28.651432 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d94efb-60c2-48ca-aab3-9820a9227f0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:28.651881 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d94efb-60c2-48ca-aab3-9820a9227f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:28.652448 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d94efb-60c2-48ca-aab3-9820a9227f0e admin admin] PATH_INFO: `/v3/projects/1ed7fc2daa4246129e2d02b6fca03399` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:28.654011 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d94efb-60c2-48ca-aab3-9820a9227f0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ed7fc2daa4246129e2d02b6fca03399)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:28.656412 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d94efb-60c2-48ca-aab3-9820a9227f0e admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:28.765279 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-55d94efb-60c2-48ca-aab3-9820a9227f0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ed7fc2daa4246129e2d02b6fca03399', 'request_id': 'req-55d94efb-60c2-48ca-aab3-9820a9227f0e'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:28.794905 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-55d94efb-60c2-48ca-aab3-9820a9227f0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ed7fc2daa4246129e2d02b6fca03399', 'request_id': 'req-55d94efb-60c2-48ca-aab3-9820a9227f0e'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:28.816962 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-55d94efb-60c2-48ca-aab3-9820a9227f0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ed7fc2daa4246129e2d02b6fca03399', 'request_id': 'req-55d94efb-60c2-48ca-aab3-9820a9227f0e'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:28.865619 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-55d94efb-60c2-48ca-aab3-9820a9227f0e admin admin] The token cache is being invalidate because project 1ed7fc2daa4246129e2d02b6fca03399 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:30:28.866848 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-55d94efb-60c2-48ca-aab3-9820a9227f0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:28.868660 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-55d94efb-60c2-48ca-aab3-9820a9227f0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:28.874403 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 892/1801] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:30:28 2022] DELETE /identity/v3/projects/1ed7fc2daa4246129e2d02b6fca03399 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:30:28.879062 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bfef71-4c2a-4809-900c-1837421c8dbb admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:28.887082 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-56bfef71-4c2a-4809-900c-1837421c8dbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:28.938819 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bfef71-4c2a-4809-900c-1837421c8dbb admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:29.236904 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3cd8d4-2106-4232-b34d-3a59cc88cdc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:29.241297 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3cd8d4-2106-4232-b34d-3a59cc88cdc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:29.241602 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3cd8d4-2106-4232-b34d-3a59cc88cdc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:29.241934 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3cd8d4-2106-4232-b34d-3a59cc88cdc3 admin admin] PATH_INFO: `/v3/users/7e534ab56f5643ec891ed9ff9d705994` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:29.253024 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3cd8d4-2106-4232-b34d-3a59cc88cdc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e534ab56f5643ec891ed9ff9d705994)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:29.255236 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3cd8d4-2106-4232-b34d-3a59cc88cdc3 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:29.435545 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-ee3cd8d4-2106-4232-b34d-3a59cc88cdc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e534ab56f5643ec891ed9ff9d705994'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:29.452799 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-ee3cd8d4-2106-4232-b34d-3a59cc88cdc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e534ab56f5643ec891ed9ff9d705994'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:29.453697 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-ee3cd8d4-2106-4232-b34d-3a59cc88cdc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e534ab56f5643ec891ed9ff9d705994'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:29.494276 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-ee3cd8d4-2106-4232-b34d-3a59cc88cdc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e534ab56f5643ec891ed9ff9d705994'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:29.560163 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-ee3cd8d4-2106-4232-b34d-3a59cc88cdc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e534ab56f5643ec891ed9ff9d705994'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:29.573670 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 910/1802] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:30:28 2022] DELETE /identity/v3/users/7e534ab56f5643ec891ed9ff9d705994 => generated 0 bytes in 691 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:30:29.627838 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d94efb-60c2-48ca-aab3-9820a9227f0e admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:29.630840 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-55d94efb-60c2-48ca-aab3-9820a9227f0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:29.672254 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d94efb-60c2-48ca-aab3-9820a9227f0e admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:29.844702 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:30.105748 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bae5c41-2cb9-4180-8693-1d0bfe5a5582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:30.106554 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae5c41-2cb9-4180-8693-1d0bfe5a5582 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:30.107102 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae5c41-2cb9-4180-8693-1d0bfe5a5582 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:30.107499 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae5c41-2cb9-4180-8693-1d0bfe5a5582 admin admin] PATH_INFO: `/v3/projects/03707b964ae44586a7d862e5013da246` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:30.124356 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bae5c41-2cb9-4180-8693-1d0bfe5a5582 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03707b964ae44586a7d862e5013da246)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:30.130310 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bae5c41-2cb9-4180-8693-1d0bfe5a5582 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:30.313541 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7bae5c41-2cb9-4180-8693-1d0bfe5a5582 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03707b964ae44586a7d862e5013da246', 'request_id': 'req-7bae5c41-2cb9-4180-8693-1d0bfe5a5582'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:30.350248 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7bae5c41-2cb9-4180-8693-1d0bfe5a5582 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03707b964ae44586a7d862e5013da246', 'request_id': 'req-7bae5c41-2cb9-4180-8693-1d0bfe5a5582'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:30.390608 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7bae5c41-2cb9-4180-8693-1d0bfe5a5582 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03707b964ae44586a7d862e5013da246', 'request_id': 'req-7bae5c41-2cb9-4180-8693-1d0bfe5a5582'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:30.442869 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7bae5c41-2cb9-4180-8693-1d0bfe5a5582 admin admin] The token cache is being invalidate because project 03707b964ae44586a7d862e5013da246 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:30:30.443169 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7bae5c41-2cb9-4180-8693-1d0bfe5a5582 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:30.446427 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7bae5c41-2cb9-4180-8693-1d0bfe5a5582 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:30.455156 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd73cd43-cbb4-47d0-a3c0-fc32a4c2d764 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:30.455663 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd73cd43-cbb4-47d0-a3c0-fc32a4c2d764 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:30.455663 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd73cd43-cbb4-47d0-a3c0-fc32a4c2d764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:30.469995 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 893/1803] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:30:29 2022] DELETE /identity/v3/projects/03707b964ae44586a7d862e5013da246 => generated 0 bytes in 823 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:30:30.547911 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-cd73cd43-cbb4-47d0-a3c0-fc32a4c2d764 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:30.565623 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-cd73cd43-cbb4-47d0-a3c0-fc32a4c2d764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:30.634981 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:30.823707 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 911/1804] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:30:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:30.840682 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1e883-64f2-4b71-a332-60c42e8c455d None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:30.841098 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1e883-64f2-4b71-a332-60c42e8c455d None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:30.841235 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1e883-64f2-4b71-a332-60c42e8c455d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:30.950363 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-45a1e883-64f2-4b71-a332-60c42e8c455d None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:30.951615 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-45a1e883-64f2-4b71-a332-60c42e8c455d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:30.987423 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 894/1805] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:30:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:30.988823 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd73cd43-cbb4-47d0-a3c0-fc32a4c2d764 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:31.007633 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd73cd43-cbb4-47d0-a3c0-fc32a4c2d764 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:31.027086 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f150520-438c-44e7-8727-c67d22366306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:31.032186 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f150520-438c-44e7-8727-c67d22366306 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:31.032802 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f150520-438c-44e7-8727-c67d22366306 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:31.033268 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f150520-438c-44e7-8727-c67d22366306 admin admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:31.038713 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f150520-438c-44e7-8727-c67d22366306 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:30:31.039813 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f150520-438c-44e7-8727-c67d22366306 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:31.043783 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f150520-438c-44e7-8727-c67d22366306 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:31.077412 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 912/1806] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 01:30:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:30:31.084839 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a1e883-64f2-4b71-a332-60c42e8c455d None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:31.107937 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a1e883-64f2-4b71-a332-60c42e8c455d None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:31.127916 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8447970-249b-4f31-8e94-319bafe85433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:31.128625 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8447970-249b-4f31-8e94-319bafe85433 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:31.128917 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8447970-249b-4f31-8e94-319bafe85433 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:31.129189 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8447970-249b-4f31-8e94-319bafe85433 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:31.130741 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8447970-249b-4f31-8e94-319bafe85433 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:31.133065 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8447970-249b-4f31-8e94-319bafe85433 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:31.169820 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f150520-438c-44e7-8727-c67d22366306 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:31.173469 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-9f150520-438c-44e7-8727-c67d22366306 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:31.220747 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f150520-438c-44e7-8727-c67d22366306 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:31.229061 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 895/1807] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:30:31 2022] POST /identity/v3/projects => generated 377 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:30:31.230415 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8447970-249b-4f31-8e94-319bafe85433 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:31.442477 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8447970-249b-4f31-8e94-319bafe85433 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:31.461456 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580fcfe8-affa-42b1-915e-a1d92f4d2549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:31.462601 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580fcfe8-affa-42b1-915e-a1d92f4d2549 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:31.463015 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580fcfe8-affa-42b1-915e-a1d92f4d2549 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:31.463437 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580fcfe8-affa-42b1-915e-a1d92f4d2549 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:31.464252 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580fcfe8-affa-42b1-915e-a1d92f4d2549 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:31.466565 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580fcfe8-affa-42b1-915e-a1d92f4d2549 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:31.503972 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee4e340-d1fd-4e72-9afb-8c0e6b41b435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:31.505385 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee4e340-d1fd-4e72-9afb-8c0e6b41b435 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:31.508784 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee4e340-d1fd-4e72-9afb-8c0e6b41b435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:31.509353 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee4e340-d1fd-4e72-9afb-8c0e6b41b435 admin admin] PATH_INFO: `/v3/projects/390d4f51719446699fdcd052ffaa423a` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:31.511620 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee4e340-d1fd-4e72-9afb-8c0e6b41b435 admin admin] RBAC: Authorizing `identity:delete_project(project_id=390d4f51719446699fdcd052ffaa423a)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:31.516661 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee4e340-d1fd-4e72-9afb-8c0e6b41b435 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:31.554641 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 896/1808] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:30:31 2022] POST /identity/v3/users => generated 289 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:30:31.561632 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580fcfe8-affa-42b1-915e-a1d92f4d2549 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:31.609590 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580fcfe8-affa-42b1-915e-a1d92f4d2549 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:31.637944 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5510311-586a-4326-ad3d-def1b2d896ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:31.638616 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5510311-586a-4326-ad3d-def1b2d896ca admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:31.638895 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5510311-586a-4326-ad3d-def1b2d896ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:31.639173 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5510311-586a-4326-ad3d-def1b2d896ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:31.639834 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5510311-586a-4326-ad3d-def1b2d896ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:31.651496 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5510311-586a-4326-ad3d-def1b2d896ca admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:31.697718 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 897/1809] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:30:31 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:30:31.702605 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5510311-586a-4326-ad3d-def1b2d896ca admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:31.710651 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:31.732171 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-1ee4e340-d1fd-4e72-9afb-8c0e6b41b435 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '390d4f51719446699fdcd052ffaa423a', 'request_id': 'req-1ee4e340-d1fd-4e72-9afb-8c0e6b41b435'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:31.744044 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5510311-586a-4326-ad3d-def1b2d896ca admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:31.760741 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-1ee4e340-d1fd-4e72-9afb-8c0e6b41b435 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '390d4f51719446699fdcd052ffaa423a', 'request_id': 'req-1ee4e340-d1fd-4e72-9afb-8c0e6b41b435'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:31.829039 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-1ee4e340-d1fd-4e72-9afb-8c0e6b41b435 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '390d4f51719446699fdcd052ffaa423a', 'request_id': 'req-1ee4e340-d1fd-4e72-9afb-8c0e6b41b435'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:31.923232 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-1ee4e340-d1fd-4e72-9afb-8c0e6b41b435 admin admin] The token cache is being invalidate because project 390d4f51719446699fdcd052ffaa423a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:30:31.924901 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-1ee4e340-d1fd-4e72-9afb-8c0e6b41b435 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:31.929543 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-1ee4e340-d1fd-4e72-9afb-8c0e6b41b435 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:31.966524 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 913/1810] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:30:31 2022] DELETE /identity/v3/projects/390d4f51719446699fdcd052ffaa423a => generated 0 bytes in 793 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 01:30:31.972298 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee4e340-d1fd-4e72-9afb-8c0e6b41b435 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:31.979149 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-1ee4e340-d1fd-4e72-9afb-8c0e6b41b435 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:32.069771 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa22edc3-0c27-4e53-8022-5e8df3977d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:32.071222 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22edc3-0c27-4e53-8022-5e8df3977d25 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:32.081305 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22edc3-0c27-4e53-8022-5e8df3977d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:32.081638 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22edc3-0c27-4e53-8022-5e8df3977d25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:32.082468 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa22edc3-0c27-4e53-8022-5e8df3977d25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:32.090287 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa22edc3-0c27-4e53-8022-5e8df3977d25 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:32.144386 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 898/1811] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:30:31 2022] GET /identity/v3/roles => generated 1420 bytes in 439 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:30:32.149494 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa22edc3-0c27-4e53-8022-5e8df3977d25 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:32.184681 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-fa22edc3-0c27-4e53-8022-5e8df3977d25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:32.303613 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa22edc3-0c27-4e53-8022-5e8df3977d25 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:32.343075 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5027e3b-62ce-40c4-a089-342c31140c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:32.344598 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5027e3b-62ce-40c4-a089-342c31140c21 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:32.347192 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5027e3b-62ce-40c4-a089-342c31140c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:32.347784 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5027e3b-62ce-40c4-a089-342c31140c21 admin admin] PATH_INFO: `/v3/projects/fddf7ff1599b4253889dd5cb57f59cfe/users/d63bf659b6344f8aa5800139e1d6db23/roles/13af81971c1c428eae0a571a22ea583d` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:32.354238 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:32.440664 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5027e3b-62ce-40c4-a089-342c31140c21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fddf7ff1599b4253889dd5cb57f59cfe, user_id=d63bf659b6344f8aa5800139e1d6db23, role_id=13af81971c1c428eae0a571a22ea583d)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:32.445459 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5027e3b-62ce-40c4-a089-342c31140c21 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:32.498659 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee4e340-d1fd-4e72-9afb-8c0e6b41b435 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:32.542488 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 899/1812] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:30:32 2022] PUT /identity/v3/projects/fddf7ff1599b4253889dd5cb57f59cfe/users/d63bf659b6344f8aa5800139e1d6db23/roles/13af81971c1c428eae0a571a22ea583d => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:30:32.550434 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbaed34-a9ca-4191-91d4-1ddef7a2f7d5 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:32.553960 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbaed34-a9ca-4191-91d4-1ddef7a2f7d5 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:32.555804 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbaed34-a9ca-4191-91d4-1ddef7a2f7d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:32.620850 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-3fbaed34-a9ca-4191-91d4-1ddef7a2f7d5 None None] MFA Rules not processed for user `d63bf659b6344f8aa5800139e1d6db23`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:32.623461 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-3fbaed34-a9ca-4191-91d4-1ddef7a2f7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:32.730486 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f959e95-e8f9-441c-bf06-0b7dbbfd3a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:32.736567 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f959e95-e8f9-441c-bf06-0b7dbbfd3a11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:32.737222 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f959e95-e8f9-441c-bf06-0b7dbbfd3a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:32.737712 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f959e95-e8f9-441c-bf06-0b7dbbfd3a11 admin admin] PATH_INFO: `/v3/users/feefdb22832f41029bc9fa5a0a84e6d7` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:32.744365 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f959e95-e8f9-441c-bf06-0b7dbbfd3a11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=feefdb22832f41029bc9fa5a0a84e6d7)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:32.747370 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f959e95-e8f9-441c-bf06-0b7dbbfd3a11 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:32.835545 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 900/1813] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:30:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:32.860846 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbaed34-a9ca-4191-91d4-1ddef7a2f7d5 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:32.867395 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-3fbaed34-a9ca-4191-91d4-1ddef7a2f7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:32.968611 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-0f959e95-e8f9-441c-bf06-0b7dbbfd3a11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'feefdb22832f41029bc9fa5a0a84e6d7'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:32.990345 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-0f959e95-e8f9-441c-bf06-0b7dbbfd3a11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'feefdb22832f41029bc9fa5a0a84e6d7'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:32.992091 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-0f959e95-e8f9-441c-bf06-0b7dbbfd3a11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'feefdb22832f41029bc9fa5a0a84e6d7'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:33.017961 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-0f959e95-e8f9-441c-bf06-0b7dbbfd3a11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'feefdb22832f41029bc9fa5a0a84e6d7'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:33.082472 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-0f959e95-e8f9-441c-bf06-0b7dbbfd3a11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'feefdb22832f41029bc9fa5a0a84e6d7'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:33.112468 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:33.124169 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 914/1814] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:30:31 2022] DELETE /identity/v3/users/feefdb22832f41029bc9fa5a0a84e6d7 => generated 0 bytes in 1157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:30:33.159309 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbaed34-a9ca-4191-91d4-1ddef7a2f7d5 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:33.411049 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea9e6c6-16e5-4345-bce2-f99c469a2df2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd73d9b9b63a499d909fec034bf9a259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:33.411754 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea9e6c6-16e5-4345-bce2-f99c469a2df2 service glance] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:33.412129 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea9e6c6-16e5-4345-bce2-f99c469a2df2 service glance] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:33.412525 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea9e6c6-16e5-4345-bce2-f99c469a2df2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:33.452414 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-1ea9e6c6-16e5-4345-bce2-f99c469a2df2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:33.835147 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea9e6c6-16e5-4345-bce2-f99c469a2df2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:33.837495 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea9e6c6-16e5-4345-bce2-f99c469a2df2 service glance] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:33.888479 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 901/1815] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:30:32 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 1030 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:30:34.048273 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa6286-ec4f-4908-a55a-3b6fb0f2e32d None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:34.048786 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa6286-ec4f-4908-a55a-3b6fb0f2e32d None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:34.049159 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa6286-ec4f-4908-a55a-3b6fb0f2e32d None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:34.051224 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 915/1816] 10.222.0.26 () {54 vars in 921 bytes} [Fri Aug 12 01:30:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:30:34.053848 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea9e6c6-16e5-4345-bce2-f99c469a2df2 service glance] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:34.056036 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-1ea9e6c6-16e5-4345-bce2-f99c469a2df2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:34.178049 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240f656-c9c7-438d-8fba-101eb1dc3499 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:34.178049 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240f656-c9c7-438d-8fba-101eb1dc3499 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:34.178504 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240f656-c9c7-438d-8fba-101eb1dc3499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:34.251127 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-1240f656-c9c7-438d-8fba-101eb1dc3499 None None] MFA Rules not processed for user `fcd5e95467b44175be2478c2c7c89926`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:34.253211 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-1240f656-c9c7-438d-8fba-101eb1dc3499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:34.478250 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea9e6c6-16e5-4345-bce2-f99c469a2df2 service glance] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:34.503159 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:34.505711 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a016311-e9b3-4418-8e32-820419b37c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:34.510715 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a016311-e9b3-4418-8e32-820419b37c8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:34.511008 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a016311-e9b3-4418-8e32-820419b37c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:34.511289 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a016311-e9b3-4418-8e32-820419b37c8c admin admin] PATH_INFO: `/v3/users/592314c6658a455d824c283f920d01a7` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:34.516668 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a016311-e9b3-4418-8e32-820419b37c8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=592314c6658a455d824c283f920d01a7)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:34.550407 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a016311-e9b3-4418-8e32-820419b37c8c admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:34.584408 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 916/1817] 10.222.0.26 () {58 vars in 1018 bytes} [Fri Aug 12 01:30:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 407 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:34.849607 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-0a016311-e9b3-4418-8e32-820419b37c8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '592314c6658a455d824c283f920d01a7'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:34.887648 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-0a016311-e9b3-4418-8e32-820419b37c8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '592314c6658a455d824c283f920d01a7'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:34.889926 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-0a016311-e9b3-4418-8e32-820419b37c8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '592314c6658a455d824c283f920d01a7'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:34.902968 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:34.904714 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1240f656-c9c7-438d-8fba-101eb1dc3499 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:34.906107 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-1240f656-c9c7-438d-8fba-101eb1dc3499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:34.935571 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-0a016311-e9b3-4418-8e32-820419b37c8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '592314c6658a455d824c283f920d01a7'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:34.940376 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1240f656-c9c7-438d-8fba-101eb1dc3499 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:34.961223 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8b2587-dfce-4bcf-9ab6-f78dfaad63fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:34.961891 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b2587-dfce-4bcf-9ab6-f78dfaad63fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:34.968610 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b2587-dfce-4bcf-9ab6-f78dfaad63fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:34.968974 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b2587-dfce-4bcf-9ab6-f78dfaad63fd admin admin] PATH_INFO: `/v3/projects/fc4d15d9bd7a4db88a847aea425f9584` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:34.971748 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-0a016311-e9b3-4418-8e32-820419b37c8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '592314c6658a455d824c283f920d01a7'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:34.976140 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8b2587-dfce-4bcf-9ab6-f78dfaad63fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc4d15d9bd7a4db88a847aea425f9584)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:34.982364 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8b2587-dfce-4bcf-9ab6-f78dfaad63fd admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:35.022819 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 902/1818] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:30:34 2022] DELETE /identity/v3/users/592314c6658a455d824c283f920d01a7 => generated 0 bytes in 969 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:30:35.028262 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c663ca6e-e491-4c90-bca6-2e9fc38725a8 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:35.028543 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c663ca6e-e491-4c90-bca6-2e9fc38725a8 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:35.028816 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c663ca6e-e491-4c90-bca6-2e9fc38725a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:35.141878 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-c663ca6e-e491-4c90-bca6-2e9fc38725a8 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:35.143228 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c663ca6e-e491-4c90-bca6-2e9fc38725a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:35.232907 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-7d8b2587-dfce-4bcf-9ab6-f78dfaad63fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc4d15d9bd7a4db88a847aea425f9584', 'request_id': 'req-7d8b2587-dfce-4bcf-9ab6-f78dfaad63fd'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:35.267318 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-7d8b2587-dfce-4bcf-9ab6-f78dfaad63fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc4d15d9bd7a4db88a847aea425f9584', 'request_id': 'req-7d8b2587-dfce-4bcf-9ab6-f78dfaad63fd'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:35.302900 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-7d8b2587-dfce-4bcf-9ab6-f78dfaad63fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc4d15d9bd7a4db88a847aea425f9584', 'request_id': 'req-7d8b2587-dfce-4bcf-9ab6-f78dfaad63fd'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:35.333330 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-7d8b2587-dfce-4bcf-9ab6-f78dfaad63fd admin admin] The token cache is being invalidate because project fc4d15d9bd7a4db88a847aea425f9584 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:30:35.333666 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-7d8b2587-dfce-4bcf-9ab6-f78dfaad63fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:35.337222 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-7d8b2587-dfce-4bcf-9ab6-f78dfaad63fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:35.347261 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 917/1819] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:30:34 2022] DELETE /identity/v3/projects/fc4d15d9bd7a4db88a847aea425f9584 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:30:35.348800 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacac3e4-9650-4839-b660-a4bf8e0c402e None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:35.349093 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacac3e4-9650-4839-b660-a4bf8e0c402e None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:35.349358 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacac3e4-9650-4839-b660-a4bf8e0c402e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:35.394595 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-dacac3e4-9650-4839-b660-a4bf8e0c402e None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:35.399031 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-dacac3e4-9650-4839-b660-a4bf8e0c402e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:35.578847 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 903/1820] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:30:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 551 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:35.590287 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c663ca6e-e491-4c90-bca6-2e9fc38725a8 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:35.603736 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c663ca6e-e491-4c90-bca6-2e9fc38725a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:35.630061 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 918/1821] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:30:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:35.632200 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e8c077-4149-4365-9dcb-c16f156bbf14 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:35.640006 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e8c077-4149-4365-9dcb-c16f156bbf14 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:35.641278 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e8c077-4149-4365-9dcb-c16f156bbf14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:35.739497 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-26e8c077-4149-4365-9dcb-c16f156bbf14 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:35.740977 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-26e8c077-4149-4365-9dcb-c16f156bbf14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:35.781756 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 919/1822] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:30:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:35.792504 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e8c077-4149-4365-9dcb-c16f156bbf14 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:35.807896 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e8c077-4149-4365-9dcb-c16f156bbf14 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:35.831441 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7818f4dc-c1d9-4a05-9cbc-c8e65f446d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:35.831600 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7818f4dc-c1d9-4a05-9cbc-c8e65f446d81 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:35.832034 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7818f4dc-c1d9-4a05-9cbc-c8e65f446d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:35.832295 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7818f4dc-c1d9-4a05-9cbc-c8e65f446d81 admin admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:35.833139 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7818f4dc-c1d9-4a05-9cbc-c8e65f446d81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:30:35.833442 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7818f4dc-c1d9-4a05-9cbc-c8e65f446d81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:35.835132 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7818f4dc-c1d9-4a05-9cbc-c8e65f446d81 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:35.892494 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 920/1823] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 01:30:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:30:35.911407 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7818f4dc-c1d9-4a05-9cbc-c8e65f446d81 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:35.948562 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7818f4dc-c1d9-4a05-9cbc-c8e65f446d81 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:35.985523 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e437b726-7b9e-457d-8f41-c53081dd435b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:35.989047 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e437b726-7b9e-457d-8f41-c53081dd435b admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:35.990007 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e437b726-7b9e-457d-8f41-c53081dd435b admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:35.993165 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e437b726-7b9e-457d-8f41-c53081dd435b admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:35.993879 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e437b726-7b9e-457d-8f41-c53081dd435b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:36.006193 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e437b726-7b9e-457d-8f41-c53081dd435b admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:36.084336 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c663ca6e-e491-4c90-bca6-2e9fc38725a8 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:36.158705 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 921/1824] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:30:35 2022] POST /identity/v3/projects => generated 379 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:30:36.161317 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e437b726-7b9e-457d-8f41-c53081dd435b admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:36.167591 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-e437b726-7b9e-457d-8f41-c53081dd435b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:36.382340 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:36.400392 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e5257-f721-4bb0-842e-032d3b44cb24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd5e95467b44175be2478c2c7c89926', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:36.401037 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e5257-f721-4bb0-842e-032d3b44cb24 service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:36.406083 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e5257-f721-4bb0-842e-032d3b44cb24 service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:36.406377 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e5257-f721-4bb0-842e-032d3b44cb24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:36.409094 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-7d5e5257-f721-4bb0-842e-032d3b44cb24 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:36.455953 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5e5257-f721-4bb0-842e-032d3b44cb24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:36.457744 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5e5257-f721-4bb0-842e-032d3b44cb24 service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:36.459228 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e437b726-7b9e-457d-8f41-c53081dd435b admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:36.477978 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:36.479564 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6619e66d-be04-4182-bff1-9e1018e1f288 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:36.481035 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619e66d-be04-4182-bff1-9e1018e1f288 service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:36.495677 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619e66d-be04-4182-bff1-9e1018e1f288 service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:36.496855 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619e66d-be04-4182-bff1-9e1018e1f288 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:36.511649 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 904/1825] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:30:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 929 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:30:36.513975 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e5257-f721-4bb0-842e-032d3b44cb24 service nova] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:36.550149 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e5257-f721-4bb0-842e-032d3b44cb24 service nova] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:36.759291 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6619e66d-be04-4182-bff1-9e1018e1f288 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:36.762446 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5093a71-5832-4cb8-a2a4-0d79738eff27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:36.764633 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6619e66d-be04-4182-bff1-9e1018e1f288 service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:36.764772 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5093a71-5832-4cb8-a2a4-0d79738eff27 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:36.764993 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5093a71-5832-4cb8-a2a4-0d79738eff27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:36.765269 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5093a71-5832-4cb8-a2a4-0d79738eff27 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:36.770779 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5093a71-5832-4cb8-a2a4-0d79738eff27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:36.779443 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5093a71-5832-4cb8-a2a4-0d79738eff27 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:36.810708 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 922/1826] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:30:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 650 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:30:36.812906 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6619e66d-be04-4182-bff1-9e1018e1f288 service neutron] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:36.818396 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-6619e66d-be04-4182-bff1-9e1018e1f288 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:36.842543 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6619e66d-be04-4182-bff1-9e1018e1f288 service neutron] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:36.848935 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 905/1827] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:30:36 2022] POST /identity/v3/users => generated 290 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:30:36.850503 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79db8bf-8587-45b8-87b9-49866610d37a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:36.851411 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79db8bf-8587-45b8-87b9-49866610d37a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:36.851936 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79db8bf-8587-45b8-87b9-49866610d37a admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:36.852452 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79db8bf-8587-45b8-87b9-49866610d37a admin admin] PATH_INFO: `/v3/projects/b2155277fa054e69b692ae3c66ffda8f` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:36.853945 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79db8bf-8587-45b8-87b9-49866610d37a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2155277fa054e69b692ae3c66ffda8f)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:36.854251 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec13c6a6-d392-45ad-bf42-5fad5c517c8c None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:36.854645 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec13c6a6-d392-45ad-bf42-5fad5c517c8c None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:36.854872 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec13c6a6-d392-45ad-bf42-5fad5c517c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:36.857097 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79db8bf-8587-45b8-87b9-49866610d37a admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:36.915796 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-ec13c6a6-d392-45ad-bf42-5fad5c517c8c None None] MFA Rules not processed for user `f3643631cf2d4a9592d465bdeba99669`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:36.920639 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-ec13c6a6-d392-45ad-bf42-5fad5c517c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:36.996921 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-d79db8bf-8587-45b8-87b9-49866610d37a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2155277fa054e69b692ae3c66ffda8f', 'request_id': 'req-d79db8bf-8587-45b8-87b9-49866610d37a'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:37.010722 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-d79db8bf-8587-45b8-87b9-49866610d37a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2155277fa054e69b692ae3c66ffda8f', 'request_id': 'req-d79db8bf-8587-45b8-87b9-49866610d37a'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:37.027407 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-d79db8bf-8587-45b8-87b9-49866610d37a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2155277fa054e69b692ae3c66ffda8f', 'request_id': 'req-d79db8bf-8587-45b8-87b9-49866610d37a'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:37.063694 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-d79db8bf-8587-45b8-87b9-49866610d37a admin admin] The token cache is being invalidate because project b2155277fa054e69b692ae3c66ffda8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:30:37.064675 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-d79db8bf-8587-45b8-87b9-49866610d37a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:37.066480 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-d79db8bf-8587-45b8-87b9-49866610d37a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:37.071160 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 923/1828] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:30:36 2022] DELETE /identity/v3/projects/b2155277fa054e69b692ae3c66ffda8f => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:30:37.072283 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79db8bf-8587-45b8-87b9-49866610d37a admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:37.088734 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-d79db8bf-8587-45b8-87b9-49866610d37a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:37.123252 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 906/1829] 10.222.0.26 () {58 vars in 1009 bytes} [Fri Aug 12 01:30:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:37.125284 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8b080f-8f9a-48a0-b8cf-ea999bf27827 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:37.127986 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8b080f-8f9a-48a0-b8cf-ea999bf27827 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:37.127986 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8b080f-8f9a-48a0-b8cf-ea999bf27827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:37.178399 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-3a8b080f-8f9a-48a0-b8cf-ea999bf27827 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:37.183585 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-3a8b080f-8f9a-48a0-b8cf-ea999bf27827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:37.272022 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79db8bf-8587-45b8-87b9-49866610d37a admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:37.293836 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6a5c0b-6c24-4dec-916e-a0a9c10d3181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:37.294866 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a5c0b-6c24-4dec-916e-a0a9c10d3181 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:37.295446 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a5c0b-6c24-4dec-916e-a0a9c10d3181 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:37.295894 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6a5c0b-6c24-4dec-916e-a0a9c10d3181 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:37.296606 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6a5c0b-6c24-4dec-916e-a0a9c10d3181 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:37.298964 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6a5c0b-6c24-4dec-916e-a0a9c10d3181 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:37.313178 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 924/1830] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:30:37 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:30:37.321329 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6a5c0b-6c24-4dec-916e-a0a9c10d3181 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:37.323124 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-cc6a5c0b-6c24-4dec-916e-a0a9c10d3181 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:37.339266 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:37.365519 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 907/1831] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:30:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:37.367209 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8b080f-8f9a-48a0-b8cf-ea999bf27827 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:37.397931 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8b080f-8f9a-48a0-b8cf-ea999bf27827 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:37.411179 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d0f3f5-57c7-4e04-9c12-c9d20be68d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:37.411179 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d0f3f5-57c7-4e04-9c12-c9d20be68d35 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:37.411179 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d0f3f5-57c7-4e04-9c12-c9d20be68d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:37.411573 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d0f3f5-57c7-4e04-9c12-c9d20be68d35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:37.412097 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d0f3f5-57c7-4e04-9c12-c9d20be68d35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:37.413813 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d0f3f5-57c7-4e04-9c12-c9d20be68d35 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:37.437507 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 908/1832] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:30:37 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:30:37.438983 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fcc7d1-13d2-49b9-8735-c1c3701b24a8 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:37.439268 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fcc7d1-13d2-49b9-8735-c1c3701b24a8 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:37.439540 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fcc7d1-13d2-49b9-8735-c1c3701b24a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:37.469836 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-53fcc7d1-13d2-49b9-8735-c1c3701b24a8 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:37.472368 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-53fcc7d1-13d2-49b9-8735-c1c3701b24a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:37.488080 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6a5c0b-6c24-4dec-916e-a0a9c10d3181 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:37.498706 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 909/1833] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:30:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:37.501494 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fcc7d1-13d2-49b9-8735-c1c3701b24a8 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:37.507329 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e303fdd-fdf5-4120-8732-82aed5129abb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32c1ba237f864b5d9699cb817e42e647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:37.507987 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e303fdd-fdf5-4120-8732-82aed5129abb service swift] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:37.508278 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e303fdd-fdf5-4120-8732-82aed5129abb service swift] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:37.508535 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e303fdd-fdf5-4120-8732-82aed5129abb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:37.519618 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fcc7d1-13d2-49b9-8735-c1c3701b24a8 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:37.537023 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aaa466-206f-45fd-b9e0-f10e724917cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:37.540621 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aaa466-206f-45fd-b9e0-f10e724917cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:37.541072 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aaa466-206f-45fd-b9e0-f10e724917cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:37.542883 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aaa466-206f-45fd-b9e0-f10e724917cf admin admin] PATH_INFO: `/v3/projects/07d576b52602419f8ce0abed478fa31c/users/bd2b7fb589df48e3bd699a79cb1f58fe/roles/13af81971c1c428eae0a571a22ea583d` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:37.584949 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:37.593888 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aaa466-206f-45fd-b9e0-f10e724917cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=07d576b52602419f8ce0abed478fa31c, user_id=bd2b7fb589df48e3bd699a79cb1f58fe, role_id=13af81971c1c428eae0a571a22ea583d)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:37.607855 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aaa466-206f-45fd-b9e0-f10e724917cf admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:37.629171 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 910/1834] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:30:37 2022] PUT /identity/v3/projects/07d576b52602419f8ce0abed478fa31c/users/bd2b7fb589df48e3bd699a79cb1f58fe/roles/13af81971c1c428eae0a571a22ea583d => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:30:37.630019 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aaa466-206f-45fd-b9e0-f10e724917cf admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:37.654878 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e303fdd-fdf5-4120-8732-82aed5129abb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:37.656907 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e303fdd-fdf5-4120-8732-82aed5129abb service swift] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:37.681618 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 925/1835] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Aug 12 01:30:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 12 01:30:37.689442 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c3ad0-4c96-437a-8289-cf32a5c089d4 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:37.689835 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c3ad0-4c96-437a-8289-cf32a5c089d4 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:37.690238 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c3ad0-4c96-437a-8289-cf32a5c089d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:37.832836 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aaa466-206f-45fd-b9e0-f10e724917cf admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:37.844287 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-4d3c3ad0-4c96-437a-8289-cf32a5c089d4 None None] MFA Rules not processed for user `bd2b7fb589df48e3bd699a79cb1f58fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:37.849806 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408bd7b7-56a2-421b-a454-b28412639d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:37.851516 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-4d3c3ad0-4c96-437a-8289-cf32a5c089d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:37.852313 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408bd7b7-56a2-421b-a454-b28412639d46 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:37.853756 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408bd7b7-56a2-421b-a454-b28412639d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:37.854216 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408bd7b7-56a2-421b-a454-b28412639d46 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:37.857927 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408bd7b7-56a2-421b-a454-b28412639d46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:30:37.858591 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408bd7b7-56a2-421b-a454-b28412639d46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:37.863006 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408bd7b7-56a2-421b-a454-b28412639d46 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:37.911576 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 911/1836] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 01:30:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:30:37.914376 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408bd7b7-56a2-421b-a454-b28412639d46 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:37.941863 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408bd7b7-56a2-421b-a454-b28412639d46 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:37.958917 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7fec55-3f2e-4e16-bdd0-d2842890e183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:37.958917 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7fec55-3f2e-4e16-bdd0-d2842890e183 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:37.959154 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7fec55-3f2e-4e16-bdd0-d2842890e183 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:37.959876 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7fec55-3f2e-4e16-bdd0-d2842890e183 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:37.960718 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7fec55-3f2e-4e16-bdd0-d2842890e183 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:37.963369 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7fec55-3f2e-4e16-bdd0-d2842890e183 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:38.028151 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 912/1837] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:30:37 2022] POST /identity/v3/projects => generated 379 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:30:38.030198 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7fec55-3f2e-4e16-bdd0-d2842890e183 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:38.163637 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 926/1838] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:30:37 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 481 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:38.168988 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3c3ad0-4c96-437a-8289-cf32a5c089d4 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:38.196558 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3c3ad0-4c96-437a-8289-cf32a5c089d4 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:38.255225 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7fec55-3f2e-4e16-bdd0-d2842890e183 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:38.280974 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ef321c-04c8-43b0-bce7-6f8c3ae7b5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:38.282664 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef321c-04c8-43b0-bce7-6f8c3ae7b5db admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:38.282664 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef321c-04c8-43b0-bce7-6f8c3ae7b5db admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:38.282664 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef321c-04c8-43b0-bce7-6f8c3ae7b5db admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:38.282931 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ef321c-04c8-43b0-bce7-6f8c3ae7b5db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:38.284783 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ef321c-04c8-43b0-bce7-6f8c3ae7b5db admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:38.373253 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 913/1839] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:30:38 2022] POST /identity/v3/users => generated 290 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:30:38.373810 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:38.374274 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ef321c-04c8-43b0-bce7-6f8c3ae7b5db admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:38.403845 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ef321c-04c8-43b0-bce7-6f8c3ae7b5db admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:38.437719 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e9e3f4-f5c0-424a-b3b8-2e9007dc5546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:38.453894 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9e3f4-f5c0-424a-b3b8-2e9007dc5546 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:38.454764 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9e3f4-f5c0-424a-b3b8-2e9007dc5546 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:38.455143 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9e3f4-f5c0-424a-b3b8-2e9007dc5546 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:38.455714 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e9e3f4-f5c0-424a-b3b8-2e9007dc5546 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:38.460423 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e9e3f4-f5c0-424a-b3b8-2e9007dc5546 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:38.466432 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2fa00c-d5c8-43ae-978f-8049279c858e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:38.468235 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2fa00c-d5c8-43ae-978f-8049279c858e admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:38.468527 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2fa00c-d5c8-43ae-978f-8049279c858e admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:38.469014 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2fa00c-d5c8-43ae-978f-8049279c858e admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:38.469856 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2fa00c-d5c8-43ae-978f-8049279c858e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:38.477053 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2fa00c-d5c8-43ae-978f-8049279c858e admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:38.501071 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 914/1840] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:30:38 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:30:38.507004 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e9e3f4-f5c0-424a-b3b8-2e9007dc5546 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:38.560386 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e9e3f4-f5c0-424a-b3b8-2e9007dc5546 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:38.576527 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0923bd28-e546-42bd-b1ea-65136c1a26cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:38.580927 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923bd28-e546-42bd-b1ea-65136c1a26cd admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:38.581205 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923bd28-e546-42bd-b1ea-65136c1a26cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:38.582064 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923bd28-e546-42bd-b1ea-65136c1a26cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:38.582791 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0923bd28-e546-42bd-b1ea-65136c1a26cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:38.589399 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0923bd28-e546-42bd-b1ea-65136c1a26cd admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:38.601667 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 927/1841] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:30:38 2022] POST /identity/v3/projects => generated 377 bytes in 432 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 01:30:38.602310 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2fa00c-d5c8-43ae-978f-8049279c858e admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:38.638067 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 915/1842] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:30:38 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:30:38.639084 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0923bd28-e546-42bd-b1ea-65136c1a26cd admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:38.680621 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0923bd28-e546-42bd-b1ea-65136c1a26cd admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:38.761166 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:38.805085 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2fa00c-d5c8-43ae-978f-8049279c858e admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:38.816820 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d072559-b57e-4280-a0eb-1bb8f91f8055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:38.817680 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d072559-b57e-4280-a0eb-1bb8f91f8055 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:38.817849 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d072559-b57e-4280-a0eb-1bb8f91f8055 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:38.817977 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d072559-b57e-4280-a0eb-1bb8f91f8055 admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:38.818649 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d072559-b57e-4280-a0eb-1bb8f91f8055 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:38.820673 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d072559-b57e-4280-a0eb-1bb8f91f8055 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:38.837791 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e110137-862f-4f77-95c3-b2af5bde5063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:38.840225 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e110137-862f-4f77-95c3-b2af5bde5063 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:38.840500 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e110137-862f-4f77-95c3-b2af5bde5063 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:38.840775 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e110137-862f-4f77-95c3-b2af5bde5063 admin admin] PATH_INFO: `/v3/projects/8000108f1d644b278321c8a86095f109/users/f3f8b83d22fd41248c6ef8a691994e46/roles/13af81971c1c428eae0a571a22ea583d` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:38.877174 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 928/1843] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:30:38 2022] POST /identity/v3/users => generated 289 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:30:38.880991 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d072559-b57e-4280-a0eb-1bb8f91f8055 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:38.891355 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e110137-862f-4f77-95c3-b2af5bde5063 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8000108f1d644b278321c8a86095f109, user_id=f3f8b83d22fd41248c6ef8a691994e46, role_id=13af81971c1c428eae0a571a22ea583d)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:38.894308 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e110137-862f-4f77-95c3-b2af5bde5063 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:38.897940 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d072559-b57e-4280-a0eb-1bb8f91f8055 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:38.929914 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df491ce-4733-4b47-8c84-8553fc9d4347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:38.932721 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df491ce-4733-4b47-8c84-8553fc9d4347 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:38.934255 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df491ce-4733-4b47-8c84-8553fc9d4347 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:38.935284 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df491ce-4733-4b47-8c84-8553fc9d4347 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:38.937090 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df491ce-4733-4b47-8c84-8553fc9d4347 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:38.940377 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 916/1844] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:30:38 2022] PUT /identity/v3/projects/8000108f1d644b278321c8a86095f109/users/f3f8b83d22fd41248c6ef8a691994e46/roles/13af81971c1c428eae0a571a22ea583d => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:30:38.941511 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df491ce-4733-4b47-8c84-8553fc9d4347 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:38.956515 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024261ce-cda9-471a-9d81-de23cd5cfce8 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:38.956867 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024261ce-cda9-471a-9d81-de23cd5cfce8 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:38.957696 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024261ce-cda9-471a-9d81-de23cd5cfce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:38.984228 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 929/1845] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:30:38 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 01:30:38.988263 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df491ce-4733-4b47-8c84-8553fc9d4347 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:39.009788 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df491ce-4733-4b47-8c84-8553fc9d4347 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:39.040507 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-024261ce-cda9-471a-9d81-de23cd5cfce8 None None] MFA Rules not processed for user `f3f8b83d22fd41248c6ef8a691994e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:39.043218 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-024261ce-cda9-471a-9d81-de23cd5cfce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:39.211476 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9376d96-24ed-454f-ac2d-fed3bee42a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:39.212131 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9376d96-24ed-454f-ac2d-fed3bee42a7e admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:39.212410 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9376d96-24ed-454f-ac2d-fed3bee42a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:39.212684 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9376d96-24ed-454f-ac2d-fed3bee42a7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:39.228153 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9376d96-24ed-454f-ac2d-fed3bee42a7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:39.230502 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9376d96-24ed-454f-ac2d-fed3bee42a7e admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:39.239966 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 917/1846] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:30:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:39.244515 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024261ce-cda9-471a-9d81-de23cd5cfce8 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:39.257311 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 930/1847] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:30:38 2022] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:30:39.261020 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024261ce-cda9-471a-9d81-de23cd5cfce8 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:39.263951 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9376d96-24ed-454f-ac2d-fed3bee42a7e admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:39.265718 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d110f0d5-dc64-48c2-b384-9f8dea98a30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:39.266386 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110f0d5-dc64-48c2-b384-9f8dea98a30f admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:39.266659 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110f0d5-dc64-48c2-b384-9f8dea98a30f admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:39.266932 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110f0d5-dc64-48c2-b384-9f8dea98a30f admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:39.267568 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d110f0d5-dc64-48c2-b384-9f8dea98a30f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:39.270298 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d110f0d5-dc64-48c2-b384-9f8dea98a30f admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:39.306342 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9376d96-24ed-454f-ac2d-fed3bee42a7e admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:39.323661 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 918/1848] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:30:39 2022] POST /identity/v3/projects => generated 377 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:30:39.325221 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d110f0d5-dc64-48c2-b384-9f8dea98a30f admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:39.326290 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a703f825-ccf3-4271-acac-877a02579dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:39.326973 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d110f0d5-dc64-48c2-b384-9f8dea98a30f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:39.327316 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703f825-ccf3-4271-acac-877a02579dd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:39.327735 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703f825-ccf3-4271-acac-877a02579dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:39.329086 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703f825-ccf3-4271-acac-877a02579dd4 admin admin] PATH_INFO: `/v3/projects/7a215475eaae4e1f9f275622edb0048d/users/aff8c1db5ed54a008b5cce5f3eaa20a9/roles/13af81971c1c428eae0a571a22ea583d` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:39.353650 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a703f825-ccf3-4271-acac-877a02579dd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a215475eaae4e1f9f275622edb0048d, user_id=aff8c1db5ed54a008b5cce5f3eaa20a9, role_id=13af81971c1c428eae0a571a22ea583d)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:39.356790 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a703f825-ccf3-4271-acac-877a02579dd4 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:39.399426 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 931/1849] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:30:39 2022] PUT /identity/v3/projects/7a215475eaae4e1f9f275622edb0048d/users/aff8c1db5ed54a008b5cce5f3eaa20a9/roles/13af81971c1c428eae0a571a22ea583d => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:30:39.399426 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a703f825-ccf3-4271-acac-877a02579dd4 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:39.425745 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:39.486240 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d110f0d5-dc64-48c2-b384-9f8dea98a30f admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:39.514052 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a703f825-ccf3-4271-acac-877a02579dd4 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:39.520037 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03563931-ab36-44e8-91e2-aa4881cbb8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:39.520660 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03563931-ab36-44e8-91e2-aa4881cbb8e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:39.520936 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03563931-ab36-44e8-91e2-aa4881cbb8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:39.521204 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03563931-ab36-44e8-91e2-aa4881cbb8e0 admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:39.522286 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03563931-ab36-44e8-91e2-aa4881cbb8e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:39.524298 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03563931-ab36-44e8-91e2-aa4881cbb8e0 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:39.553888 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 932/1850] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:30:39 2022] POST /identity/v3/users => generated 295 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:30:39.555516 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b7010-781c-4349-a3f7-014672fb28f6 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:39.555815 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b7010-781c-4349-a3f7-014672fb28f6 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:39.556180 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b7010-781c-4349-a3f7-014672fb28f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:39.571919 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:39.632365 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-c26b7010-781c-4349-a3f7-014672fb28f6 None None] MFA Rules not processed for user `aff8c1db5ed54a008b5cce5f3eaa20a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:39.634388 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-c26b7010-781c-4349-a3f7-014672fb28f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:39.634609 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea80955-cddd-427a-ac53-cebcff6ca3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:39.635476 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea80955-cddd-427a-ac53-cebcff6ca3cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:39.635757 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea80955-cddd-427a-ac53-cebcff6ca3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:39.636068 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea80955-cddd-427a-ac53-cebcff6ca3cc admin admin] PATH_INFO: `/v3/projects/17e2768e45ec42bd993132ab28bf6bf9` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:39.638074 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea80955-cddd-427a-ac53-cebcff6ca3cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=17e2768e45ec42bd993132ab28bf6bf9)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:39.642341 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea80955-cddd-427a-ac53-cebcff6ca3cc admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:39.742036 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 933/1851] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:30:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:39.742036 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26b7010-781c-4349-a3f7-014672fb28f6 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:39.754423 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-fea80955-cddd-427a-ac53-cebcff6ca3cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17e2768e45ec42bd993132ab28bf6bf9', 'request_id': 'req-fea80955-cddd-427a-ac53-cebcff6ca3cc'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:39.771036 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26b7010-781c-4349-a3f7-014672fb28f6 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:39.810730 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-fea80955-cddd-427a-ac53-cebcff6ca3cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17e2768e45ec42bd993132ab28bf6bf9', 'request_id': 'req-fea80955-cddd-427a-ac53-cebcff6ca3cc'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:39.822414 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-fea80955-cddd-427a-ac53-cebcff6ca3cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17e2768e45ec42bd993132ab28bf6bf9', 'request_id': 'req-fea80955-cddd-427a-ac53-cebcff6ca3cc'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:39.871164 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-fea80955-cddd-427a-ac53-cebcff6ca3cc admin admin] The token cache is being invalidate because project 17e2768e45ec42bd993132ab28bf6bf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:30:39.879436 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-fea80955-cddd-427a-ac53-cebcff6ca3cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:39.882754 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-fea80955-cddd-427a-ac53-cebcff6ca3cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:39.891907 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 919/1852] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:30:39 2022] DELETE /identity/v3/projects/17e2768e45ec42bd993132ab28bf6bf9 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:30:39.893161 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea80955-cddd-427a-ac53-cebcff6ca3cc admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:39.898015 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-fea80955-cddd-427a-ac53-cebcff6ca3cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:40.018191 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e799c5-7374-4ecf-a007-419c9cba386e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:40.019546 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e799c5-7374-4ecf-a007-419c9cba386e admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:40.019898 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e799c5-7374-4ecf-a007-419c9cba386e admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:40.020294 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e799c5-7374-4ecf-a007-419c9cba386e admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:40.020964 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e799c5-7374-4ecf-a007-419c9cba386e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:40.023022 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e799c5-7374-4ecf-a007-419c9cba386e admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:40.061945 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 934/1853] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:30:39 2022] GET /identity/v3/roles => generated 1420 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:30:40.063002 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e799c5-7374-4ecf-a007-419c9cba386e admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:40.068256 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-32e799c5-7374-4ecf-a007-419c9cba386e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:40.099685 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e799c5-7374-4ecf-a007-419c9cba386e admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:40.125218 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69830ab-3859-464d-83b1-34625bb34935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:40.125710 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69830ab-3859-464d-83b1-34625bb34935 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:40.125993 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69830ab-3859-464d-83b1-34625bb34935 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:40.126322 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69830ab-3859-464d-83b1-34625bb34935 admin admin] PATH_INFO: `/v3/users/18289aa1c2394c49b2b8bea254dede71` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:40.127760 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69830ab-3859-464d-83b1-34625bb34935 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18289aa1c2394c49b2b8bea254dede71)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:40.129756 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69830ab-3859-464d-83b1-34625bb34935 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:40.176126 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea80955-cddd-427a-ac53-cebcff6ca3cc admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:40.183928 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e45a2a-c222-4046-bca1-d4a51fc55689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:40.184633 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e45a2a-c222-4046-bca1-d4a51fc55689 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:40.184908 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e45a2a-c222-4046-bca1-d4a51fc55689 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:40.185174 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e45a2a-c222-4046-bca1-d4a51fc55689 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:40.185921 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e45a2a-c222-4046-bca1-d4a51fc55689 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:40.199210 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e45a2a-c222-4046-bca1-d4a51fc55689 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:40.234320 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:40.264681 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 920/1854] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:30:39 2022] POST /identity/v3/projects => generated 379 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:30:40.266953 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298222b7-b71d-480e-b502-c1269fe2c8a4 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:40.267099 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-e69830ab-3859-464d-83b1-34625bb34935 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18289aa1c2394c49b2b8bea254dede71'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:40.267593 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298222b7-b71d-480e-b502-c1269fe2c8a4 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:40.267957 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298222b7-b71d-480e-b502-c1269fe2c8a4 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:40.270547 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 921/1855] 10.222.0.26 () {54 vars in 921 bytes} [Fri Aug 12 01:30:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:30:40.272439 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298222b7-b71d-480e-b502-c1269fe2c8a4 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:40.275476 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-298222b7-b71d-480e-b502-c1269fe2c8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:40.282605 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-e69830ab-3859-464d-83b1-34625bb34935 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18289aa1c2394c49b2b8bea254dede71'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:40.283235 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-e69830ab-3859-464d-83b1-34625bb34935 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18289aa1c2394c49b2b8bea254dede71'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:40.294991 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-e69830ab-3859-464d-83b1-34625bb34935 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18289aa1c2394c49b2b8bea254dede71'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:40.321795 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-e69830ab-3859-464d-83b1-34625bb34935 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18289aa1c2394c49b2b8bea254dede71'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:40.356273 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 935/1856] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:30:40 2022] DELETE /identity/v3/users/18289aa1c2394c49b2b8bea254dede71 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:30:40.356480 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69830ab-3859-464d-83b1-34625bb34935 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:40.358463 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-e69830ab-3859-464d-83b1-34625bb34935 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:40.379655 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:40.416947 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298222b7-b71d-480e-b502-c1269fe2c8a4 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:40.516220 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69830ab-3859-464d-83b1-34625bb34935 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:40.525395 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc8e555-da4c-4413-8429-10f4842dc967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:40.526028 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc8e555-da4c-4413-8429-10f4842dc967 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:40.526505 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc8e555-da4c-4413-8429-10f4842dc967 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:40.526775 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc8e555-da4c-4413-8429-10f4842dc967 admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:40.527860 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc8e555-da4c-4413-8429-10f4842dc967 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:40.532502 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc8e555-da4c-4413-8429-10f4842dc967 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:40.572703 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05ce0a1-c090-43f3-882f-8b70660153d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:40.573687 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05ce0a1-c090-43f3-882f-8b70660153d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:40.574531 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05ce0a1-c090-43f3-882f-8b70660153d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:40.574858 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05ce0a1-c090-43f3-882f-8b70660153d9 admin admin] PATH_INFO: `/v3/projects/8b1c73f9ff4a4147aaa67f19d739dffc/users/d2325e4104794c438647c779bddba8fa/roles/fb48693810be495fb4b1893a79429b78` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:40.579374 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 936/1857] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:30:40 2022] POST /identity/v3/users => generated 296 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:30:40.586736 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850503dc-191d-4ca6-8843-de27283c2719 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:40.587025 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850503dc-191d-4ca6-8843-de27283c2719 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:40.587277 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850503dc-191d-4ca6-8843-de27283c2719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:40.632978 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-850503dc-191d-4ca6-8843-de27283c2719 None None] MFA Rules not processed for user `fcd5e95467b44175be2478c2c7c89926`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:40.633615 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-850503dc-191d-4ca6-8843-de27283c2719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:40.639251 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05ce0a1-c090-43f3-882f-8b70660153d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b1c73f9ff4a4147aaa67f19d739dffc, user_id=d2325e4104794c438647c779bddba8fa, role_id=fb48693810be495fb4b1893a79429b78)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:40.645631 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05ce0a1-c090-43f3-882f-8b70660153d9 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:40.669066 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 922/1858] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:30:40 2022] PUT /identity/v3/projects/8b1c73f9ff4a4147aaa67f19d739dffc/users/d2325e4104794c438647c779bddba8fa/roles/fb48693810be495fb4b1893a79429b78 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:30:40.670144 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05ce0a1-c090-43f3-882f-8b70660153d9 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:40.790934 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05ce0a1-c090-43f3-882f-8b70660153d9 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:40.799594 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2495ce8b-afc5-4cd5-94c1-fed9a8da5c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:40.801154 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2495ce8b-afc5-4cd5-94c1-fed9a8da5c90 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:40.801581 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2495ce8b-afc5-4cd5-94c1-fed9a8da5c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:40.801856 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2495ce8b-afc5-4cd5-94c1-fed9a8da5c90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:40.802827 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2495ce8b-afc5-4cd5-94c1-fed9a8da5c90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:40.804715 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2495ce8b-afc5-4cd5-94c1-fed9a8da5c90 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:40.826590 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 923/1859] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:30:40 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:30:40.826590 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2495ce8b-afc5-4cd5-94c1-fed9a8da5c90 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:40.826590 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2495ce8b-afc5-4cd5-94c1-fed9a8da5c90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:40.852219 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2495ce8b-afc5-4cd5-94c1-fed9a8da5c90 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:40.866798 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67639236-6263-499f-b596-f8afed580b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:40.867481 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67639236-6263-499f-b596-f8afed580b67 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:40.867758 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67639236-6263-499f-b596-f8afed580b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:40.870775 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67639236-6263-499f-b596-f8afed580b67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:40.871516 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67639236-6263-499f-b596-f8afed580b67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:40.877206 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67639236-6263-499f-b596-f8afed580b67 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:40.903665 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 937/1860] 10.222.0.26 () {58 vars in 1018 bytes} [Fri Aug 12 01:30:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:40.903665 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850503dc-191d-4ca6-8843-de27283c2719 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:40.905252 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 924/1861] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:30:40 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:30:40.906338 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67639236-6263-499f-b596-f8afed580b67 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:40.923453 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850503dc-191d-4ca6-8843-de27283c2719 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:40.933633 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddaffc1-d591-46b3-83e4-9ff3b76c7ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:40.934825 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddaffc1-d591-46b3-83e4-9ff3b76c7ee4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:40.935568 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddaffc1-d591-46b3-83e4-9ff3b76c7ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:40.935943 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddaffc1-d591-46b3-83e4-9ff3b76c7ee4 admin admin] PATH_INFO: `/v3/projects/174c1217fb6145bdbbda89c184e47e3d/users/757d2bb90409446fac4fd16f0dd93657/roles/fb48693810be495fb4b1893a79429b78` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:40.936424 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67639236-6263-499f-b596-f8afed580b67 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:40.944436 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d0da1e-a960-4463-baea-43faa04f45e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:40.945584 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0da1e-a960-4463-baea-43faa04f45e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:40.946097 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0da1e-a960-4463-baea-43faa04f45e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:40.946984 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0da1e-a960-4463-baea-43faa04f45e9 admin admin] PATH_INFO: `/v3/projects/8b1c73f9ff4a4147aaa67f19d739dffc/users/d2325e4104794c438647c779bddba8fa/roles/fb48693810be495fb4b1893a79429b78` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:40.949627 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d0da1e-a960-4463-baea-43faa04f45e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b1c73f9ff4a4147aaa67f19d739dffc, user_id=d2325e4104794c438647c779bddba8fa, role_id=fb48693810be495fb4b1893a79429b78)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:40.953220 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d0da1e-a960-4463-baea-43faa04f45e9 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:40.960993 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddaffc1-d591-46b3-83e4-9ff3b76c7ee4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=174c1217fb6145bdbbda89c184e47e3d, user_id=757d2bb90409446fac4fd16f0dd93657, role_id=fb48693810be495fb4b1893a79429b78)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:40.965940 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddaffc1-d591-46b3-83e4-9ff3b76c7ee4 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:40.971367 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 925/1862] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:30:40 2022] PUT /identity/v3/projects/8b1c73f9ff4a4147aaa67f19d739dffc/users/d2325e4104794c438647c779bddba8fa/roles/fb48693810be495fb4b1893a79429b78 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:30:40.981700 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4125a56-869c-4b23-b883-c19c20931c4a None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:40.982091 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4125a56-869c-4b23-b883-c19c20931c4a None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:40.982451 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4125a56-869c-4b23-b883-c19c20931c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:40.989195 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:41.010695 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 938/1863] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:30:40 2022] PUT /identity/v3/projects/174c1217fb6145bdbbda89c184e47e3d/users/757d2bb90409446fac4fd16f0dd93657/roles/fb48693810be495fb4b1893a79429b78 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:30:41.012025 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddaffc1-d591-46b3-83e4-9ff3b76c7ee4 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:41.031334 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-d4125a56-869c-4b23-b883-c19c20931c4a None None] MFA Rules not processed for user `d2325e4104794c438647c779bddba8fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:41.032498 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d4125a56-869c-4b23-b883-c19c20931c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:41.085976 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:41.188182 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 926/1864] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:30:40 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:41.206048 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4125a56-869c-4b23-b883-c19c20931c4a None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:41.208938 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddaffc1-d591-46b3-83e4-9ff3b76c7ee4 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:41.211010 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d4125a56-869c-4b23-b883-c19c20931c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:41.224846 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1de0c54-b839-4446-b1ae-e7f3bae1edd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:41.225469 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de0c54-b839-4446-b1ae-e7f3bae1edd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:41.225761 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de0c54-b839-4446-b1ae-e7f3bae1edd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:41.226032 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de0c54-b839-4446-b1ae-e7f3bae1edd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:41.226742 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1de0c54-b839-4446-b1ae-e7f3bae1edd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:41.228322 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1de0c54-b839-4446-b1ae-e7f3bae1edd5 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:41.274824 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 939/1865] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:30:41 2022] GET /identity/v3/roles => generated 1420 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:30:41.276710 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1de0c54-b839-4446-b1ae-e7f3bae1edd5 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:41.303109 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1de0c54-b839-4446-b1ae-e7f3bae1edd5 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:41.317535 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f56eb1-82f6-4eab-bf2e-aa9040f15371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:41.319787 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f56eb1-82f6-4eab-bf2e-aa9040f15371 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:41.320333 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f56eb1-82f6-4eab-bf2e-aa9040f15371 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:41.320806 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f56eb1-82f6-4eab-bf2e-aa9040f15371 admin admin] PATH_INFO: `/v3/projects/174c1217fb6145bdbbda89c184e47e3d/users/757d2bb90409446fac4fd16f0dd93657/roles/fb48693810be495fb4b1893a79429b78` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:41.323263 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f56eb1-82f6-4eab-bf2e-aa9040f15371 admin admin] RBAC: Authorizing `identity:create_grant(project_id=174c1217fb6145bdbbda89c184e47e3d, user_id=757d2bb90409446fac4fd16f0dd93657, role_id=fb48693810be495fb4b1893a79429b78)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:41.326666 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f56eb1-82f6-4eab-bf2e-aa9040f15371 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:41.353378 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 940/1866] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:30:41 2022] PUT /identity/v3/projects/174c1217fb6145bdbbda89c184e47e3d/users/757d2bb90409446fac4fd16f0dd93657/roles/fb48693810be495fb4b1893a79429b78 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:30:41.364162 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e1caff-81bc-49bb-b592-eb3c72e8a0ae None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:41.365267 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e1caff-81bc-49bb-b592-eb3c72e8a0ae None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:41.366135 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e1caff-81bc-49bb-b592-eb3c72e8a0ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:41.380737 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4125a56-869c-4b23-b883-c19c20931c4a None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:41.450334 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-06e1caff-81bc-49bb-b592-eb3c72e8a0ae None None] MFA Rules not processed for user `757d2bb90409446fac4fd16f0dd93657`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:41.454004 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-06e1caff-81bc-49bb-b592-eb3c72e8a0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:41.527649 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6118886c-9e1c-496f-a651-e45092c97c69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7853d40c29af424c8d7913950d89750b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:41.529413 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118886c-9e1c-496f-a651-e45092c97c69 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:41.530235 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118886c-9e1c-496f-a651-e45092c97c69 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:41.531581 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118886c-9e1c-496f-a651-e45092c97c69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:41.536642 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-6118886c-9e1c-496f-a651-e45092c97c69 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:41.741915 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6118886c-9e1c-496f-a651-e45092c97c69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:41.748562 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6118886c-9e1c-496f-a651-e45092c97c69 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:41.776361 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 927/1867] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:30:41 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 573 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:30:41.778186 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6118886c-9e1c-496f-a651-e45092c97c69 service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:41.780133 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-6118886c-9e1c-496f-a651-e45092c97c69 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:41.788997 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 941/1868] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:30:41 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 426 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:41.789998 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e1caff-81bc-49bb-b592-eb3c72e8a0ae None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:41.793909 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-06e1caff-81bc-49bb-b592-eb3c72e8a0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:41.973694 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:42.061932 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6118886c-9e1c-496f-a651-e45092c97c69 service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:42.100075 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a43a17a-0315-4e6b-b753-01279490d73f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd5e95467b44175be2478c2c7c89926', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:42.101093 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43a17a-0315-4e6b-b753-01279490d73f service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:42.101723 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43a17a-0315-4e6b-b753-01279490d73f service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:42.103413 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43a17a-0315-4e6b-b753-01279490d73f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:42.135373 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a43a17a-0315-4e6b-b753-01279490d73f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:42.137026 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a43a17a-0315-4e6b-b753-01279490d73f service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:42.146608 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e1caff-81bc-49bb-b592-eb3c72e8a0ae None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:42.151643 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 928/1869] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:30:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:30:42.152329 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a43a17a-0315-4e6b-b753-01279490d73f service nova] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:42.156546 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-6a43a17a-0315-4e6b-b753-01279490d73f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:42.158915 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5205efb4-e45a-4910-8d73-11e80f771755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:42.159696 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205efb4-e45a-4910-8d73-11e80f771755 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:42.159970 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205efb4-e45a-4910-8d73-11e80f771755 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:42.160298 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205efb4-e45a-4910-8d73-11e80f771755 admin admin] PATH_INFO: `/v3/projects/140a1fb4583547339c3fec5a9b173cc3` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:42.162000 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5205efb4-e45a-4910-8d73-11e80f771755 admin admin] RBAC: Authorizing `identity:delete_project(project_id=140a1fb4583547339c3fec5a9b173cc3)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:42.165398 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5205efb4-e45a-4910-8d73-11e80f771755 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:42.199454 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a43a17a-0315-4e6b-b753-01279490d73f service nova] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:42.206298 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:42.207217 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c653e7-a58a-4f99-8924-f8204c397b28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7853d40c29af424c8d7913950d89750b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:42.207891 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c653e7-a58a-4f99-8924-f8204c397b28 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:42.208193 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c653e7-a58a-4f99-8924-f8204c397b28 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:42.208429 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c653e7-a58a-4f99-8924-f8204c397b28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:42.234029 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c653e7-a58a-4f99-8924-f8204c397b28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:42.237834 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c653e7-a58a-4f99-8924-f8204c397b28 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:42.275725 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 929/1870] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:30:42 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:30:42.304784 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-5205efb4-e45a-4910-8d73-11e80f771755 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '140a1fb4583547339c3fec5a9b173cc3', 'request_id': 'req-5205efb4-e45a-4910-8d73-11e80f771755'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:42.328349 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-5205efb4-e45a-4910-8d73-11e80f771755 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '140a1fb4583547339c3fec5a9b173cc3', 'request_id': 'req-5205efb4-e45a-4910-8d73-11e80f771755'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:42.339444 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-5205efb4-e45a-4910-8d73-11e80f771755 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '140a1fb4583547339c3fec5a9b173cc3', 'request_id': 'req-5205efb4-e45a-4910-8d73-11e80f771755'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:42.370336 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-5205efb4-e45a-4910-8d73-11e80f771755 admin admin] The token cache is being invalidate because project 140a1fb4583547339c3fec5a9b173cc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:30:42.370639 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-5205efb4-e45a-4910-8d73-11e80f771755 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:42.371315 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-5205efb4-e45a-4910-8d73-11e80f771755 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:42.376945 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 942/1871] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:30:41 2022] DELETE /identity/v3/projects/140a1fb4583547339c3fec5a9b173cc3 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:30:42.378648 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19858da-3ba7-41c6-8755-bf93b31a1825 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:42.378935 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19858da-3ba7-41c6-8755-bf93b31a1825 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:42.379213 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19858da-3ba7-41c6-8755-bf93b31a1825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:42.393810 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5205efb4-e45a-4910-8d73-11e80f771755 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:42.396348 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-5205efb4-e45a-4910-8d73-11e80f771755 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:42.410846 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-d19858da-3ba7-41c6-8755-bf93b31a1825 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:42.410846 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d19858da-3ba7-41c6-8755-bf93b31a1825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:42.561718 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 930/1872] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:30:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:42.572639 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46edadc6-af27-44fc-9792-f6c6f6ec2e46 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:42.572926 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46edadc6-af27-44fc-9792-f6c6f6ec2e46 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:42.573203 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46edadc6-af27-44fc-9792-f6c6f6ec2e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:42.608118 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5205efb4-e45a-4910-8d73-11e80f771755 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:42.632947 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-46edadc6-af27-44fc-9792-f6c6f6ec2e46 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:42.636379 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-46edadc6-af27-44fc-9792-f6c6f6ec2e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:42.638739 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ce9e25-7e75-4efc-8c08-60ec9868320f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7853d40c29af424c8d7913950d89750b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:42.638739 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce9e25-7e75-4efc-8c08-60ec9868320f service cinder] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:42.639047 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce9e25-7e75-4efc-8c08-60ec9868320f service cinder] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:42.639308 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce9e25-7e75-4efc-8c08-60ec9868320f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:42.651271 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-20ce9e25-7e75-4efc-8c08-60ec9868320f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:42.661218 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 931/1873] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:30:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:42.661679 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46edadc6-af27-44fc-9792-f6c6f6ec2e46 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:42.679644 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46edadc6-af27-44fc-9792-f6c6f6ec2e46 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:42.698086 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e9467a-f769-4856-9116-8d36c145c844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:42.698929 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e9467a-f769-4856-9116-8d36c145c844 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:42.700376 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e9467a-f769-4856-9116-8d36c145c844 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:42.700657 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e9467a-f769-4856-9116-8d36c145c844 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:42.702351 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e9467a-f769-4856-9116-8d36c145c844 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:30:42.704056 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e9467a-f769-4856-9116-8d36c145c844 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:42.715354 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e9467a-f769-4856-9116-8d36c145c844 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:42.757410 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 932/1874] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 01:30:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:30:42.759981 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ce9e25-7e75-4efc-8c08-60ec9868320f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:42.761048 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e9467a-f769-4856-9116-8d36c145c844 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:42.761603 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ce9e25-7e75-4efc-8c08-60ec9868320f service cinder] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:42.773779 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 943/1875] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:30:42 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 01:30:42.798102 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e9467a-f769-4856-9116-8d36c145c844 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:42.808057 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb2a87b-420d-49d9-bfb8-146a4e086dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:42.808654 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2a87b-420d-49d9-bfb8-146a4e086dba admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:42.808992 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2a87b-420d-49d9-bfb8-146a4e086dba admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:42.809375 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2a87b-420d-49d9-bfb8-146a4e086dba admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:42.810790 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb2a87b-420d-49d9-bfb8-146a4e086dba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:42.812877 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb2a87b-420d-49d9-bfb8-146a4e086dba admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:42.862171 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 933/1876] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:30:42 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:30:42.866637 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ce9e25-7e75-4efc-8c08-60ec9868320f service cinder] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:42.888909 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ce9e25-7e75-4efc-8c08-60ec9868320f service cinder] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:42.983729 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:42.998319 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdaecd8-67ae-447d-95aa-808bb79c6ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:42.999092 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdaecd8-67ae-447d-95aa-808bb79c6ae5 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:42.999708 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdaecd8-67ae-447d-95aa-808bb79c6ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:42.999708 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdaecd8-67ae-447d-95aa-808bb79c6ae5 admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:43.000475 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdaecd8-67ae-447d-95aa-808bb79c6ae5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:43.003321 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdaecd8-67ae-447d-95aa-808bb79c6ae5 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:43.037978 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 944/1877] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:30:42 2022] POST /identity/v3/users => generated 292 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:30:43.039567 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb2a87b-420d-49d9-bfb8-146a4e086dba admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:43.053187 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb2a87b-420d-49d9-bfb8-146a4e086dba admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:43.064861 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d495297-2fe2-4171-9c01-6b69830d5b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:43.066031 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d495297-2fe2-4171-9c01-6b69830d5b1b admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:43.067475 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d495297-2fe2-4171-9c01-6b69830d5b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:43.067886 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d495297-2fe2-4171-9c01-6b69830d5b1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:43.068959 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d495297-2fe2-4171-9c01-6b69830d5b1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:43.070647 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d495297-2fe2-4171-9c01-6b69830d5b1b admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:43.093780 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 934/1878] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:30:43 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:30:43.094545 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdaecd8-67ae-447d-95aa-808bb79c6ae5 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:43.117712 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdaecd8-67ae-447d-95aa-808bb79c6ae5 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:43.134173 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabb49d3-0c35-4af7-b202-2383ebf95954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:43.136932 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb49d3-0c35-4af7-b202-2383ebf95954 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:43.137350 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb49d3-0c35-4af7-b202-2383ebf95954 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:43.138482 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb49d3-0c35-4af7-b202-2383ebf95954 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:43.139307 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabb49d3-0c35-4af7-b202-2383ebf95954 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:43.142198 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabb49d3-0c35-4af7-b202-2383ebf95954 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:43.166061 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 945/1879] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:30:43 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 01:30:43.173096 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d495297-2fe2-4171-9c01-6b69830d5b1b admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:43.191007 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d495297-2fe2-4171-9c01-6b69830d5b1b admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:43.200293 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6acd8d5-d550-429e-9521-d86210f55c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:43.201051 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6acd8d5-d550-429e-9521-d86210f55c2a admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:43.201279 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6acd8d5-d550-429e-9521-d86210f55c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:43.201743 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6acd8d5-d550-429e-9521-d86210f55c2a admin admin] PATH_INFO: `/v3/projects/dfa3291fc25441ee9ac864e7b8261767/users/c3e50af7de924214a54fd133c4400084/roles/13af81971c1c428eae0a571a22ea583d` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:43.229029 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6acd8d5-d550-429e-9521-d86210f55c2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfa3291fc25441ee9ac864e7b8261767, user_id=c3e50af7de924214a54fd133c4400084, role_id=13af81971c1c428eae0a571a22ea583d)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:43.233684 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6acd8d5-d550-429e-9521-d86210f55c2a admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:43.279792 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 935/1880] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:30:43 2022] PUT /identity/v3/projects/dfa3291fc25441ee9ac864e7b8261767/users/c3e50af7de924214a54fd133c4400084/roles/13af81971c1c428eae0a571a22ea583d => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:30:43.281543 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69fb828-6ad3-479e-aa94-a2ee7dee2dff None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:43.281836 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69fb828-6ad3-479e-aa94-a2ee7dee2dff None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:43.282137 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69fb828-6ad3-479e-aa94-a2ee7dee2dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:43.364338 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-e69fb828-6ad3-479e-aa94-a2ee7dee2dff None None] MFA Rules not processed for user `c3e50af7de924214a54fd133c4400084`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:43.381362 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-e69fb828-6ad3-479e-aa94-a2ee7dee2dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:43.647665 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6acd8d5-d550-429e-9521-d86210f55c2a admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:43.652146 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 946/1881] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:30:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:43.738864 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:43.776456 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6acd8d5-d550-429e-9521-d86210f55c2a admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:43.785537 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca19abb6-73fd-4764-a4d4-355e488f9cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:43.786393 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19abb6-73fd-4764-a4d4-355e488f9cb5 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:43.786733 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19abb6-73fd-4764-a4d4-355e488f9cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:43.787250 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19abb6-73fd-4764-a4d4-355e488f9cb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:43.789016 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca19abb6-73fd-4764-a4d4-355e488f9cb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:43.791233 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca19abb6-73fd-4764-a4d4-355e488f9cb5 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:43.832971 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 936/1882] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:30:43 2022] POST /identity/v3/projects => generated 383 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:30:43.836912 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69fb828-6ad3-479e-aa94-a2ee7dee2dff None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:43.852853 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca19abb6-73fd-4764-a4d4-355e488f9cb5 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:43.855717 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69fb828-6ad3-479e-aa94-a2ee7dee2dff None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:43.946823 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca19abb6-73fd-4764-a4d4-355e488f9cb5 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:43.947031 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131cc4ba-57df-4c2b-b563-9ce3377e76ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:43.947632 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131cc4ba-57df-4c2b-b563-9ce3377e76ec admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:43.948313 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131cc4ba-57df-4c2b-b563-9ce3377e76ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:43.948313 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131cc4ba-57df-4c2b-b563-9ce3377e76ec admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:43.949216 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131cc4ba-57df-4c2b-b563-9ce3377e76ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:43.950796 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131cc4ba-57df-4c2b-b563-9ce3377e76ec admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:43.951783 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b073fa-65e7-467f-abbb-e167621525c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7853d40c29af424c8d7913950d89750b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:43.952530 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b073fa-65e7-467f-abbb-e167621525c7 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:43.952903 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b073fa-65e7-467f-abbb-e167621525c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:43.953281 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b073fa-65e7-467f-abbb-e167621525c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:43.955345 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-22b073fa-65e7-467f-abbb-e167621525c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:44.001825 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 947/1883] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:30:43 2022] POST /identity/v3/users => generated 298 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:30:44.004806 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131cc4ba-57df-4c2b-b563-9ce3377e76ec admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:44.022731 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131cc4ba-57df-4c2b-b563-9ce3377e76ec admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:44.029243 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d6f76-0d74-43a1-b1a8-eaa57cf7cc28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:44.030834 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d6f76-0d74-43a1-b1a8-eaa57cf7cc28 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:44.031119 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d6f76-0d74-43a1-b1a8-eaa57cf7cc28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:44.031469 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d6f76-0d74-43a1-b1a8-eaa57cf7cc28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:44.033031 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d6f76-0d74-43a1-b1a8-eaa57cf7cc28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:44.034842 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d6f76-0d74-43a1-b1a8-eaa57cf7cc28 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:44.048657 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b073fa-65e7-467f-abbb-e167621525c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:44.053156 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 948/1884] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:30:44 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:30:44.053433 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b073fa-65e7-467f-abbb-e167621525c7 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:44.054778 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d6f76-0d74-43a1-b1a8-eaa57cf7cc28 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:44.062725 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 937/1885] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:30:43 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 01:30:44.078427 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d6f76-0d74-43a1-b1a8-eaa57cf7cc28 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:44.084393 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1fce3e-866f-454c-9c35-e1409ea02ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:44.085195 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1fce3e-866f-454c-9c35-e1409ea02ec1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:44.085537 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1fce3e-866f-454c-9c35-e1409ea02ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:44.091697 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1fce3e-866f-454c-9c35-e1409ea02ec1 admin admin] PATH_INFO: `/v3/projects/1ac4d1b717474415910626e284f476cf/users/5ea49678a2324bd3885b640e9f9e7710/roles/fb48693810be495fb4b1893a79429b78` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:44.147761 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1fce3e-866f-454c-9c35-e1409ea02ec1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ac4d1b717474415910626e284f476cf, user_id=5ea49678a2324bd3885b640e9f9e7710, role_id=fb48693810be495fb4b1893a79429b78)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:44.150449 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1fce3e-866f-454c-9c35-e1409ea02ec1 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:44.181162 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 949/1886] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:30:44 2022] PUT /identity/v3/projects/1ac4d1b717474415910626e284f476cf/users/5ea49678a2324bd3885b640e9f9e7710/roles/fb48693810be495fb4b1893a79429b78 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:30:44.184918 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b073fa-65e7-467f-abbb-e167621525c7 service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:44.199204 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b073fa-65e7-467f-abbb-e167621525c7 service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:44.286276 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3e72d5-de2c-4fce-afa7-d45c99c7c211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:44.287367 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e72d5-de2c-4fce-afa7-d45c99c7c211 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:44.287762 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e72d5-de2c-4fce-afa7-d45c99c7c211 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:44.288132 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e72d5-de2c-4fce-afa7-d45c99c7c211 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:44.289122 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3e72d5-de2c-4fce-afa7-d45c99c7c211 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:44.291474 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3e72d5-de2c-4fce-afa7-d45c99c7c211 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:44.304736 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 938/1887] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:30:44 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:30:44.308740 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1fce3e-866f-454c-9c35-e1409ea02ec1 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:44.320402 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1fce3e-866f-454c-9c35-e1409ea02ec1 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:44.325438 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4608075-349f-4138-b846-26c53bb19de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:44.326213 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4608075-349f-4138-b846-26c53bb19de2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:44.326479 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4608075-349f-4138-b846-26c53bb19de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:44.326760 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4608075-349f-4138-b846-26c53bb19de2 admin admin] PATH_INFO: `/v3/projects/1ac4d1b717474415910626e284f476cf/users/5ea49678a2324bd3885b640e9f9e7710/roles/fb48693810be495fb4b1893a79429b78` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:44.328795 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4608075-349f-4138-b846-26c53bb19de2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ac4d1b717474415910626e284f476cf, user_id=5ea49678a2324bd3885b640e9f9e7710, role_id=fb48693810be495fb4b1893a79429b78)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:44.331893 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4608075-349f-4138-b846-26c53bb19de2 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:44.347373 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 950/1888] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:30:44 2022] PUT /identity/v3/projects/1ac4d1b717474415910626e284f476cf/users/5ea49678a2324bd3885b640e9f9e7710/roles/fb48693810be495fb4b1893a79429b78 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:30:44.358983 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c692e10-e903-48b8-8994-6b9b166b15c7 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:44.359218 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c692e10-e903-48b8-8994-6b9b166b15c7 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:44.360116 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c692e10-e903-48b8-8994-6b9b166b15c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:44.395252 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:44.413318 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-5c692e10-e903-48b8-8994-6b9b166b15c7 None None] MFA Rules not processed for user `5ea49678a2324bd3885b640e9f9e7710`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:44.414870 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-5c692e10-e903-48b8-8994-6b9b166b15c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:44.543679 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 939/1889] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:30:44 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:44.555479 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4608075-349f-4138-b846-26c53bb19de2 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:44.557412 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-e4608075-349f-4138-b846-26c53bb19de2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:44.576794 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:44.680678 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4608075-349f-4138-b846-26c53bb19de2 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:44.687039 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677eb1b6-fbc1-426d-ab13-6b1fae70cef3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7853d40c29af424c8d7913950d89750b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:44.688614 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677eb1b6-fbc1-426d-ab13-6b1fae70cef3 service cinder] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:44.688886 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677eb1b6-fbc1-426d-ab13-6b1fae70cef3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:44.689285 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677eb1b6-fbc1-426d-ab13-6b1fae70cef3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:44.708688 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677eb1b6-fbc1-426d-ab13-6b1fae70cef3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:44.711689 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677eb1b6-fbc1-426d-ab13-6b1fae70cef3 service cinder] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:44.731509 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 951/1890] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:30:44 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:30:44.926575 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c692e10-e903-48b8-8994-6b9b166b15c7 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:44.938757 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c692e10-e903-48b8-8994-6b9b166b15c7 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:44.947200 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe01090-16fc-4de7-b2d4-76b16383c87f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7853d40c29af424c8d7913950d89750b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:44.947929 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe01090-16fc-4de7-b2d4-76b16383c87f service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:44.948648 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe01090-16fc-4de7-b2d4-76b16383c87f service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:44.948961 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe01090-16fc-4de7-b2d4-76b16383c87f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:44.997623 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa953690-e6d9-4aec-855b-9cc45633a8d5 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:44.998144 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa953690-e6d9-4aec-855b-9cc45633a8d5 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:44.998227 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa953690-e6d9-4aec-855b-9cc45633a8d5 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:44.999761 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 952/1891] 10.222.0.26 () {54 vars in 921 bytes} [Fri Aug 12 01:30:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:30:45.007378 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e023c288-4d34-4b89-9bc8-f3c95dc36b4a None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:45.007664 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e023c288-4d34-4b89-9bc8-f3c95dc36b4a None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:45.008156 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e023c288-4d34-4b89-9bc8-f3c95dc36b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:45.047152 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe01090-16fc-4de7-b2d4-76b16383c87f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:45.049004 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe01090-16fc-4de7-b2d4-76b16383c87f service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:45.051497 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-e023c288-4d34-4b89-9bc8-f3c95dc36b4a None None] MFA Rules not processed for user `fcd5e95467b44175be2478c2c7c89926`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:45.052796 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-e023c288-4d34-4b89-9bc8-f3c95dc36b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:45.073050 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 940/1892] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:30:44 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:30:45.204028 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 953/1893] 10.222.0.26 () {58 vars in 1018 bytes} [Fri Aug 12 01:30:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 01:30:45.476482 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe01090-16fc-4de7-b2d4-76b16383c87f service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:45.478072 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-5fe01090-16fc-4de7-b2d4-76b16383c87f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:45.532224 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe01090-16fc-4de7-b2d4-76b16383c87f service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:45.543611 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f0bde1-c315-4481-bc5c-fcab800b8139 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd5e95467b44175be2478c2c7c89926', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:45.544248 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0bde1-c315-4481-bc5c-fcab800b8139 service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:45.544520 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0bde1-c315-4481-bc5c-fcab800b8139 service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:45.544785 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0bde1-c315-4481-bc5c-fcab800b8139 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:45.566931 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f0bde1-c315-4481-bc5c-fcab800b8139 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:45.568743 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f0bde1-c315-4481-bc5c-fcab800b8139 service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:45.600886 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 941/1894] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:30:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 01:30:46.441656 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e023c288-4d34-4b89-9bc8-f3c95dc36b4a None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:46.444584 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-e023c288-4d34-4b89-9bc8-f3c95dc36b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:46.525208 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e023c288-4d34-4b89-9bc8-f3c95dc36b4a None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:46.530268 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7110be-e470-4e5c-a098-a629f7762aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:46.531074 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7110be-e470-4e5c-a098-a629f7762aef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:46.531558 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7110be-e470-4e5c-a098-a629f7762aef admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:46.531973 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7110be-e470-4e5c-a098-a629f7762aef admin admin] PATH_INFO: `/v3/users/bd2b7fb589df48e3bd699a79cb1f58fe` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:46.533227 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7110be-e470-4e5c-a098-a629f7762aef admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd2b7fb589df48e3bd699a79cb1f58fe)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:46.535340 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7110be-e470-4e5c-a098-a629f7762aef admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:46.603604 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:46.617085 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-ce7110be-e470-4e5c-a098-a629f7762aef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd2b7fb589df48e3bd699a79cb1f58fe'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:46.630336 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-ce7110be-e470-4e5c-a098-a629f7762aef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd2b7fb589df48e3bd699a79cb1f58fe'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:46.632714 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-ce7110be-e470-4e5c-a098-a629f7762aef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd2b7fb589df48e3bd699a79cb1f58fe'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:46.642294 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-ce7110be-e470-4e5c-a098-a629f7762aef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd2b7fb589df48e3bd699a79cb1f58fe'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:46.662141 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-ce7110be-e470-4e5c-a098-a629f7762aef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd2b7fb589df48e3bd699a79cb1f58fe'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:46.685741 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 954/1895] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:30:46 2022] DELETE /identity/v3/users/bd2b7fb589df48e3bd699a79cb1f58fe => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:30:46.690368 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6c9fd-d2dd-45d6-b4e2-ff3cc7a9fbdc None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:46.690828 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6c9fd-d2dd-45d6-b4e2-ff3cc7a9fbdc None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:46.691084 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6c9fd-d2dd-45d6-b4e2-ff3cc7a9fbdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:46.710789 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-8bc6c9fd-d2dd-45d6-b4e2-ff3cc7a9fbdc None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:46.712807 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-8bc6c9fd-d2dd-45d6-b4e2-ff3cc7a9fbdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:46.803380 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 942/1896] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:30:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:46.813871 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7110be-e470-4e5c-a098-a629f7762aef admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:46.815698 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-ce7110be-e470-4e5c-a098-a629f7762aef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:46.924185 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7110be-e470-4e5c-a098-a629f7762aef admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:46.933414 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a87c79e-69c1-449b-b5ae-a67861de7af9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:46.934403 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87c79e-69c1-449b-b5ae-a67861de7af9 service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:46.935098 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87c79e-69c1-449b-b5ae-a67861de7af9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:46.950259 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87c79e-69c1-449b-b5ae-a67861de7af9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:46.966910 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a87c79e-69c1-449b-b5ae-a67861de7af9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:46.969207 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a87c79e-69c1-449b-b5ae-a67861de7af9 service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:46.993883 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 955/1897] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:30:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:30:47.579777 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc6c9fd-d2dd-45d6-b4e2-ff3cc7a9fbdc None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:47.581363 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-8bc6c9fd-d2dd-45d6-b4e2-ff3cc7a9fbdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:47.597023 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc6c9fd-d2dd-45d6-b4e2-ff3cc7a9fbdc None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:47.602001 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f7f7c-83b9-45c2-b6d6-9ed347daff88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:47.602777 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f7f7c-83b9-45c2-b6d6-9ed347daff88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:47.603101 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f7f7c-83b9-45c2-b6d6-9ed347daff88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:47.603437 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f7f7c-83b9-45c2-b6d6-9ed347daff88 admin admin] PATH_INFO: `/v3/projects/07d576b52602419f8ce0abed478fa31c` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:47.604929 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2f7f7c-83b9-45c2-b6d6-9ed347daff88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07d576b52602419f8ce0abed478fa31c)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:47.607402 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2f7f7c-83b9-45c2-b6d6-9ed347daff88 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:47.631574 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:47.657768 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-0b2f7f7c-83b9-45c2-b6d6-9ed347daff88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07d576b52602419f8ce0abed478fa31c', 'request_id': 'req-0b2f7f7c-83b9-45c2-b6d6-9ed347daff88'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:47.667025 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-0b2f7f7c-83b9-45c2-b6d6-9ed347daff88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07d576b52602419f8ce0abed478fa31c', 'request_id': 'req-0b2f7f7c-83b9-45c2-b6d6-9ed347daff88'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:47.673066 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-0b2f7f7c-83b9-45c2-b6d6-9ed347daff88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07d576b52602419f8ce0abed478fa31c', 'request_id': 'req-0b2f7f7c-83b9-45c2-b6d6-9ed347daff88'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:47.685294 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-0b2f7f7c-83b9-45c2-b6d6-9ed347daff88 admin admin] The token cache is being invalidate because project 07d576b52602419f8ce0abed478fa31c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:30:47.685583 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-0b2f7f7c-83b9-45c2-b6d6-9ed347daff88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:47.686272 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-0b2f7f7c-83b9-45c2-b6d6-9ed347daff88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:47.687850 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 943/1898] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:30:47 2022] DELETE /identity/v3/projects/07d576b52602419f8ce0abed478fa31c => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:30:47.692485 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a87c79e-69c1-449b-b5ae-a67861de7af9 service neutron] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:47.703497 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a87c79e-69c1-449b-b5ae-a67861de7af9 service neutron] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:47.774765 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18c0cc7-995e-4817-8fde-21e753b83e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:47.775427 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c0cc7-995e-4817-8fde-21e753b83e20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:47.775699 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c0cc7-995e-4817-8fde-21e753b83e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:47.775963 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c0cc7-995e-4817-8fde-21e753b83e20 admin admin] PATH_INFO: `/v3/users/aff8c1db5ed54a008b5cce5f3eaa20a9` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:47.777082 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18c0cc7-995e-4817-8fde-21e753b83e20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aff8c1db5ed54a008b5cce5f3eaa20a9)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:47.779017 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18c0cc7-995e-4817-8fde-21e753b83e20 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:47.826698 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-b18c0cc7-995e-4817-8fde-21e753b83e20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aff8c1db5ed54a008b5cce5f3eaa20a9'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:47.836541 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-b18c0cc7-995e-4817-8fde-21e753b83e20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aff8c1db5ed54a008b5cce5f3eaa20a9'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:47.837160 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-b18c0cc7-995e-4817-8fde-21e753b83e20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aff8c1db5ed54a008b5cce5f3eaa20a9'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:47.842879 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:47.844894 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-b18c0cc7-995e-4817-8fde-21e753b83e20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aff8c1db5ed54a008b5cce5f3eaa20a9'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:47.859155 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-b18c0cc7-995e-4817-8fde-21e753b83e20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aff8c1db5ed54a008b5cce5f3eaa20a9'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:47.865318 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 956/1899] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:30:47 2022] DELETE /identity/v3/users/aff8c1db5ed54a008b5cce5f3eaa20a9 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:30:47.975810 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f7f7c-83b9-45c2-b6d6-9ed347daff88 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:47.977652 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-0b2f7f7c-83b9-45c2-b6d6-9ed347daff88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:47.991315 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f7f7c-83b9-45c2-b6d6-9ed347daff88 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:48.056400 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5169cc-d05c-41fa-bcf9-608bac994dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:48.057049 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5169cc-d05c-41fa-bcf9-608bac994dcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:48.057497 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5169cc-d05c-41fa-bcf9-608bac994dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:48.057826 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5169cc-d05c-41fa-bcf9-608bac994dcf admin admin] PATH_INFO: `/v3/users/c3e50af7de924214a54fd133c4400084` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:48.059169 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5169cc-d05c-41fa-bcf9-608bac994dcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3e50af7de924214a54fd133c4400084)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:48.061311 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5169cc-d05c-41fa-bcf9-608bac994dcf admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:48.132876 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-0f5169cc-d05c-41fa-bcf9-608bac994dcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3e50af7de924214a54fd133c4400084'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:48.143781 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-0f5169cc-d05c-41fa-bcf9-608bac994dcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3e50af7de924214a54fd133c4400084'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:48.144689 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-0f5169cc-d05c-41fa-bcf9-608bac994dcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3e50af7de924214a54fd133c4400084'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:48.171039 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-0f5169cc-d05c-41fa-bcf9-608bac994dcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3e50af7de924214a54fd133c4400084'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:48.190009 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-0f5169cc-d05c-41fa-bcf9-608bac994dcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3e50af7de924214a54fd133c4400084'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:48.198158 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 944/1900] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:30:47 2022] DELETE /identity/v3/users/c3e50af7de924214a54fd133c4400084 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:30:48.202715 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca6c22-345e-4ba2-9458-f69a3dfc14c7 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:48.203001 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca6c22-345e-4ba2-9458-f69a3dfc14c7 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:48.203274 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca6c22-345e-4ba2-9458-f69a3dfc14c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:48.224954 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-3aca6c22-345e-4ba2-9458-f69a3dfc14c7 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:48.226229 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-3aca6c22-345e-4ba2-9458-f69a3dfc14c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:48.240695 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5169cc-d05c-41fa-bcf9-608bac994dcf admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:48.242271 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-0f5169cc-d05c-41fa-bcf9-608bac994dcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:48.275329 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:48.340954 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 957/1901] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:30:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:48.363340 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aca6c22-345e-4ba2-9458-f69a3dfc14c7 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:48.365379 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-3aca6c22-345e-4ba2-9458-f69a3dfc14c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:48.389402 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5169cc-d05c-41fa-bcf9-608bac994dcf admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:48.398324 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d2a755-9659-4842-8e65-7c9636abaecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:48.399412 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2a755-9659-4842-8e65-7c9636abaecb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:48.399768 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2a755-9659-4842-8e65-7c9636abaecb admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:48.400040 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2a755-9659-4842-8e65-7c9636abaecb admin admin] PATH_INFO: `/v3/projects/7a215475eaae4e1f9f275622edb0048d` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:48.401439 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d2a755-9659-4842-8e65-7c9636abaecb admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a215475eaae4e1f9f275622edb0048d)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:48.403295 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d2a755-9659-4842-8e65-7c9636abaecb admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:48.462614 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aca6c22-345e-4ba2-9458-f69a3dfc14c7 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:48.474952 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-88d2a755-9659-4842-8e65-7c9636abaecb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a215475eaae4e1f9f275622edb0048d', 'request_id': 'req-88d2a755-9659-4842-8e65-7c9636abaecb'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:48.489369 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-88d2a755-9659-4842-8e65-7c9636abaecb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a215475eaae4e1f9f275622edb0048d', 'request_id': 'req-88d2a755-9659-4842-8e65-7c9636abaecb'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:48.508333 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-88d2a755-9659-4842-8e65-7c9636abaecb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a215475eaae4e1f9f275622edb0048d', 'request_id': 'req-88d2a755-9659-4842-8e65-7c9636abaecb'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:48.526745 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-88d2a755-9659-4842-8e65-7c9636abaecb admin admin] The token cache is being invalidate because project 7a215475eaae4e1f9f275622edb0048d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:30:48.526974 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-88d2a755-9659-4842-8e65-7c9636abaecb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:48.528230 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-88d2a755-9659-4842-8e65-7c9636abaecb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:48.530046 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 945/1902] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:30:48 2022] DELETE /identity/v3/projects/7a215475eaae4e1f9f275622edb0048d => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:30:48.531038 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d2a755-9659-4842-8e65-7c9636abaecb admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:48.533859 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-88d2a755-9659-4842-8e65-7c9636abaecb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:48.571330 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e22ffb-dea2-49f2-9351-291fd793c0d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:48.571950 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e22ffb-dea2-49f2-9351-291fd793c0d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:48.572222 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e22ffb-dea2-49f2-9351-291fd793c0d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:48.572487 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e22ffb-dea2-49f2-9351-291fd793c0d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:48.574384 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-21e22ffb-dea2-49f2-9351-291fd793c0d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:48.641271 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d2a755-9659-4842-8e65-7c9636abaecb admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:48.646532 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ebe595-3ee6-453f-a0da-d993d2edcd2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:48.647615 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ebe595-3ee6-453f-a0da-d993d2edcd2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:48.647985 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ebe595-3ee6-453f-a0da-d993d2edcd2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:48.648796 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ebe595-3ee6-453f-a0da-d993d2edcd2f admin admin] PATH_INFO: `/v3/users/f3f8b83d22fd41248c6ef8a691994e46` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:48.651266 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:48.651805 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ebe595-3ee6-453f-a0da-d993d2edcd2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3f8b83d22fd41248c6ef8a691994e46)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:48.655676 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ebe595-3ee6-453f-a0da-d993d2edcd2f admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:48.673554 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e22ffb-dea2-49f2-9351-291fd793c0d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:48.675048 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e22ffb-dea2-49f2-9351-291fd793c0d7 service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:48.688553 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 958/1903] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:30:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:30:48.689448 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e22ffb-dea2-49f2-9351-291fd793c0d7 service neutron] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:48.691088 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-21e22ffb-dea2-49f2-9351-291fd793c0d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:48.705683 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e22ffb-dea2-49f2-9351-291fd793c0d7 service neutron] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:48.714273 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814ce388-c5a7-4687-9924-9b8892987e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:48.715286 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ce388-c5a7-4687-9924-9b8892987e7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:48.715827 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ce388-c5a7-4687-9924-9b8892987e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:48.716164 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ce388-c5a7-4687-9924-9b8892987e7f admin admin] PATH_INFO: `/v3/users/757d2bb90409446fac4fd16f0dd93657` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:48.718135 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814ce388-c5a7-4687-9924-9b8892987e7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=757d2bb90409446fac4fd16f0dd93657)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:48.721340 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814ce388-c5a7-4687-9924-9b8892987e7f admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:48.761026 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-77ebe595-3ee6-453f-a0da-d993d2edcd2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3f8b83d22fd41248c6ef8a691994e46'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:48.773301 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-77ebe595-3ee6-453f-a0da-d993d2edcd2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3f8b83d22fd41248c6ef8a691994e46'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:48.774296 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-77ebe595-3ee6-453f-a0da-d993d2edcd2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3f8b83d22fd41248c6ef8a691994e46'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:48.778234 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:48.795245 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-77ebe595-3ee6-453f-a0da-d993d2edcd2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3f8b83d22fd41248c6ef8a691994e46'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:48.816752 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-814ce388-c5a7-4687-9924-9b8892987e7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '757d2bb90409446fac4fd16f0dd93657'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:48.817730 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-77ebe595-3ee6-453f-a0da-d993d2edcd2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3f8b83d22fd41248c6ef8a691994e46'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:48.835525 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 946/1904] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:30:48 2022] DELETE /identity/v3/users/f3f8b83d22fd41248c6ef8a691994e46 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:30:48.836295 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-814ce388-c5a7-4687-9924-9b8892987e7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '757d2bb90409446fac4fd16f0dd93657'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:48.838606 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-814ce388-c5a7-4687-9924-9b8892987e7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '757d2bb90409446fac4fd16f0dd93657'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:48.841301 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4c520-408b-472e-ae46-a05e55c5b59b None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:48.841748 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4c520-408b-472e-ae46-a05e55c5b59b None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:48.842647 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4c520-408b-472e-ae46-a05e55c5b59b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:48.848939 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-814ce388-c5a7-4687-9924-9b8892987e7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '757d2bb90409446fac4fd16f0dd93657'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:48.873307 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-814ce388-c5a7-4687-9924-9b8892987e7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '757d2bb90409446fac4fd16f0dd93657'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:48.874506 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-abe4c520-408b-472e-ae46-a05e55c5b59b None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:48.876834 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-abe4c520-408b-472e-ae46-a05e55c5b59b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:48.919824 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 959/1905] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:30:48 2022] DELETE /identity/v3/users/757d2bb90409446fac4fd16f0dd93657 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:30:49.002308 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 947/1906] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:30:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:49.032953 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814ce388-c5a7-4687-9924-9b8892987e7f admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:49.036543 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-814ce388-c5a7-4687-9924-9b8892987e7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:49.203460 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814ce388-c5a7-4687-9924-9b8892987e7f admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:49.209316 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e808f-6083-40bf-bcca-df5ddafdfa1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:49.210305 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e808f-6083-40bf-bcca-df5ddafdfa1f service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:49.210305 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e808f-6083-40bf-bcca-df5ddafdfa1f service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:49.222702 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e808f-6083-40bf-bcca-df5ddafdfa1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:49.362782 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3e808f-6083-40bf-bcca-df5ddafdfa1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:49.366260 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3e808f-6083-40bf-bcca-df5ddafdfa1f service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:49.381214 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 960/1907] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:30:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:30:49.474745 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe4c520-408b-472e-ae46-a05e55c5b59b None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:49.484081 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-abe4c520-408b-472e-ae46-a05e55c5b59b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:49.501127 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe4c520-408b-472e-ae46-a05e55c5b59b None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:49.506437 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cb6417-141d-4d30-ac42-8b8106de060a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:49.507331 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb6417-141d-4d30-ac42-8b8106de060a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:49.507616 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb6417-141d-4d30-ac42-8b8106de060a admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:49.513594 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb6417-141d-4d30-ac42-8b8106de060a admin admin] PATH_INFO: `/v3/projects/dfa3291fc25441ee9ac864e7b8261767` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:49.521504 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cb6417-141d-4d30-ac42-8b8106de060a admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfa3291fc25441ee9ac864e7b8261767)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:49.523839 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cb6417-141d-4d30-ac42-8b8106de060a admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:49.584771 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-88cb6417-141d-4d30-ac42-8b8106de060a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfa3291fc25441ee9ac864e7b8261767', 'request_id': 'req-88cb6417-141d-4d30-ac42-8b8106de060a'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:49.601626 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-88cb6417-141d-4d30-ac42-8b8106de060a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfa3291fc25441ee9ac864e7b8261767', 'request_id': 'req-88cb6417-141d-4d30-ac42-8b8106de060a'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:49.609992 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-88cb6417-141d-4d30-ac42-8b8106de060a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfa3291fc25441ee9ac864e7b8261767', 'request_id': 'req-88cb6417-141d-4d30-ac42-8b8106de060a'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:49.627934 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-88cb6417-141d-4d30-ac42-8b8106de060a admin admin] The token cache is being invalidate because project dfa3291fc25441ee9ac864e7b8261767 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:30:49.628220 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-88cb6417-141d-4d30-ac42-8b8106de060a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:49.628998 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-88cb6417-141d-4d30-ac42-8b8106de060a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:49.631168 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 948/1908] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:30:49 2022] DELETE /identity/v3/projects/dfa3291fc25441ee9ac864e7b8261767 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:30:49.635248 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e808f-6083-40bf-bcca-df5ddafdfa1f service neutron] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:49.651006 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e808f-6083-40bf-bcca-df5ddafdfa1f service neutron] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:49.656201 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:49.703377 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cb6417-141d-4d30-ac42-8b8106de060a admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:49.709185 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-88cb6417-141d-4d30-ac42-8b8106de060a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:49.727714 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e85ba2-784e-4806-94a6-a2f451900fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:49.728368 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e85ba2-784e-4806-94a6-a2f451900fb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:49.728834 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e85ba2-784e-4806-94a6-a2f451900fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:49.729486 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e85ba2-784e-4806-94a6-a2f451900fb3 admin admin] PATH_INFO: `/v3/users/5ea49678a2324bd3885b640e9f9e7710` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:49.730990 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e85ba2-784e-4806-94a6-a2f451900fb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ea49678a2324bd3885b640e9f9e7710)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:49.733570 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e85ba2-784e-4806-94a6-a2f451900fb3 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:49.801126 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-37e85ba2-784e-4806-94a6-a2f451900fb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ea49678a2324bd3885b640e9f9e7710'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:49.802802 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:49.810658 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cb6417-141d-4d30-ac42-8b8106de060a admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:49.811742 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-37e85ba2-784e-4806-94a6-a2f451900fb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ea49678a2324bd3885b640e9f9e7710'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:49.812643 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-37e85ba2-784e-4806-94a6-a2f451900fb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ea49678a2324bd3885b640e9f9e7710'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:49.818564 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ad32a6-bf32-437d-ad6d-a75e4e27a822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:49.819490 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad32a6-bf32-437d-ad6d-a75e4e27a822 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:49.819905 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad32a6-bf32-437d-ad6d-a75e4e27a822 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:49.820318 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad32a6-bf32-437d-ad6d-a75e4e27a822 admin admin] PATH_INFO: `/v3/projects/174c1217fb6145bdbbda89c184e47e3d` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:49.822320 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ad32a6-bf32-437d-ad6d-a75e4e27a822 admin admin] RBAC: Authorizing `identity:delete_project(project_id=174c1217fb6145bdbbda89c184e47e3d)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:49.824127 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-37e85ba2-784e-4806-94a6-a2f451900fb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ea49678a2324bd3885b640e9f9e7710'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:49.826724 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ad32a6-bf32-437d-ad6d-a75e4e27a822 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:49.838564 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-37e85ba2-784e-4806-94a6-a2f451900fb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ea49678a2324bd3885b640e9f9e7710'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:49.850133 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 961/1909] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:30:49 2022] DELETE /identity/v3/users/5ea49678a2324bd3885b640e9f9e7710 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:30:49.889312 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-37ad32a6-bf32-437d-ad6d-a75e4e27a822 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '174c1217fb6145bdbbda89c184e47e3d', 'request_id': 'req-37ad32a6-bf32-437d-ad6d-a75e4e27a822'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:49.919401 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-37ad32a6-bf32-437d-ad6d-a75e4e27a822 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '174c1217fb6145bdbbda89c184e47e3d', 'request_id': 'req-37ad32a6-bf32-437d-ad6d-a75e4e27a822'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:49.929219 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-37ad32a6-bf32-437d-ad6d-a75e4e27a822 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '174c1217fb6145bdbbda89c184e47e3d', 'request_id': 'req-37ad32a6-bf32-437d-ad6d-a75e4e27a822'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:49.944311 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-37ad32a6-bf32-437d-ad6d-a75e4e27a822 admin admin] The token cache is being invalidate because project 174c1217fb6145bdbbda89c184e47e3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:30:49.945053 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-37ad32a6-bf32-437d-ad6d-a75e4e27a822 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:49.945899 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-37ad32a6-bf32-437d-ad6d-a75e4e27a822 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:49.948340 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 949/1910] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:30:49 2022] DELETE /identity/v3/projects/174c1217fb6145bdbbda89c184e47e3d => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:30:49.955815 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda0428-5a66-4559-ac4a-aed834b7b2c5 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:49.956257 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda0428-5a66-4559-ac4a-aed834b7b2c5 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:49.956637 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda0428-5a66-4559-ac4a-aed834b7b2c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:49.982999 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-ebda0428-5a66-4559-ac4a-aed834b7b2c5 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:49.985274 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-ebda0428-5a66-4559-ac4a-aed834b7b2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:50.149869 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 962/1911] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:30:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:50.158369 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed664f56-5998-42fe-811b-12fc616fdfee None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:50.158897 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed664f56-5998-42fe-811b-12fc616fdfee None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:50.158897 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed664f56-5998-42fe-811b-12fc616fdfee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:50.203472 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-ed664f56-5998-42fe-811b-12fc616fdfee None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:50.206313 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-ed664f56-5998-42fe-811b-12fc616fdfee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:50.228523 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 950/1912] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:30:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 01:30:50.233462 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebda0428-5a66-4559-ac4a-aed834b7b2c5 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:50.251761 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebda0428-5a66-4559-ac4a-aed834b7b2c5 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:50.266138 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195eff7b-2e8f-492c-b235-73331bd9065d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:50.266900 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195eff7b-2e8f-492c-b235-73331bd9065d admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:50.271315 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195eff7b-2e8f-492c-b235-73331bd9065d admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:50.271751 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195eff7b-2e8f-492c-b235-73331bd9065d admin admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:50.272608 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195eff7b-2e8f-492c-b235-73331bd9065d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:30:50.272951 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195eff7b-2e8f-492c-b235-73331bd9065d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:50.276348 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195eff7b-2e8f-492c-b235-73331bd9065d admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:50.305056 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 963/1913] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 01:30:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:30:50.309283 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed664f56-5998-42fe-811b-12fc616fdfee None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:50.323657 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed664f56-5998-42fe-811b-12fc616fdfee None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:50.342451 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91966025-aa3e-40cc-b2f7-83928c626d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:50.343099 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91966025-aa3e-40cc-b2f7-83928c626d82 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:50.343371 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91966025-aa3e-40cc-b2f7-83928c626d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:50.343635 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91966025-aa3e-40cc-b2f7-83928c626d82 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:50.344282 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91966025-aa3e-40cc-b2f7-83928c626d82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:50.346233 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91966025-aa3e-40cc-b2f7-83928c626d82 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:50.378946 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 951/1914] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:30:50 2022] POST /identity/v3/projects => generated 387 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:30:50.383464 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195eff7b-2e8f-492c-b235-73331bd9065d admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:50.394859 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195eff7b-2e8f-492c-b235-73331bd9065d admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:50.413942 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:50.428691 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91966025-aa3e-40cc-b2f7-83928c626d82 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:50.431115 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-91966025-aa3e-40cc-b2f7-83928c626d82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:50.538478 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ccc1f-82fd-496a-baa7-195cda5a90b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:50.539108 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ccc1f-82fd-496a-baa7-195cda5a90b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:50.539387 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ccc1f-82fd-496a-baa7-195cda5a90b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:50.540151 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ccc1f-82fd-496a-baa7-195cda5a90b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:50.540342 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26ccc1f-82fd-496a-baa7-195cda5a90b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:50.542241 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26ccc1f-82fd-496a-baa7-195cda5a90b7 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:50.559025 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91966025-aa3e-40cc-b2f7-83928c626d82 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:50.564519 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7d69e1-407b-44de-bda0-0d471aec8fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:50.565234 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d69e1-407b-44de-bda0-0d471aec8fa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:50.565516 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d69e1-407b-44de-bda0-0d471aec8fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:50.565787 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d69e1-407b-44de-bda0-0d471aec8fa1 admin admin] PATH_INFO: `/v3/projects/8000108f1d644b278321c8a86095f109` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:50.567254 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7d69e1-407b-44de-bda0-0d471aec8fa1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8000108f1d644b278321c8a86095f109)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:50.570728 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7d69e1-407b-44de-bda0-0d471aec8fa1 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:50.575654 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 964/1915] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:30:50 2022] POST /identity/v3/users => generated 294 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:30:50.576714 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ccc1f-82fd-496a-baa7-195cda5a90b7 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:50.578927 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-e26ccc1f-82fd-496a-baa7-195cda5a90b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:50.595228 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ccc1f-82fd-496a-baa7-195cda5a90b7 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:50.611028 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24131df9-ecc3-404e-bd79-440459e2eef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:50.611701 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24131df9-ecc3-404e-bd79-440459e2eef5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:50.612008 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24131df9-ecc3-404e-bd79-440459e2eef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:50.612286 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24131df9-ecc3-404e-bd79-440459e2eef5 admin admin] PATH_INFO: `/v3/projects/1ac4d1b717474415910626e284f476cf` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:50.613596 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24131df9-ecc3-404e-bd79-440459e2eef5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ac4d1b717474415910626e284f476cf)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:50.619881 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24131df9-ecc3-404e-bd79-440459e2eef5 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:50.632644 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-1e7d69e1-407b-44de-bda0-0d471aec8fa1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8000108f1d644b278321c8a86095f109', 'request_id': 'req-1e7d69e1-407b-44de-bda0-0d471aec8fa1'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:50.643510 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-1e7d69e1-407b-44de-bda0-0d471aec8fa1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8000108f1d644b278321c8a86095f109', 'request_id': 'req-1e7d69e1-407b-44de-bda0-0d471aec8fa1'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:50.645491 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:50.650896 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-1e7d69e1-407b-44de-bda0-0d471aec8fa1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8000108f1d644b278321c8a86095f109', 'request_id': 'req-1e7d69e1-407b-44de-bda0-0d471aec8fa1'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:50.663614 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-1e7d69e1-407b-44de-bda0-0d471aec8fa1 admin admin] The token cache is being invalidate because project 8000108f1d644b278321c8a86095f109 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:30:50.663948 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-1e7d69e1-407b-44de-bda0-0d471aec8fa1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:50.665178 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-1e7d69e1-407b-44de-bda0-0d471aec8fa1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:50.666763 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 952/1916] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:30:50 2022] DELETE /identity/v3/projects/8000108f1d644b278321c8a86095f109 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:30:50.667578 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7d69e1-407b-44de-bda0-0d471aec8fa1 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:50.668813 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-1e7d69e1-407b-44de-bda0-0d471aec8fa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:50.674360 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-24131df9-ecc3-404e-bd79-440459e2eef5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ac4d1b717474415910626e284f476cf', 'request_id': 'req-24131df9-ecc3-404e-bd79-440459e2eef5'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:50.680357 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-24131df9-ecc3-404e-bd79-440459e2eef5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ac4d1b717474415910626e284f476cf', 'request_id': 'req-24131df9-ecc3-404e-bd79-440459e2eef5'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:50.687120 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-24131df9-ecc3-404e-bd79-440459e2eef5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ac4d1b717474415910626e284f476cf', 'request_id': 'req-24131df9-ecc3-404e-bd79-440459e2eef5'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:50.702340 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-24131df9-ecc3-404e-bd79-440459e2eef5 admin admin] The token cache is being invalidate because project 1ac4d1b717474415910626e284f476cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:30:50.702626 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-24131df9-ecc3-404e-bd79-440459e2eef5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:50.703314 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-24131df9-ecc3-404e-bd79-440459e2eef5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:50.704984 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 965/1917] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:30:50 2022] DELETE /identity/v3/projects/1ac4d1b717474415910626e284f476cf => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:30:50.705745 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24131df9-ecc3-404e-bd79-440459e2eef5 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:50.707060 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-24131df9-ecc3-404e-bd79-440459e2eef5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:50.743723 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7d69e1-407b-44de-bda0-0d471aec8fa1 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:50.783889 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24131df9-ecc3-404e-bd79-440459e2eef5 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:50.811407 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba88d9c9-137d-4650-bb9a-3669b805eda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:50.812170 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba88d9c9-137d-4650-bb9a-3669b805eda3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:50.812463 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba88d9c9-137d-4650-bb9a-3669b805eda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:50.812597 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b73ba-911f-4cbb-b7cb-93e8d63bda99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:50.812842 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba88d9c9-137d-4650-bb9a-3669b805eda3 admin admin] PATH_INFO: `/v3/users/d2325e4104794c438647c779bddba8fa` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:50.813175 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b73ba-911f-4cbb-b7cb-93e8d63bda99 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:50.813584 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b73ba-911f-4cbb-b7cb-93e8d63bda99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:50.814031 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b73ba-911f-4cbb-b7cb-93e8d63bda99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:50.814674 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba88d9c9-137d-4650-bb9a-3669b805eda3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2325e4104794c438647c779bddba8fa)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:50.814791 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70b73ba-911f-4cbb-b7cb-93e8d63bda99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:50.816339 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70b73ba-911f-4cbb-b7cb-93e8d63bda99 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:50.816579 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba88d9c9-137d-4650-bb9a-3669b805eda3 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:50.827015 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 953/1918] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:30:50 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:30:50.828288 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575743ba-c542-4d04-a8c5-f9817397ec2b None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:50.828574 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575743ba-c542-4d04-a8c5-f9817397ec2b None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:50.828846 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575743ba-c542-4d04-a8c5-f9817397ec2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:50.850519 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-575743ba-c542-4d04-a8c5-f9817397ec2b None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:50.851794 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-575743ba-c542-4d04-a8c5-f9817397ec2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:50.859880 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=84,keystone:INSERT=4,keystone:DELETE=12 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:50.865188 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 954/1919] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:30:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:50.867148 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575743ba-c542-4d04-a8c5-f9817397ec2b None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:50.869561 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-575743ba-c542-4d04-a8c5-f9817397ec2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:50.886557 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575743ba-c542-4d04-a8c5-f9817397ec2b None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:50.896516 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf099b4-33fd-4a32-9daa-5c79283473e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:50.898656 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf099b4-33fd-4a32-9daa-5c79283473e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:50.899100 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf099b4-33fd-4a32-9daa-5c79283473e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:50.899537 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf099b4-33fd-4a32-9daa-5c79283473e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:50.900484 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf099b4-33fd-4a32-9daa-5c79283473e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:50.902679 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf099b4-33fd-4a32-9daa-5c79283473e4 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:50.906318 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-ba88d9c9-137d-4650-bb9a-3669b805eda3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2325e4104794c438647c779bddba8fa'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:50.922288 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-ba88d9c9-137d-4650-bb9a-3669b805eda3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2325e4104794c438647c779bddba8fa'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:50.922980 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-ba88d9c9-137d-4650-bb9a-3669b805eda3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2325e4104794c438647c779bddba8fa'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:50.932727 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 955/1920] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:30:50 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:30:50.934957 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-ba88d9c9-137d-4650-bb9a-3669b805eda3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2325e4104794c438647c779bddba8fa'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:50.935618 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dfe33a-8db1-4a83-961f-760a1c7dd3bf None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:50.938169 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dfe33a-8db1-4a83-961f-760a1c7dd3bf None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:50.938754 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dfe33a-8db1-4a83-961f-760a1c7dd3bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:50.963203 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-ba88d9c9-137d-4650-bb9a-3669b805eda3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2325e4104794c438647c779bddba8fa'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:50.974763 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 966/1921] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:30:50 2022] DELETE /identity/v3/users/d2325e4104794c438647c779bddba8fa => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:30:50.975892 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba88d9c9-137d-4650-bb9a-3669b805eda3 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:50.976137 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-40dfe33a-8db1-4a83-961f-760a1c7dd3bf None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:50.977941 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-ba88d9c9-137d-4650-bb9a-3669b805eda3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:50.978094 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-40dfe33a-8db1-4a83-961f-760a1c7dd3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:51.053973 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba88d9c9-137d-4650-bb9a-3669b805eda3 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:51.059774 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1a34b-bbbb-42bc-957e-e71f204178d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:51.060571 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1a34b-bbbb-42bc-957e-e71f204178d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:51.060956 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1a34b-bbbb-42bc-957e-e71f204178d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:51.061292 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1a34b-bbbb-42bc-957e-e71f204178d2 admin admin] PATH_INFO: `/v3/projects/a205389826a54fd7bb931bd1d4eeb0bb/users/0ab12d9941d84ac18d78832adcdb475b/roles/13af81971c1c428eae0a571a22ea583d` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:51.064821 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 956/1922] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:30:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:51.066312 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dfe33a-8db1-4a83-961f-760a1c7dd3bf None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:51.078173 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dfe33a-8db1-4a83-961f-760a1c7dd3bf None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:51.084719 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e1a34b-bbbb-42bc-957e-e71f204178d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a205389826a54fd7bb931bd1d4eeb0bb, user_id=0ab12d9941d84ac18d78832adcdb475b, role_id=13af81971c1c428eae0a571a22ea583d)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:51.084923 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef825c05-55ee-4b04-8907-87902341f86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:51.085333 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef825c05-55ee-4b04-8907-87902341f86c admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:51.085640 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef825c05-55ee-4b04-8907-87902341f86c admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:51.085977 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef825c05-55ee-4b04-8907-87902341f86c admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:51.086668 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef825c05-55ee-4b04-8907-87902341f86c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:30:51.087161 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef825c05-55ee-4b04-8907-87902341f86c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:51.088159 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e1a34b-bbbb-42bc-957e-e71f204178d2 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:51.088990 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef825c05-55ee-4b04-8907-87902341f86c admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:51.108808 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 967/1923] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:30:50 2022] PUT /identity/v3/projects/a205389826a54fd7bb931bd1d4eeb0bb/users/0ab12d9941d84ac18d78832adcdb475b/roles/13af81971c1c428eae0a571a22ea583d => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:30:51.120116 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:51.122751 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94569129-4548-4043-aca2-97245defa439 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:51.123035 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94569129-4548-4043-aca2-97245defa439 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:51.123297 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94569129-4548-4043-aca2-97245defa439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:51.128388 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 957/1924] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 01:30:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:30:51.133672 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef825c05-55ee-4b04-8907-87902341f86c admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:51.146357 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef825c05-55ee-4b04-8907-87902341f86c admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:51.164038 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-94569129-4548-4043-aca2-97245defa439 None None] MFA Rules not processed for user `0ab12d9941d84ac18d78832adcdb475b`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:51.166021 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-94569129-4548-4043-aca2-97245defa439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:51.251917 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc26534-c9f7-4ad2-8396-7e2e0bfc5e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:51.252581 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc26534-c9f7-4ad2-8396-7e2e0bfc5e8f admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:51.253324 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc26534-c9f7-4ad2-8396-7e2e0bfc5e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:51.257742 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc26534-c9f7-4ad2-8396-7e2e0bfc5e8f admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:51.258550 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc26534-c9f7-4ad2-8396-7e2e0bfc5e8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:51.261211 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc26534-c9f7-4ad2-8396-7e2e0bfc5e8f admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:51.291775 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 968/1925] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:30:51 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:51.302852 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94569129-4548-4043-aca2-97245defa439 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:51.304333 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 958/1926] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:30:51 2022] POST /identity/v3/projects => generated 373 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:30:51.305541 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc26534-c9f7-4ad2-8396-7e2e0bfc5e8f admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:51.317474 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94569129-4548-4043-aca2-97245defa439 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:51.334733 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:51.450677 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc26534-c9f7-4ad2-8396-7e2e0bfc5e8f admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:51.459100 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28ebb63-229d-41c6-af33-d67114328cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:51.459758 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ebb63-229d-41c6-af33-d67114328cf3 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:51.460622 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ebb63-229d-41c6-af33-d67114328cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:51.460931 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ebb63-229d-41c6-af33-d67114328cf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:51.461721 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28ebb63-229d-41c6-af33-d67114328cf3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:51.464268 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28ebb63-229d-41c6-af33-d67114328cf3 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:51.468354 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb2f8a-d05a-4103-8d4b-06b96bfede4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:51.468995 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb2f8a-d05a-4103-8d4b-06b96bfede4e admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:51.469273 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb2f8a-d05a-4103-8d4b-06b96bfede4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:51.469543 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb2f8a-d05a-4103-8d4b-06b96bfede4e admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:51.470231 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecb2f8a-d05a-4103-8d4b-06b96bfede4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:51.472168 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecb2f8a-d05a-4103-8d4b-06b96bfede4e admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:51.501890 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 959/1927] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:30:51 2022] POST /identity/v3/users => generated 287 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:30:51.508894 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb2f8a-d05a-4103-8d4b-06b96bfede4e admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:51.533243 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb2f8a-d05a-4103-8d4b-06b96bfede4e admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:51.535821 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 969/1928] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:30:51 2022] POST /identity/v3/projects => generated 387 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:30:51.539934 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28ebb63-229d-41c6-af33-d67114328cf3 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:51.651652 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28ebb63-229d-41c6-af33-d67114328cf3 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:51.666751 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb257d9-e0b7-49a8-9456-3f849cafcc7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:51.667435 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb257d9-e0b7-49a8-9456-3f849cafcc7e admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:51.667782 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb257d9-e0b7-49a8-9456-3f849cafcc7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:51.668061 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb257d9-e0b7-49a8-9456-3f849cafcc7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:51.668734 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb257d9-e0b7-49a8-9456-3f849cafcc7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:51.678677 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb257d9-e0b7-49a8-9456-3f849cafcc7e admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:51.679669 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce3bc8d-3538-49e6-887b-8e00a3332448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:51.680755 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce3bc8d-3538-49e6-887b-8e00a3332448 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:51.681037 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce3bc8d-3538-49e6-887b-8e00a3332448 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:51.681350 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce3bc8d-3538-49e6-887b-8e00a3332448 admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:51.682538 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce3bc8d-3538-49e6-887b-8e00a3332448 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:51.684663 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce3bc8d-3538-49e6-887b-8e00a3332448 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:51.690965 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 960/1929] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:30:51 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 01:30:51.692257 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb257d9-e0b7-49a8-9456-3f849cafcc7e admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:51.695696 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-3cb257d9-e0b7-49a8-9456-3f849cafcc7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:51.710611 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb257d9-e0b7-49a8-9456-3f849cafcc7e admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:51.713174 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 970/1930] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:30:51 2022] POST /identity/v3/users => generated 300 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 01:30:51.714326 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce3bc8d-3538-49e6-887b-8e00a3332448 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:51.717796 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e8d64-df52-4fff-ba8c-18c3313d094a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:51.718751 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e8d64-df52-4fff-ba8c-18c3313d094a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:51.719099 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e8d64-df52-4fff-ba8c-18c3313d094a admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:51.719442 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e8d64-df52-4fff-ba8c-18c3313d094a admin admin] PATH_INFO: `/v3/projects/8b1c73f9ff4a4147aaa67f19d739dffc` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:51.720764 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70e8d64-df52-4fff-ba8c-18c3313d094a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b1c73f9ff4a4147aaa67f19d739dffc)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:51.723266 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70e8d64-df52-4fff-ba8c-18c3313d094a admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:51.726767 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce3bc8d-3538-49e6-887b-8e00a3332448 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:51.731037 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ea4f06-69b6-4ea9-b28f-49eb797ee6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:51.731331 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:51.731657 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea4f06-69b6-4ea9-b28f-49eb797ee6b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:51.731933 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea4f06-69b6-4ea9-b28f-49eb797ee6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:51.732558 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea4f06-69b6-4ea9-b28f-49eb797ee6b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:51.733066 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ea4f06-69b6-4ea9-b28f-49eb797ee6b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:51.734892 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ea4f06-69b6-4ea9-b28f-49eb797ee6b8 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:51.747641 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 971/1931] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:30:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:30:51.749026 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ea4f06-69b6-4ea9-b28f-49eb797ee6b8 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:51.760983 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ea4f06-69b6-4ea9-b28f-49eb797ee6b8 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:51.766733 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3858c3ac-25f5-42db-8077-da001d04ba56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:51.767287 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858c3ac-25f5-42db-8077-da001d04ba56 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:51.767603 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858c3ac-25f5-42db-8077-da001d04ba56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:51.767867 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858c3ac-25f5-42db-8077-da001d04ba56 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:51.768502 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3858c3ac-25f5-42db-8077-da001d04ba56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:51.770165 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3858c3ac-25f5-42db-8077-da001d04ba56 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:51.780492 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-c70e8d64-df52-4fff-ba8c-18c3313d094a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b1c73f9ff4a4147aaa67f19d739dffc', 'request_id': 'req-c70e8d64-df52-4fff-ba8c-18c3313d094a'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:51.784112 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 972/1932] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:30:51 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:30:51.784989 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3858c3ac-25f5-42db-8077-da001d04ba56 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:51.791949 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-c70e8d64-df52-4fff-ba8c-18c3313d094a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b1c73f9ff4a4147aaa67f19d739dffc', 'request_id': 'req-c70e8d64-df52-4fff-ba8c-18c3313d094a'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:51.802811 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3858c3ac-25f5-42db-8077-da001d04ba56 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:51.811254 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-c70e8d64-df52-4fff-ba8c-18c3313d094a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b1c73f9ff4a4147aaa67f19d739dffc', 'request_id': 'req-c70e8d64-df52-4fff-ba8c-18c3313d094a'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:51.828636 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-c70e8d64-df52-4fff-ba8c-18c3313d094a admin admin] The token cache is being invalidate because project 8b1c73f9ff4a4147aaa67f19d739dffc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:30:51.829020 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-c70e8d64-df52-4fff-ba8c-18c3313d094a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:51.829598 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-c70e8d64-df52-4fff-ba8c-18c3313d094a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:51.831143 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 961/1933] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:30:51 2022] DELETE /identity/v3/projects/8b1c73f9ff4a4147aaa67f19d739dffc => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:30:51.831955 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e8d64-df52-4fff-ba8c-18c3313d094a admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:51.847053 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c70e8d64-df52-4fff-ba8c-18c3313d094a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:51.875973 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a583f8a5-26c8-474b-aef0-9162ae19f255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:51.876991 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a583f8a5-26c8-474b-aef0-9162ae19f255 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:51.877710 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a583f8a5-26c8-474b-aef0-9162ae19f255 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:51.878174 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a583f8a5-26c8-474b-aef0-9162ae19f255 admin admin] PATH_INFO: `/v3/projects/3476ab6a476144c290a08405f6e4b48d/users/b4d9cc1f930a467780a84aea77999aab/roles/13af81971c1c428eae0a571a22ea583d` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:51.894965 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a583f8a5-26c8-474b-aef0-9162ae19f255 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3476ab6a476144c290a08405f6e4b48d, user_id=b4d9cc1f930a467780a84aea77999aab, role_id=13af81971c1c428eae0a571a22ea583d)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:51.905696 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a583f8a5-26c8-474b-aef0-9162ae19f255 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:51.908781 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:51.946399 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 973/1934] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:30:51 2022] PUT /identity/v3/projects/3476ab6a476144c290a08405f6e4b48d/users/b4d9cc1f930a467780a84aea77999aab/roles/13af81971c1c428eae0a571a22ea583d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:30:51.946603 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e8d64-df52-4fff-ba8c-18c3313d094a admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:51.946699 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9aaa0-d9c9-48b8-a729-45670b123526 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:51.946699 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9aaa0-d9c9-48b8-a729-45670b123526 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:51.946699 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9aaa0-d9c9-48b8-a729-45670b123526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:51.970436 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-abc9aaa0-d9c9-48b8-a729-45670b123526 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:51.971694 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-abc9aaa0-d9c9-48b8-a729-45670b123526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:52.049850 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d72f7ac-fe55-49d3-badd-980d25229129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:52.050730 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d72f7ac-fe55-49d3-badd-980d25229129 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:52.051126 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d72f7ac-fe55-49d3-badd-980d25229129 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:52.051507 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d72f7ac-fe55-49d3-badd-980d25229129 admin admin] PATH_INFO: `/v3/projects/68a2284a7b414beda2c27f1aac0e0162/users/d459c10007e049cb825199ed0c8051cb/roles/fb48693810be495fb4b1893a79429b78` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:52.054900 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 974/1935] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:30:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:52.063212 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832538ad-4166-4fbd-9881-54af224c860a None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:52.063642 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832538ad-4166-4fbd-9881-54af224c860a None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:52.064211 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832538ad-4166-4fbd-9881-54af224c860a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:52.081270 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d72f7ac-fe55-49d3-badd-980d25229129 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68a2284a7b414beda2c27f1aac0e0162, user_id=d459c10007e049cb825199ed0c8051cb, role_id=fb48693810be495fb4b1893a79429b78)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:52.084543 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d72f7ac-fe55-49d3-badd-980d25229129 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:52.102175 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-832538ad-4166-4fbd-9881-54af224c860a None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:52.103338 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-832538ad-4166-4fbd-9881-54af224c860a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:52.104873 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 962/1936] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:30:51 2022] PUT /identity/v3/projects/68a2284a7b414beda2c27f1aac0e0162/users/d459c10007e049cb825199ed0c8051cb/roles/fb48693810be495fb4b1893a79429b78 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:30:52.107767 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c907e95-6d85-4acc-a8b2-43e18733dfbc None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:52.107767 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c907e95-6d85-4acc-a8b2-43e18733dfbc None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:52.107767 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c907e95-6d85-4acc-a8b2-43e18733dfbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:52.153067 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-2c907e95-6d85-4acc-a8b2-43e18733dfbc None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:52.154604 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2c907e95-6d85-4acc-a8b2-43e18733dfbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:52.204079 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:52.228298 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 975/1937] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:30:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:52.229627 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832538ad-4166-4fbd-9881-54af224c860a None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:52.242866 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832538ad-4166-4fbd-9881-54af224c860a None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:52.258685 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4183994c-3b4a-481e-b5fc-7cf589157a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:52.259491 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4183994c-3b4a-481e-b5fc-7cf589157a42 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:52.259770 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4183994c-3b4a-481e-b5fc-7cf589157a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:52.260043 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4183994c-3b4a-481e-b5fc-7cf589157a42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:52.260833 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4183994c-3b4a-481e-b5fc-7cf589157a42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:52.265689 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4183994c-3b4a-481e-b5fc-7cf589157a42 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:52.289900 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 976/1938] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:30:52 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:30:52.295134 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4183994c-3b4a-481e-b5fc-7cf589157a42 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:52.308868 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 963/1939] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:30:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:52.313277 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c907e95-6d85-4acc-a8b2-43e18733dfbc None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:52.314458 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2c907e95-6d85-4acc-a8b2-43e18733dfbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:52.321168 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4183994c-3b4a-481e-b5fc-7cf589157a42 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:52.334211 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb83dfb-f2c9-447b-912d-3045d84254d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:52.334895 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb83dfb-f2c9-447b-912d-3045d84254d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:52.335167 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb83dfb-f2c9-447b-912d-3045d84254d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:52.335433 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb83dfb-f2c9-447b-912d-3045d84254d4 admin admin] PATH_INFO: `/v3/projects/68a2284a7b414beda2c27f1aac0e0162/users/d459c10007e049cb825199ed0c8051cb/roles/fb48693810be495fb4b1893a79429b78` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:52.339420 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb83dfb-f2c9-447b-912d-3045d84254d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68a2284a7b414beda2c27f1aac0e0162, user_id=d459c10007e049cb825199ed0c8051cb, role_id=fb48693810be495fb4b1893a79429b78)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:52.343475 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb83dfb-f2c9-447b-912d-3045d84254d4 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:52.355147 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 977/1940] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:30:52 2022] PUT /identity/v3/projects/68a2284a7b414beda2c27f1aac0e0162/users/d459c10007e049cb825199ed0c8051cb/roles/fb48693810be495fb4b1893a79429b78 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:30:52.365711 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb83dfb-f2c9-447b-912d-3045d84254d4 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:52.432259 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c907e95-6d85-4acc-a8b2-43e18733dfbc None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:52.521684 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725ec3f5-6684-4499-954d-80f194ac09de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:52.522558 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725ec3f5-6684-4499-954d-80f194ac09de service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:52.522836 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725ec3f5-6684-4499-954d-80f194ac09de service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:52.523177 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725ec3f5-6684-4499-954d-80f194ac09de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:52.532705 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb83dfb-f2c9-447b-912d-3045d84254d4 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:52.539950 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725ec3f5-6684-4499-954d-80f194ac09de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:52.541881 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725ec3f5-6684-4499-954d-80f194ac09de service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:52.552648 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a411cb1-33fc-4569-a3a6-d85d01c45a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:52.553293 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a411cb1-33fc-4569-a3a6-d85d01c45a1b admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:52.553567 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a411cb1-33fc-4569-a3a6-d85d01c45a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:52.553835 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a411cb1-33fc-4569-a3a6-d85d01c45a1b admin admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:52.554513 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a411cb1-33fc-4569-a3a6-d85d01c45a1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:30:52.555634 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a411cb1-33fc-4569-a3a6-d85d01c45a1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:52.556947 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a411cb1-33fc-4569-a3a6-d85d01c45a1b admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:52.575057 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 964/1941] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:30:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:30:52.576602 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee086d-ffa5-45d2-83a3-e51403c9a19d None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:52.576900 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee086d-ffa5-45d2-83a3-e51403c9a19d None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:52.579551 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee086d-ffa5-45d2-83a3-e51403c9a19d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:52.593893 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 978/1942] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 01:30:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:30:52.595408 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a411cb1-33fc-4569-a3a6-d85d01c45a1b admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:52.607406 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:52.613529 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a411cb1-33fc-4569-a3a6-d85d01c45a1b admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:52.623719 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b0db37-41f6-4db8-9b87-6bcdf18ac98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:52.625179 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0db37-41f6-4db8-9b87-6bcdf18ac98c admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:52.626208 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0db37-41f6-4db8-9b87-6bcdf18ac98c admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:52.626990 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0db37-41f6-4db8-9b87-6bcdf18ac98c admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:52.628420 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b0db37-41f6-4db8-9b87-6bcdf18ac98c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:52.633151 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b0db37-41f6-4db8-9b87-6bcdf18ac98c admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:52.664973 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-18ee086d-ffa5-45d2-83a3-e51403c9a19d None None] MFA Rules not processed for user `d459c10007e049cb825199ed0c8051cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:52.666407 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-18ee086d-ffa5-45d2-83a3-e51403c9a19d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:52.686221 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 979/1943] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:30:52 2022] POST /identity/v3/projects => generated 393 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:30:52.688820 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b0db37-41f6-4db8-9b87-6bcdf18ac98c admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:52.783346 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b0db37-41f6-4db8-9b87-6bcdf18ac98c admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:52.791546 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e75b49-5e91-4fae-905f-782473269142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:52.794293 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e75b49-5e91-4fae-905f-782473269142 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:52.794910 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e75b49-5e91-4fae-905f-782473269142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:52.795614 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e75b49-5e91-4fae-905f-782473269142 admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:52.796831 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e75b49-5e91-4fae-905f-782473269142 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:52.800150 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e75b49-5e91-4fae-905f-782473269142 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:52.830883 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 965/1944] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:30:52 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:52.844556 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee086d-ffa5-45d2-83a3-e51403c9a19d None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:52.846281 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-18ee086d-ffa5-45d2-83a3-e51403c9a19d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:52.862924 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:52.869569 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 980/1945] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:30:52 2022] POST /identity/v3/users => generated 297 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:30:52.870829 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e75b49-5e91-4fae-905f-782473269142 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:52.888721 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e75b49-5e91-4fae-905f-782473269142 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:52.900948 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de8123-a089-4461-b02e-51a09905f30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:52.901574 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de8123-a089-4461-b02e-51a09905f30d admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:52.901895 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de8123-a089-4461-b02e-51a09905f30d admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:52.902190 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de8123-a089-4461-b02e-51a09905f30d admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:52.902835 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82de8123-a089-4461-b02e-51a09905f30d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:52.906073 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82de8123-a089-4461-b02e-51a09905f30d admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:52.939188 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 981/1946] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:30:52 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 01:30:52.940819 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de8123-a089-4461-b02e-51a09905f30d admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:52.946252 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee086d-ffa5-45d2-83a3-e51403c9a19d None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:52.955333 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de8123-a089-4461-b02e-51a09905f30d admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:52.975422 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a220da-b723-46c9-9706-2faa372c602e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:52.978561 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a220da-b723-46c9-9706-2faa372c602e admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:52.978843 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a220da-b723-46c9-9706-2faa372c602e admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:52.979117 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a220da-b723-46c9-9706-2faa372c602e admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:52.979963 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a220da-b723-46c9-9706-2faa372c602e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:52.987163 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a220da-b723-46c9-9706-2faa372c602e admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:53.015911 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 982/1947] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:30:52 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:30:53.018000 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a220da-b723-46c9-9706-2faa372c602e admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:53.050466 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a220da-b723-46c9-9706-2faa372c602e admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:53.052531 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bd9e71-6e4c-48bf-aef3-d9b01278f711 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7853d40c29af424c8d7913950d89750b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:53.053233 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd9e71-6e4c-48bf-aef3-d9b01278f711 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:53.053539 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd9e71-6e4c-48bf-aef3-d9b01278f711 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:53.053721 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd9e71-6e4c-48bf-aef3-d9b01278f711 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:53.059089 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b73de6-6b91-4707-bd03-068311654507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:53.060137 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b73de6-6b91-4707-bd03-068311654507 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:53.060543 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b73de6-6b91-4707-bd03-068311654507 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:53.061003 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b73de6-6b91-4707-bd03-068311654507 admin admin] PATH_INFO: `/v3/projects/868f8747ff7f4a6ebd7bd9aa97080b23/users/197d995a8bb94f728287b6c3415f200f/roles/13af81971c1c428eae0a571a22ea583d` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:53.083627 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b73de6-6b91-4707-bd03-068311654507 admin admin] RBAC: Authorizing `identity:create_grant(project_id=868f8747ff7f4a6ebd7bd9aa97080b23, user_id=197d995a8bb94f728287b6c3415f200f, role_id=13af81971c1c428eae0a571a22ea583d)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:53.090858 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b73de6-6b91-4707-bd03-068311654507 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:53.122047 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 983/1948] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:30:53 2022] PUT /identity/v3/projects/868f8747ff7f4a6ebd7bd9aa97080b23/users/197d995a8bb94f728287b6c3415f200f/roles/13af81971c1c428eae0a571a22ea583d => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:30:53.133844 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f8aa2-1b0d-422a-a186-de038ac60621 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:53.134146 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f8aa2-1b0d-422a-a186-de038ac60621 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:53.134459 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f8aa2-1b0d-422a-a186-de038ac60621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:53.150750 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bd9e71-6e4c-48bf-aef3-d9b01278f711 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:53.153278 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bd9e71-6e4c-48bf-aef3-d9b01278f711 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:53.170248 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 966/1949] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:30:52 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 01:30:53.193497 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-9d8f8aa2-1b0d-422a-a186-de038ac60621 None None] MFA Rules not processed for user `197d995a8bb94f728287b6c3415f200f`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:53.194810 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-9d8f8aa2-1b0d-422a-a186-de038ac60621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:53.288678 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 984/1950] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:30:53 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 01:30:53.293601 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bd9e71-6e4c-48bf-aef3-d9b01278f711 service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:53.307070 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bd9e71-6e4c-48bf-aef3-d9b01278f711 service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:53.402097 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc813a11-86db-4828-98ad-79b0dc8df146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:53.402888 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc813a11-86db-4828-98ad-79b0dc8df146 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:53.403260 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc813a11-86db-4828-98ad-79b0dc8df146 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:53.404222 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc813a11-86db-4828-98ad-79b0dc8df146 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:53.404222 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc813a11-86db-4828-98ad-79b0dc8df146 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:53.406773 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc813a11-86db-4828-98ad-79b0dc8df146 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:53.441456 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:53.455474 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 967/1951] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:30:53 2022] POST /identity/v3/projects => generated 393 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:30:53.459637 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f8aa2-1b0d-422a-a186-de038ac60621 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:53.482790 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f8aa2-1b0d-422a-a186-de038ac60621 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:53.501922 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:53.571537 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ed7bac-4786-4f6e-b761-94f5b85c30d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:53.572177 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed7bac-4786-4f6e-b761-94f5b85c30d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:53.572451 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed7bac-4786-4f6e-b761-94f5b85c30d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:53.572721 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed7bac-4786-4f6e-b761-94f5b85c30d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:53.573353 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ed7bac-4786-4f6e-b761-94f5b85c30d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:53.575419 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ed7bac-4786-4f6e-b761-94f5b85c30d0 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:53.615408 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 985/1952] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:30:53 2022] POST /identity/v3/users => generated 303 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:30:53.616916 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc813a11-86db-4828-98ad-79b0dc8df146 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:53.633983 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc813a11-86db-4828-98ad-79b0dc8df146 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:53.644099 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a19d3de-ab58-4ac8-9519-498219264477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:53.644926 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19d3de-ab58-4ac8-9519-498219264477 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:53.647112 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19d3de-ab58-4ac8-9519-498219264477 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:53.647497 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19d3de-ab58-4ac8-9519-498219264477 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:53.648854 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a19d3de-ab58-4ac8-9519-498219264477 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:53.654652 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a19d3de-ab58-4ac8-9519-498219264477 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:53.671472 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 968/1953] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:30:53 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 01:30:53.675752 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ed7bac-4786-4f6e-b761-94f5b85c30d0 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:53.687369 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ed7bac-4786-4f6e-b761-94f5b85c30d0 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:53.693166 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbf49b6-493f-46a6-8b81-4c2860176707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:53.693554 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf49b6-493f-46a6-8b81-4c2860176707 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:53.693887 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf49b6-493f-46a6-8b81-4c2860176707 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:53.694600 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf49b6-493f-46a6-8b81-4c2860176707 admin admin] PATH_INFO: `/v3/projects/80c625fb5b7a4887bc073fe7f7b18ef7/users/1cb89099b5054f7ba626e451e58724c8/roles/fb48693810be495fb4b1893a79429b78` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:53.716762 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbf49b6-493f-46a6-8b81-4c2860176707 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80c625fb5b7a4887bc073fe7f7b18ef7, user_id=1cb89099b5054f7ba626e451e58724c8, role_id=fb48693810be495fb4b1893a79429b78)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:53.719056 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbf49b6-493f-46a6-8b81-4c2860176707 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:53.737444 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 986/1954] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:30:53 2022] PUT /identity/v3/projects/80c625fb5b7a4887bc073fe7f7b18ef7/users/1cb89099b5054f7ba626e451e58724c8/roles/fb48693810be495fb4b1893a79429b78 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 01:30:53.741032 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a19d3de-ab58-4ac8-9519-498219264477 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:53.754315 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a19d3de-ab58-4ac8-9519-498219264477 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:53.844384 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab1355-d7b5-4b7d-8136-c65790a0e2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:53.845033 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab1355-d7b5-4b7d-8136-c65790a0e2c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:53.845306 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab1355-d7b5-4b7d-8136-c65790a0e2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:53.845570 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab1355-d7b5-4b7d-8136-c65790a0e2c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:53.846246 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eab1355-d7b5-4b7d-8136-c65790a0e2c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:53.847945 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eab1355-d7b5-4b7d-8136-c65790a0e2c4 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:53.859381 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 969/1955] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:30:53 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:30:53.863352 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbf49b6-493f-46a6-8b81-4c2860176707 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:53.877083 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbf49b6-493f-46a6-8b81-4c2860176707 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:53.891916 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3003f8-2fed-470b-9dd0-3601521b57e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:53.893234 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3003f8-2fed-470b-9dd0-3601521b57e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:53.893667 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3003f8-2fed-470b-9dd0-3601521b57e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:53.894092 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3003f8-2fed-470b-9dd0-3601521b57e7 admin admin] PATH_INFO: `/v3/projects/80c625fb5b7a4887bc073fe7f7b18ef7/users/1cb89099b5054f7ba626e451e58724c8/roles/fb48693810be495fb4b1893a79429b78` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:53.896900 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3003f8-2fed-470b-9dd0-3601521b57e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80c625fb5b7a4887bc073fe7f7b18ef7, user_id=1cb89099b5054f7ba626e451e58724c8, role_id=fb48693810be495fb4b1893a79429b78)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:53.900996 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3003f8-2fed-470b-9dd0-3601521b57e7 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:53.925781 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 987/1956] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:30:53 2022] PUT /identity/v3/projects/80c625fb5b7a4887bc073fe7f7b18ef7/users/1cb89099b5054f7ba626e451e58724c8/roles/fb48693810be495fb4b1893a79429b78 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:30:53.929142 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de2476c-1e71-4d04-a46c-89f538acd6e7 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:53.929142 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de2476c-1e71-4d04-a46c-89f538acd6e7 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:53.929142 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de2476c-1e71-4d04-a46c-89f538acd6e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:53.977895 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-8de2476c-1e71-4d04-a46c-89f538acd6e7 None None] MFA Rules not processed for user `1cb89099b5054f7ba626e451e58724c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:53.979207 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-8de2476c-1e71-4d04-a46c-89f538acd6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:54.069037 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3003f8-2fed-470b-9dd0-3601521b57e7 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:54.080835 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 970/1957] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:30:53 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:54.100056 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de2476c-1e71-4d04-a46c-89f538acd6e7 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:54.232009 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3003f8-2fed-470b-9dd0-3601521b57e7 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:54.243906 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de2476c-1e71-4d04-a46c-89f538acd6e7 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:54.246558 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dca3a4f-78c2-404d-97c7-e9bbcca28bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:54.246942 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca3a4f-78c2-404d-97c7-e9bbcca28bd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:54.247220 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca3a4f-78c2-404d-97c7-e9bbcca28bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:54.247493 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca3a4f-78c2-404d-97c7-e9bbcca28bd5 admin admin] PATH_INFO: `/v3/users/0ab12d9941d84ac18d78832adcdb475b` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:54.249583 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dca3a4f-78c2-404d-97c7-e9bbcca28bd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ab12d9941d84ac18d78832adcdb475b)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:54.252582 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dca3a4f-78c2-404d-97c7-e9bbcca28bd5 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:54.256074 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e54a502-adc3-4384-a513-5644887b113f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7853d40c29af424c8d7913950d89750b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:54.256711 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e54a502-adc3-4384-a513-5644887b113f service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:54.256990 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e54a502-adc3-4384-a513-5644887b113f service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:54.257258 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e54a502-adc3-4384-a513-5644887b113f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:54.287743 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e54a502-adc3-4384-a513-5644887b113f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:54.291800 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e54a502-adc3-4384-a513-5644887b113f service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:54.343544 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 971/1958] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:30:54 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:30:54.345980 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e33a7cf-4020-4a98-9e3d-eaa35bad9910 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:54.348488 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e33a7cf-4020-4a98-9e3d-eaa35bad9910 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:54.349110 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e33a7cf-4020-4a98-9e3d-eaa35bad9910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:54.360118 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-2dca3a4f-78c2-404d-97c7-e9bbcca28bd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ab12d9941d84ac18d78832adcdb475b'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:54.376206 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-2dca3a4f-78c2-404d-97c7-e9bbcca28bd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ab12d9941d84ac18d78832adcdb475b'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:54.376907 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-2dca3a4f-78c2-404d-97c7-e9bbcca28bd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ab12d9941d84ac18d78832adcdb475b'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:54.400066 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-2dca3a4f-78c2-404d-97c7-e9bbcca28bd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ab12d9941d84ac18d78832adcdb475b'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:54.417543 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=85,keystone:INSERT=6,keystone:DELETE=9 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:54.448720 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:54.452806 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-7e33a7cf-4020-4a98-9e3d-eaa35bad9910 None None] MFA Rules not processed for user `b4d9cc1f930a467780a84aea77999aab`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:54.456564 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-7e33a7cf-4020-4a98-9e3d-eaa35bad9910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:54.477141 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-2dca3a4f-78c2-404d-97c7-e9bbcca28bd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ab12d9941d84ac18d78832adcdb475b'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:54.486560 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 988/1959] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:30:54 2022] DELETE /identity/v3/users/0ab12d9941d84ac18d78832adcdb475b => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 01:30:54.487619 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dca3a4f-78c2-404d-97c7-e9bbcca28bd5 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:54.490281 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-2dca3a4f-78c2-404d-97c7-e9bbcca28bd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:54.582994 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dca3a4f-78c2-404d-97c7-e9bbcca28bd5 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:54.588867 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2640dd0f-9c0e-4f43-ada3-0b2bf556f0ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7853d40c29af424c8d7913950d89750b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:54.592236 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640dd0f-9c0e-4f43-ada3-0b2bf556f0ef service cinder] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:54.592665 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640dd0f-9c0e-4f43-ada3-0b2bf556f0ef service cinder] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:54.593119 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640dd0f-9c0e-4f43-ada3-0b2bf556f0ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:54.612190 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-2640dd0f-9c0e-4f43-ada3-0b2bf556f0ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:54.612822 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 972/1960] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:30:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:54.617080 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275bccd-38d7-4a68-a2d9-1fe090775b70 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:54.617348 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275bccd-38d7-4a68-a2d9-1fe090775b70 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:54.617616 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275bccd-38d7-4a68-a2d9-1fe090775b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:54.712121 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-8275bccd-38d7-4a68-a2d9-1fe090775b70 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:54.713699 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-8275bccd-38d7-4a68-a2d9-1fe090775b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:54.788122 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2640dd0f-9c0e-4f43-ada3-0b2bf556f0ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:54.793554 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2640dd0f-9c0e-4f43-ada3-0b2bf556f0ef service cinder] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:54.809297 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 989/1961] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:30:54 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:30:54.810473 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2640dd0f-9c0e-4f43-ada3-0b2bf556f0ef service cinder] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:54.812060 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-2640dd0f-9c0e-4f43-ada3-0b2bf556f0ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:54.931206 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 973/1962] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:30:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:54.937746 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8275bccd-38d7-4a68-a2d9-1fe090775b70 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:54.939269 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-8275bccd-38d7-4a68-a2d9-1fe090775b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:55.050470 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2640dd0f-9c0e-4f43-ada3-0b2bf556f0ef service cinder] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:55.061191 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066aa19a-5471-4b4c-8357-71490fc8ab61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:55.062357 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066aa19a-5471-4b4c-8357-71490fc8ab61 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:55.064883 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066aa19a-5471-4b4c-8357-71490fc8ab61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:55.065906 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066aa19a-5471-4b4c-8357-71490fc8ab61 admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:55.068404 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066aa19a-5471-4b4c-8357-71490fc8ab61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:55.071010 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066aa19a-5471-4b4c-8357-71490fc8ab61 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:55.098084 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8275bccd-38d7-4a68-a2d9-1fe090775b70 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:55.118854 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d0dcfe-01eb-4bd6-a6fb-e8286b2f6845 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:55.119500 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d0dcfe-01eb-4bd6-a6fb-e8286b2f6845 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:55.119771 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d0dcfe-01eb-4bd6-a6fb-e8286b2f6845 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:55.120061 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d0dcfe-01eb-4bd6-a6fb-e8286b2f6845 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:55.134952 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 990/1963] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:30:54 2022] POST /identity/v3/projects => generated 373 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:30:55.165872 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066aa19a-5471-4b4c-8357-71490fc8ab61 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:55.178942 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d0dcfe-01eb-4bd6-a6fb-e8286b2f6845 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:55.180411 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d0dcfe-01eb-4bd6-a6fb-e8286b2f6845 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:55.214531 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 974/1964] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:30:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 01:30:55.221941 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:55.270879 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066aa19a-5471-4b4c-8357-71490fc8ab61 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:55.277705 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a070d558-efbd-4c9b-9483-ef14d60d99bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:55.278497 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a070d558-efbd-4c9b-9483-ef14d60d99bd admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:55.278786 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a070d558-efbd-4c9b-9483-ef14d60d99bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:55.279255 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a070d558-efbd-4c9b-9483-ef14d60d99bd admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:55.280588 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a070d558-efbd-4c9b-9483-ef14d60d99bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:55.283899 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a070d558-efbd-4c9b-9483-ef14d60d99bd admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:55.328481 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 991/1965] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:30:55 2022] POST /identity/v3/users => generated 293 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:30:55.329449 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d0dcfe-01eb-4bd6-a6fb-e8286b2f6845 service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:55.348886 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d0dcfe-01eb-4bd6-a6fb-e8286b2f6845 service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:55.388795 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9514717f-d7e8-4123-8319-1eb0c57aff22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:55.389422 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514717f-d7e8-4123-8319-1eb0c57aff22 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:55.389693 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514717f-d7e8-4123-8319-1eb0c57aff22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:55.389956 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514717f-d7e8-4123-8319-1eb0c57aff22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:55.390668 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9514717f-d7e8-4123-8319-1eb0c57aff22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:55.392446 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9514717f-d7e8-4123-8319-1eb0c57aff22 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:55.431689 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 975/1966] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 01:30:55.436192 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a070d558-efbd-4c9b-9483-ef14d60d99bd admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:55.450238 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a070d558-efbd-4c9b-9483-ef14d60d99bd admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:55.474957 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d115de5-3dcf-43e3-8c79-b2e12c630d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:55.475664 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d115de5-3dcf-43e3-8c79-b2e12c630d0d admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:55.476024 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d115de5-3dcf-43e3-8c79-b2e12c630d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:55.476323 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d115de5-3dcf-43e3-8c79-b2e12c630d0d admin admin] PATH_INFO: `/v3/projects/ea6ba8eac5034e0f9c8394bfe8267ce4/users/3c887579697742d49dc6a293b6d67c4e/roles/fb48693810be495fb4b1893a79429b78` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:55.507175 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d115de5-3dcf-43e3-8c79-b2e12c630d0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea6ba8eac5034e0f9c8394bfe8267ce4, user_id=3c887579697742d49dc6a293b6d67c4e, role_id=fb48693810be495fb4b1893a79429b78)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:55.510415 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d115de5-3dcf-43e3-8c79-b2e12c630d0d admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:55.536513 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 992/1967] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:30:55 2022] PUT /identity/v3/projects/ea6ba8eac5034e0f9c8394bfe8267ce4/users/3c887579697742d49dc6a293b6d67c4e/roles/fb48693810be495fb4b1893a79429b78 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 01:30:55.540347 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9514717f-d7e8-4123-8319-1eb0c57aff22 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:55.568435 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9514717f-d7e8-4123-8319-1eb0c57aff22 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:55.618771 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:55.651361 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af6ee2-0799-4637-96d4-e01ab41dc9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:55.652078 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af6ee2-0799-4637-96d4-e01ab41dc9f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:55.652405 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af6ee2-0799-4637-96d4-e01ab41dc9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:55.652683 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af6ee2-0799-4637-96d4-e01ab41dc9f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:55.653628 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3af6ee2-0799-4637-96d4-e01ab41dc9f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:55.654969 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3af6ee2-0799-4637-96d4-e01ab41dc9f9 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:55.666301 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 976/1968] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:30:55 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:30:55.670232 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d115de5-3dcf-43e3-8c79-b2e12c630d0d admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:55.682811 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d115de5-3dcf-43e3-8c79-b2e12c630d0d admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:55.710264 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c441e4-f693-4768-8a0a-5789579325ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:55.710961 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c441e4-f693-4768-8a0a-5789579325ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:55.711240 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c441e4-f693-4768-8a0a-5789579325ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:55.711539 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c441e4-f693-4768-8a0a-5789579325ac admin admin] PATH_INFO: `/v3/projects/ea6ba8eac5034e0f9c8394bfe8267ce4/users/3c887579697742d49dc6a293b6d67c4e/roles/fb48693810be495fb4b1893a79429b78` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:55.713560 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c441e4-f693-4768-8a0a-5789579325ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea6ba8eac5034e0f9c8394bfe8267ce4, user_id=3c887579697742d49dc6a293b6d67c4e, role_id=fb48693810be495fb4b1893a79429b78)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:55.716780 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c441e4-f693-4768-8a0a-5789579325ac admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:55.730084 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 993/1969] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:30:55 2022] PUT /identity/v3/projects/ea6ba8eac5034e0f9c8394bfe8267ce4/users/3c887579697742d49dc6a293b6d67c4e/roles/fb48693810be495fb4b1893a79429b78 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 01:30:55.767900 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af6ee2-0799-4637-96d4-e01ab41dc9f9 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:55.771125 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-e3af6ee2-0799-4637-96d4-e01ab41dc9f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:55.787668 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af6ee2-0799-4637-96d4-e01ab41dc9f9 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:55.881064 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c9f242-1e71-4de4-a4bf-bbc8378df842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:55.882645 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9f242-1e71-4de4-a4bf-bbc8378df842 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:55.882996 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9f242-1e71-4de4-a4bf-bbc8378df842 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:55.883862 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9f242-1e71-4de4-a4bf-bbc8378df842 admin admin] PATH_INFO: `/v3/projects/a205389826a54fd7bb931bd1d4eeb0bb` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:55.884463 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c9f242-1e71-4de4-a4bf-bbc8378df842 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a205389826a54fd7bb931bd1d4eeb0bb)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:55.886632 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c9f242-1e71-4de4-a4bf-bbc8378df842 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:55.957221 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-a9c9f242-1e71-4de4-a4bf-bbc8378df842 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a205389826a54fd7bb931bd1d4eeb0bb', 'request_id': 'req-a9c9f242-1e71-4de4-a4bf-bbc8378df842'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:55.972403 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-a9c9f242-1e71-4de4-a4bf-bbc8378df842 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a205389826a54fd7bb931bd1d4eeb0bb', 'request_id': 'req-a9c9f242-1e71-4de4-a4bf-bbc8378df842'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:55.981140 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-a9c9f242-1e71-4de4-a4bf-bbc8378df842 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a205389826a54fd7bb931bd1d4eeb0bb', 'request_id': 'req-a9c9f242-1e71-4de4-a4bf-bbc8378df842'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:55.994101 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-a9c9f242-1e71-4de4-a4bf-bbc8378df842 admin admin] The token cache is being invalidate because project a205389826a54fd7bb931bd1d4eeb0bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:30:55.994343 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-a9c9f242-1e71-4de4-a4bf-bbc8378df842 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:55.994854 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-a9c9f242-1e71-4de4-a4bf-bbc8378df842 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:55.996374 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 977/1970] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:30:55 2022] DELETE /identity/v3/projects/a205389826a54fd7bb931bd1d4eeb0bb => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:30:56.000932 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c441e4-f693-4768-8a0a-5789579325ac admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:56.003394 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-54c441e4-f693-4768-8a0a-5789579325ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:56.018472 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c441e4-f693-4768-8a0a-5789579325ac admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:56.095820 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549eeccc-5186-48d8-b397-008d06ecad3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:56.096534 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549eeccc-5186-48d8-b397-008d06ecad3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:56.096815 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549eeccc-5186-48d8-b397-008d06ecad3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:56.097088 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549eeccc-5186-48d8-b397-008d06ecad3f admin admin] PATH_INFO: `/v3/users/d459c10007e049cb825199ed0c8051cb` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:56.098314 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549eeccc-5186-48d8-b397-008d06ecad3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d459c10007e049cb825199ed0c8051cb)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:56.100242 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549eeccc-5186-48d8-b397-008d06ecad3f admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:56.154763 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-549eeccc-5186-48d8-b397-008d06ecad3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd459c10007e049cb825199ed0c8051cb'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:56.163707 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-549eeccc-5186-48d8-b397-008d06ecad3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd459c10007e049cb825199ed0c8051cb'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:56.164260 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-549eeccc-5186-48d8-b397-008d06ecad3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd459c10007e049cb825199ed0c8051cb'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:56.181892 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-549eeccc-5186-48d8-b397-008d06ecad3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd459c10007e049cb825199ed0c8051cb'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:56.202891 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-549eeccc-5186-48d8-b397-008d06ecad3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd459c10007e049cb825199ed0c8051cb'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:56.204701 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:56.227131 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 994/1971] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:30:55 2022] DELETE /identity/v3/users/d459c10007e049cb825199ed0c8051cb => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:30:56.727561 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c9f242-1e71-4de4-a4bf-bbc8378df842 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:56.752968 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c9f242-1e71-4de4-a4bf-bbc8378df842 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:56.861424 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab1a17-01fe-4b7f-a38a-858326b3fff7 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:56.861709 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab1a17-01fe-4b7f-a38a-858326b3fff7 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:56.862170 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab1a17-01fe-4b7f-a38a-858326b3fff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:56.901781 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da66dd3-2cfa-45dd-bc8c-da539bfa3ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:56.902153 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da66dd3-2cfa-45dd-bc8c-da539bfa3ad9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:56.902547 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da66dd3-2cfa-45dd-bc8c-da539bfa3ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:56.902915 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da66dd3-2cfa-45dd-bc8c-da539bfa3ad9 admin admin] PATH_INFO: `/v3/projects/68a2284a7b414beda2c27f1aac0e0162` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:56.904308 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da66dd3-2cfa-45dd-bc8c-da539bfa3ad9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68a2284a7b414beda2c27f1aac0e0162)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:56.904423 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-b4ab1a17-01fe-4b7f-a38a-858326b3fff7 None None] MFA Rules not processed for user `3c887579697742d49dc6a293b6d67c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:56.905769 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-b4ab1a17-01fe-4b7f-a38a-858326b3fff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:56.916753 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da66dd3-2cfa-45dd-bc8c-da539bfa3ad9 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:56.920207 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:57.016874 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-8da66dd3-2cfa-45dd-bc8c-da539bfa3ad9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68a2284a7b414beda2c27f1aac0e0162', 'request_id': 'req-8da66dd3-2cfa-45dd-bc8c-da539bfa3ad9'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:57.018184 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 995/1972] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:30:56 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 01:30:57.028632 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ccddfd-e6d0-4996-8e5d-414ad3d8fd73 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:57.028978 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ccddfd-e6d0-4996-8e5d-414ad3d8fd73 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:57.038228 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-8da66dd3-2cfa-45dd-bc8c-da539bfa3ad9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68a2284a7b414beda2c27f1aac0e0162', 'request_id': 'req-8da66dd3-2cfa-45dd-bc8c-da539bfa3ad9'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:57.044290 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ccddfd-e6d0-4996-8e5d-414ad3d8fd73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:57.065284 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-8da66dd3-2cfa-45dd-bc8c-da539bfa3ad9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68a2284a7b414beda2c27f1aac0e0162', 'request_id': 'req-8da66dd3-2cfa-45dd-bc8c-da539bfa3ad9'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:57.081524 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-8da66dd3-2cfa-45dd-bc8c-da539bfa3ad9 admin admin] The token cache is being invalidate because project 68a2284a7b414beda2c27f1aac0e0162 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:30:57.081737 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-8da66dd3-2cfa-45dd-bc8c-da539bfa3ad9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:57.083209 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-8da66dd3-2cfa-45dd-bc8c-da539bfa3ad9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:57.083976 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-e5ccddfd-e6d0-4996-8e5d-414ad3d8fd73 None None] MFA Rules not processed for user `b4d9cc1f930a467780a84aea77999aab`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:57.085614 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 978/1973] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:30:56 2022] DELETE /identity/v3/projects/68a2284a7b414beda2c27f1aac0e0162 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:30:57.089370 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-e5ccddfd-e6d0-4996-8e5d-414ad3d8fd73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:57.091063 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a1a7f-17d2-4d36-b35d-4c31df8491e0 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:57.091579 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a1a7f-17d2-4d36-b35d-4c31df8491e0 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:57.092844 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a1a7f-17d2-4d36-b35d-4c31df8491e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:57.118274 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-825a1a7f-17d2-4d36-b35d-4c31df8491e0 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:57.119942 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-825a1a7f-17d2-4d36-b35d-4c31df8491e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:57.174764 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 996/1974] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:30:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:57.186293 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ccddfd-e6d0-4996-8e5d-414ad3d8fd73 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:57.188439 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-e5ccddfd-e6d0-4996-8e5d-414ad3d8fd73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:57.206391 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 979/1975] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:30:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 01:30:57.214229 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55796a65-b560-4079-9b5f-dfc0a9e6b39a None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:57.215230 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55796a65-b560-4079-9b5f-dfc0a9e6b39a None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:57.215518 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55796a65-b560-4079-9b5f-dfc0a9e6b39a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:57.246468 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-55796a65-b560-4079-9b5f-dfc0a9e6b39a None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:57.248947 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-55796a65-b560-4079-9b5f-dfc0a9e6b39a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:57.269357 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 980/1976] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:30:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 01:30:57.274856 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55796a65-b560-4079-9b5f-dfc0a9e6b39a None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:57.289729 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55796a65-b560-4079-9b5f-dfc0a9e6b39a None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:57.295007 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e399d56-883f-4309-955c-5443d6d69e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:57.295690 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e399d56-883f-4309-955c-5443d6d69e45 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:57.296045 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e399d56-883f-4309-955c-5443d6d69e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:57.296376 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e399d56-883f-4309-955c-5443d6d69e45 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:57.297087 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e399d56-883f-4309-955c-5443d6d69e45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:30:57.297448 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e399d56-883f-4309-955c-5443d6d69e45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:57.300369 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e399d56-883f-4309-955c-5443d6d69e45 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:57.309477 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ccddfd-e6d0-4996-8e5d-414ad3d8fd73 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:57.317377 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58892c2e-6e0d-48d6-963c-02bd4f571395 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd5e95467b44175be2478c2c7c89926', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:57.318199 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 981/1977] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 01:30:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:30:57.318470 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58892c2e-6e0d-48d6-963c-02bd4f571395 service nova] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:57.319366 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58892c2e-6e0d-48d6-963c-02bd4f571395 service nova] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:57.319645 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58892c2e-6e0d-48d6-963c-02bd4f571395 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:57.321474 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-58892c2e-6e0d-48d6-963c-02bd4f571395 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:57.322806 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e399d56-883f-4309-955c-5443d6d69e45 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:57.355063 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e399d56-883f-4309-955c-5443d6d69e45 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:57.355220 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58892c2e-6e0d-48d6-963c-02bd4f571395 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:57.357444 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58892c2e-6e0d-48d6-963c-02bd4f571395 service nova] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:57.368071 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7115d3-500b-49d6-9e32-2b7c1f96bf9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:57.368701 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7115d3-500b-49d6-9e32-2b7c1f96bf9f admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:57.369520 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 997/1978] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:30:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:30:57.369637 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7115d3-500b-49d6-9e32-2b7c1f96bf9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:57.371823 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7115d3-500b-49d6-9e32-2b7c1f96bf9f admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:57.371823 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7115d3-500b-49d6-9e32-2b7c1f96bf9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:57.372466 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7115d3-500b-49d6-9e32-2b7c1f96bf9f admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:57.416615 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 982/1979] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:30:57 2022] POST /identity/v3/projects => generated 383 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 01:30:57.417809 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58892c2e-6e0d-48d6-963c-02bd4f571395 service nova] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:57.431648 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58892c2e-6e0d-48d6-963c-02bd4f571395 service nova] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:57.452786 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:57.539033 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d9c206-678e-4d7a-8d15-09d65d8d0d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:57.539820 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d9c206-678e-4d7a-8d15-09d65d8d0d6a admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:57.540167 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d9c206-678e-4d7a-8d15-09d65d8d0d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:57.540501 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d9c206-678e-4d7a-8d15-09d65d8d0d6a admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:57.541199 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d9c206-678e-4d7a-8d15-09d65d8d0d6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:57.545501 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d9c206-678e-4d7a-8d15-09d65d8d0d6a admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:57.585831 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 998/1980] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:30:57 2022] POST /identity/v3/users => generated 292 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:30:57.590104 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7115d3-500b-49d6-9e32-2b7c1f96bf9f admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:57.601665 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7115d3-500b-49d6-9e32-2b7c1f96bf9f admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:57.608972 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d369c3-fdad-4470-96e6-fe4f20c32ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:57.609613 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d369c3-fdad-4470-96e6-fe4f20c32ee7 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:57.609890 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d369c3-fdad-4470-96e6-fe4f20c32ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:57.610189 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d369c3-fdad-4470-96e6-fe4f20c32ee7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:57.610844 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d369c3-fdad-4470-96e6-fe4f20c32ee7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:57.613100 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d369c3-fdad-4470-96e6-fe4f20c32ee7 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:57.625927 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 983/1981] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:30:57 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 01:30:57.630137 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d9c206-678e-4d7a-8d15-09d65d8d0d6a admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:57.647218 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d9c206-678e-4d7a-8d15-09d65d8d0d6a admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:57.667782 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b374c41b-9d3c-46ca-88c5-8de70a4f0da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:57.668760 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374c41b-9d3c-46ca-88c5-8de70a4f0da4 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:57.669243 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374c41b-9d3c-46ca-88c5-8de70a4f0da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:57.669581 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374c41b-9d3c-46ca-88c5-8de70a4f0da4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:57.670284 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b374c41b-9d3c-46ca-88c5-8de70a4f0da4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:57.671882 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b374c41b-9d3c-46ca-88c5-8de70a4f0da4 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:57.689053 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d369c3-fdad-4470-96e6-fe4f20c32ee7 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:57.698333 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 999/1982] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:30:57 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:30:57.712750 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d369c3-fdad-4470-96e6-fe4f20c32ee7 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:57.719490 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb260f1f-54b4-41e2-a8b7-8dab6dc79ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:57.720501 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb260f1f-54b4-41e2-a8b7-8dab6dc79ac1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:57.720501 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb260f1f-54b4-41e2-a8b7-8dab6dc79ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:57.720801 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb260f1f-54b4-41e2-a8b7-8dab6dc79ac1 admin admin] PATH_INFO: `/v3/projects/eb516d977b40406d99567bd5d52d8eb4/users/a96d86cfcb1c40a097b3d0ff0a2294f8/roles/13af81971c1c428eae0a571a22ea583d` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:57.741170 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb260f1f-54b4-41e2-a8b7-8dab6dc79ac1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb516d977b40406d99567bd5d52d8eb4, user_id=a96d86cfcb1c40a097b3d0ff0a2294f8, role_id=13af81971c1c428eae0a571a22ea583d)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:57.744241 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb260f1f-54b4-41e2-a8b7-8dab6dc79ac1 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:57.766158 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 984/1983] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:30:57 2022] PUT /identity/v3/projects/eb516d977b40406d99567bd5d52d8eb4/users/a96d86cfcb1c40a097b3d0ff0a2294f8/roles/13af81971c1c428eae0a571a22ea583d => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:30:57.777971 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f2d8d-0279-478b-b448-75c4fb0c3e3d None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:57.778310 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f2d8d-0279-478b-b448-75c4fb0c3e3d None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:57.778584 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f2d8d-0279-478b-b448-75c4fb0c3e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:57.811065 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-de7f2d8d-0279-478b-b448-75c4fb0c3e3d None None] MFA Rules not processed for user `a96d86cfcb1c40a097b3d0ff0a2294f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:57.812368 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-de7f2d8d-0279-478b-b448-75c4fb0c3e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:57.904415 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1000/1984] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:30:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:57.915868 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb260f1f-54b4-41e2-a8b7-8dab6dc79ac1 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:57.917665 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-eb260f1f-54b4-41e2-a8b7-8dab6dc79ac1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:57.943006 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:58.018461 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb260f1f-54b4-41e2-a8b7-8dab6dc79ac1 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:58.024409 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a406b7cf-d4c4-47d9-aa6f-b9f5c1b6426f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7853d40c29af424c8d7913950d89750b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:58.024945 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a406b7cf-d4c4-47d9-aa6f-b9f5c1b6426f service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:58.025220 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a406b7cf-d4c4-47d9-aa6f-b9f5c1b6426f service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:58.025595 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a406b7cf-d4c4-47d9-aa6f-b9f5c1b6426f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:58.042327 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a406b7cf-d4c4-47d9-aa6f-b9f5c1b6426f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:58.043945 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a406b7cf-d4c4-47d9-aa6f-b9f5c1b6426f service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:58.054532 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 985/1985] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:30:57 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:30:58.075730 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7f2d8d-0279-478b-b448-75c4fb0c3e3d None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:58.159957 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7f2d8d-0279-478b-b448-75c4fb0c3e3d None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:58.166288 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94c3bcb-4961-47f2-a5c0-de985322c971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:58.167051 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c3bcb-4961-47f2-a5c0-de985322c971 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:58.167517 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c3bcb-4961-47f2-a5c0-de985322c971 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:58.167886 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c3bcb-4961-47f2-a5c0-de985322c971 admin admin] PATH_INFO: `/v3/users/a96d86cfcb1c40a097b3d0ff0a2294f8` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:58.169925 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94c3bcb-4961-47f2-a5c0-de985322c971 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a96d86cfcb1c40a097b3d0ff0a2294f8)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:58.172241 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94c3bcb-4961-47f2-a5c0-de985322c971 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:58.211844 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:58.251629 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-f94c3bcb-4961-47f2-a5c0-de985322c971 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a96d86cfcb1c40a097b3d0ff0a2294f8'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:58.260603 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-f94c3bcb-4961-47f2-a5c0-de985322c971 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a96d86cfcb1c40a097b3d0ff0a2294f8'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:58.261208 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-f94c3bcb-4961-47f2-a5c0-de985322c971 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a96d86cfcb1c40a097b3d0ff0a2294f8'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:58.268642 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-f94c3bcb-4961-47f2-a5c0-de985322c971 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a96d86cfcb1c40a097b3d0ff0a2294f8'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:58.282095 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-f94c3bcb-4961-47f2-a5c0-de985322c971 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a96d86cfcb1c40a097b3d0ff0a2294f8'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:58.288277 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1001/1986] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:30:58 2022] DELETE /identity/v3/users/a96d86cfcb1c40a097b3d0ff0a2294f8 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:30:58.293039 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42e93d-e085-45c4-bd26-46d89ed6ac68 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:58.293326 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42e93d-e085-45c4-bd26-46d89ed6ac68 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:58.293600 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42e93d-e085-45c4-bd26-46d89ed6ac68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:58.314638 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-9e42e93d-e085-45c4-bd26-46d89ed6ac68 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:58.316044 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-9e42e93d-e085-45c4-bd26-46d89ed6ac68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:58.385422 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 986/1987] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:30:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:58.401251 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94c3bcb-4961-47f2-a5c0-de985322c971 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:58.402237 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-f94c3bcb-4961-47f2-a5c0-de985322c971 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:58.466748 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94c3bcb-4961-47f2-a5c0-de985322c971 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:58.470349 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f562b5-82ac-41c0-9eed-59699369f119 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:58.470964 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f562b5-82ac-41c0-9eed-59699369f119 service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:58.471251 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f562b5-82ac-41c0-9eed-59699369f119 service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:58.471507 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f562b5-82ac-41c0-9eed-59699369f119 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:58.485428 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f562b5-82ac-41c0-9eed-59699369f119 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:58.487130 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f562b5-82ac-41c0-9eed-59699369f119 service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:58.498668 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1002/1988] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:30:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:30:58.812772 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e42e93d-e085-45c4-bd26-46d89ed6ac68 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:58.814266 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-9e42e93d-e085-45c4-bd26-46d89ed6ac68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:58.827489 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e42e93d-e085-45c4-bd26-46d89ed6ac68 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:58.837149 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63359691-84ff-45b0-a60c-b23d51f0c2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:58.837889 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63359691-84ff-45b0-a60c-b23d51f0c2b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:58.838175 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63359691-84ff-45b0-a60c-b23d51f0c2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:58.838513 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63359691-84ff-45b0-a60c-b23d51f0c2b6 admin admin] PATH_INFO: `/v3/projects/eb516d977b40406d99567bd5d52d8eb4` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:58.840132 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63359691-84ff-45b0-a60c-b23d51f0c2b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb516d977b40406d99567bd5d52d8eb4)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:58.842047 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63359691-84ff-45b0-a60c-b23d51f0c2b6 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:58.892944 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-63359691-84ff-45b0-a60c-b23d51f0c2b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb516d977b40406d99567bd5d52d8eb4', 'request_id': 'req-63359691-84ff-45b0-a60c-b23d51f0c2b6'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:58.903284 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-63359691-84ff-45b0-a60c-b23d51f0c2b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb516d977b40406d99567bd5d52d8eb4', 'request_id': 'req-63359691-84ff-45b0-a60c-b23d51f0c2b6'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:58.910577 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-63359691-84ff-45b0-a60c-b23d51f0c2b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb516d977b40406d99567bd5d52d8eb4', 'request_id': 'req-63359691-84ff-45b0-a60c-b23d51f0c2b6'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:58.922756 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-63359691-84ff-45b0-a60c-b23d51f0c2b6 admin admin] The token cache is being invalidate because project eb516d977b40406d99567bd5d52d8eb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:30:58.922881 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-63359691-84ff-45b0-a60c-b23d51f0c2b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:58.923501 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-63359691-84ff-45b0-a60c-b23d51f0c2b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:58.926315 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 987/1989] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:30:58 2022] DELETE /identity/v3/projects/eb516d977b40406d99567bd5d52d8eb4 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:30:58.931535 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a47e47-e80a-4139-be04-673cd80f7908 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:58.932129 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a47e47-e80a-4139-be04-673cd80f7908 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:58.932541 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a47e47-e80a-4139-be04-673cd80f7908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:58.957236 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-52a47e47-e80a-4139-be04-673cd80f7908 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:58.958622 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-52a47e47-e80a-4139-be04-673cd80f7908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:59.035755 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1003/1990] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:30:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 01:30:59.044461 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594ba09-5701-4037-9965-d1358aa1fe8d None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:59.044784 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594ba09-5701-4037-9965-d1358aa1fe8d None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:59.045065 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594ba09-5701-4037-9965-d1358aa1fe8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:59.076279 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-6594ba09-5701-4037-9965-d1358aa1fe8d None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:59.076279 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-6594ba09-5701-4037-9965-d1358aa1fe8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:59.083371 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 988/1991] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:30:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:59.087445 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a47e47-e80a-4139-be04-673cd80f7908 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:59.097706 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a47e47-e80a-4139-be04-673cd80f7908 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:59.102832 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964691bc-6847-4b2e-a6c6-72116f621bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:59.103493 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964691bc-6847-4b2e-a6c6-72116f621bb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:59.103707 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964691bc-6847-4b2e-a6c6-72116f621bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:59.103974 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964691bc-6847-4b2e-a6c6-72116f621bb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:59.104696 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964691bc-6847-4b2e-a6c6-72116f621bb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:30:59.104910 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964691bc-6847-4b2e-a6c6-72116f621bb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:59.106636 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964691bc-6847-4b2e-a6c6-72116f621bb9 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:59.118019 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6594ba09-5701-4037-9965-d1358aa1fe8d None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:59.119839 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-6594ba09-5701-4037-9965-d1358aa1fe8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:59.125190 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1004/1992] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 01:30:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:30:59.126858 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964691bc-6847-4b2e-a6c6-72116f621bb9 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:59.133048 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6594ba09-5701-4037-9965-d1358aa1fe8d None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:59.138236 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a2b269-58d9-4066-bc57-fcd196af8c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:59.138942 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a2b269-58d9-4066-bc57-fcd196af8c5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:59.139351 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a2b269-58d9-4066-bc57-fcd196af8c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:59.139635 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a2b269-58d9-4066-bc57-fcd196af8c5b admin admin] PATH_INFO: `/v3/users/197d995a8bb94f728287b6c3415f200f` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:59.140919 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a2b269-58d9-4066-bc57-fcd196af8c5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=197d995a8bb94f728287b6c3415f200f)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:59.142388 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964691bc-6847-4b2e-a6c6-72116f621bb9 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:59.142895 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a2b269-58d9-4066-bc57-fcd196af8c5b admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:59.148410 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348bec48-728d-49b0-8a82-f151210c5d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:59.149857 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348bec48-728d-49b0-8a82-f151210c5d16 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:59.150339 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348bec48-728d-49b0-8a82-f151210c5d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:59.150744 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348bec48-728d-49b0-8a82-f151210c5d16 admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:59.151386 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348bec48-728d-49b0-8a82-f151210c5d16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:59.154240 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348bec48-728d-49b0-8a82-f151210c5d16 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:59.186567 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:59.190179 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1005/1993] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:30:59 2022] POST /identity/v3/projects => generated 375 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:30:59.194325 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348bec48-728d-49b0-8a82-f151210c5d16 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:59.205628 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b1a2b269-58d9-4066-bc57-fcd196af8c5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '197d995a8bb94f728287b6c3415f200f'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:59.206760 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:59.216132 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b1a2b269-58d9-4066-bc57-fcd196af8c5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '197d995a8bb94f728287b6c3415f200f'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:59.216898 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b1a2b269-58d9-4066-bc57-fcd196af8c5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '197d995a8bb94f728287b6c3415f200f'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:59.225546 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b1a2b269-58d9-4066-bc57-fcd196af8c5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '197d995a8bb94f728287b6c3415f200f'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:59.240650 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b1a2b269-58d9-4066-bc57-fcd196af8c5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '197d995a8bb94f728287b6c3415f200f'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:30:59.248668 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 989/1994] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:30:59 2022] DELETE /identity/v3/users/197d995a8bb94f728287b6c3415f200f => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 01:30:59.271739 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a85d7-3215-446a-ba89-64ff405bb808 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:59.272209 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a85d7-3215-446a-ba89-64ff405bb808 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:59.272570 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a85d7-3215-446a-ba89-64ff405bb808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:59.296067 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-3c7a85d7-3215-446a-ba89-64ff405bb808 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:59.298777 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-3c7a85d7-3215-446a-ba89-64ff405bb808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:59.303739 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348bec48-728d-49b0-8a82-f151210c5d16 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:59.374161 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 990/1995] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:30:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:59.382145 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7a85d7-3215-446a-ba89-64ff405bb808 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:59.383778 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-3c7a85d7-3215-446a-ba89-64ff405bb808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:59.384839 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fc34d7-551e-45fb-87e0-c6a873abc40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:59.385548 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc34d7-551e-45fb-87e0-c6a873abc40e admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:59.385884 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc34d7-551e-45fb-87e0-c6a873abc40e admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:59.386245 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc34d7-551e-45fb-87e0-c6a873abc40e admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:59.386989 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fc34d7-551e-45fb-87e0-c6a873abc40e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:59.389028 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fc34d7-551e-45fb-87e0-c6a873abc40e admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:59.414392 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1006/1996] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:30:59 2022] POST /identity/v3/users => generated 288 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:30:59.415573 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fc34d7-551e-45fb-87e0-c6a873abc40e admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:59.419847 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-93fc34d7-551e-45fb-87e0-c6a873abc40e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:59.445814 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fc34d7-551e-45fb-87e0-c6a873abc40e admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:59.453167 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b5d386-1cbd-42f6-b0b4-a563df56be8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:59.453801 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b5d386-1cbd-42f6-b0b4-a563df56be8f admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:59.455101 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b5d386-1cbd-42f6-b0b4-a563df56be8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:59.455101 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b5d386-1cbd-42f6-b0b4-a563df56be8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:59.455101 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b5d386-1cbd-42f6-b0b4-a563df56be8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:59.456969 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b5d386-1cbd-42f6-b0b4-a563df56be8f admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:59.468616 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1007/1997] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:30:59 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:30:59.473240 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b5d386-1cbd-42f6-b0b4-a563df56be8f admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:59.496717 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b5d386-1cbd-42f6-b0b4-a563df56be8f admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:59.503026 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79818e07-8ac3-49ff-943c-1e8326e344b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:59.503264 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79818e07-8ac3-49ff-943c-1e8326e344b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:59.503535 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79818e07-8ac3-49ff-943c-1e8326e344b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:59.504155 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79818e07-8ac3-49ff-943c-1e8326e344b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:59.504678 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79818e07-8ac3-49ff-943c-1e8326e344b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:59.506575 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79818e07-8ac3-49ff-943c-1e8326e344b2 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:59.509285 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7a85d7-3215-446a-ba89-64ff405bb808 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:59.517393 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56860a6a-76d1-4479-853b-c99e253905b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:59.518183 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56860a6a-76d1-4479-853b-c99e253905b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:59.518557 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56860a6a-76d1-4479-853b-c99e253905b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:59.518989 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56860a6a-76d1-4479-853b-c99e253905b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:59.521471 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1008/1998] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:30:59 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:30:59.525769 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79818e07-8ac3-49ff-943c-1e8326e344b2 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:59.530452 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56860a6a-76d1-4479-853b-c99e253905b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:59.532133 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56860a6a-76d1-4479-853b-c99e253905b9 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:59.549594 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79818e07-8ac3-49ff-943c-1e8326e344b2 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:59.557716 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6061ab27-5254-42bf-a946-ac9afd77e154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:59.558479 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6061ab27-5254-42bf-a946-ac9afd77e154 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:59.558755 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6061ab27-5254-42bf-a946-ac9afd77e154 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:59.559051 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6061ab27-5254-42bf-a946-ac9afd77e154 admin admin] PATH_INFO: `/v3/projects/2a645c296ba34ce58344ac931c2a258d/users/1cdbf237296147b489d1f741ea92d4c7/roles/13af81971c1c428eae0a571a22ea583d` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:59.564572 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 991/1999] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:30:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 01:30:59.577298 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6061ab27-5254-42bf-a946-ac9afd77e154 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a645c296ba34ce58344ac931c2a258d, user_id=1cdbf237296147b489d1f741ea92d4c7, role_id=13af81971c1c428eae0a571a22ea583d)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:59.580971 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6061ab27-5254-42bf-a946-ac9afd77e154 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:59.609199 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1009/2000] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:30:59 2022] PUT /identity/v3/projects/2a645c296ba34ce58344ac931c2a258d/users/1cdbf237296147b489d1f741ea92d4c7/roles/13af81971c1c428eae0a571a22ea583d => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 01:30:59.611571 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f3878-0ee3-4705-8a40-c98bc339431b None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:59.611988 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f3878-0ee3-4705-8a40-c98bc339431b None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:59.612364 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f3878-0ee3-4705-8a40-c98bc339431b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:59.652698 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-477f3878-0ee3-4705-8a40-c98bc339431b None None] MFA Rules not processed for user `1cdbf237296147b489d1f741ea92d4c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:30:59.654183 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-477f3878-0ee3-4705-8a40-c98bc339431b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:59.704240 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:59.746009 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 992/2001] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:30:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:30:59.746432 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6061ab27-5254-42bf-a946-ac9afd77e154 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:59.841808 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6061ab27-5254-42bf-a946-ac9afd77e154 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:59.850044 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c101ac52-8abe-4805-ae2e-63e3a88e197d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:59.850802 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101ac52-8abe-4805-ae2e-63e3a88e197d admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:59.851095 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101ac52-8abe-4805-ae2e-63e3a88e197d admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:59.851341 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101ac52-8abe-4805-ae2e-63e3a88e197d admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:30:59.851981 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c101ac52-8abe-4805-ae2e-63e3a88e197d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:30:59.854092 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c101ac52-8abe-4805-ae2e-63e3a88e197d admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:30:59.859257 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:30:59.889819 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1010/2002] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:30:59 2022] POST /identity/v3/projects => generated 375 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:30:59.891182 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477f3878-0ee3-4705-8a40-c98bc339431b None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:59.902529 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477f3878-0ee3-4705-8a40-c98bc339431b None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:30:59.946169 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c101ac52-8abe-4805-ae2e-63e3a88e197d admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:30:59.947841 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-c101ac52-8abe-4805-ae2e-63e3a88e197d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:30:59.998019 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e43485-4bc7-4c34-a2bc-b9b452eb9e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:30:59.999004 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e43485-4bc7-4c34-a2bc-b9b452eb9e16 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:30:59.999376 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e43485-4bc7-4c34-a2bc-b9b452eb9e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:30:59.999736 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e43485-4bc7-4c34-a2bc-b9b452eb9e16 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:00.000463 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e43485-4bc7-4c34-a2bc-b9b452eb9e16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:00.002917 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e43485-4bc7-4c34-a2bc-b9b452eb9e16 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:00.044799 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 993/2003] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:30:59 2022] POST /identity/v3/users => generated 288 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:31:00.049104 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e43485-4bc7-4c34-a2bc-b9b452eb9e16 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:00.064978 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c101ac52-8abe-4805-ae2e-63e3a88e197d admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:00.069184 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e43485-4bc7-4c34-a2bc-b9b452eb9e16 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:00.071786 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f86fd0e-f342-4fca-bf0e-e91895f36b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:00.072112 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f86fd0e-f342-4fca-bf0e-e91895f36b88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:00.072391 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f86fd0e-f342-4fca-bf0e-e91895f36b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:00.072663 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f86fd0e-f342-4fca-bf0e-e91895f36b88 admin admin] PATH_INFO: `/v3/projects/868f8747ff7f4a6ebd7bd9aa97080b23` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:00.073888 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f86fd0e-f342-4fca-bf0e-e91895f36b88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=868f8747ff7f4a6ebd7bd9aa97080b23)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:00.075926 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f86fd0e-f342-4fca-bf0e-e91895f36b88 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:00.079597 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2eb2d1-21a1-4f2b-9d52-ad84405dcd75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:00.080494 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2eb2d1-21a1-4f2b-9d52-ad84405dcd75 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:00.081049 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2eb2d1-21a1-4f2b-9d52-ad84405dcd75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:00.081523 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2eb2d1-21a1-4f2b-9d52-ad84405dcd75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:00.083364 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2eb2d1-21a1-4f2b-9d52-ad84405dcd75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:00.087716 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2eb2d1-21a1-4f2b-9d52-ad84405dcd75 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:00.106415 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 994/2004] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:31:00 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 01:31:00.108955 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2eb2d1-21a1-4f2b-9d52-ad84405dcd75 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:00.122650 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2eb2d1-21a1-4f2b-9d52-ad84405dcd75 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:00.139020 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8059d5-7851-414b-bf1d-637efe3e8f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:00.139818 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8059d5-7851-414b-bf1d-637efe3e8f49 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:00.140096 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8059d5-7851-414b-bf1d-637efe3e8f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:00.140683 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8059d5-7851-414b-bf1d-637efe3e8f49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:00.142337 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8059d5-7851-414b-bf1d-637efe3e8f49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:00.147352 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8059d5-7851-414b-bf1d-637efe3e8f49 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:00.159618 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-7f86fd0e-f342-4fca-bf0e-e91895f36b88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '868f8747ff7f4a6ebd7bd9aa97080b23', 'request_id': 'req-7f86fd0e-f342-4fca-bf0e-e91895f36b88'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:00.168883 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-7f86fd0e-f342-4fca-bf0e-e91895f36b88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '868f8747ff7f4a6ebd7bd9aa97080b23', 'request_id': 'req-7f86fd0e-f342-4fca-bf0e-e91895f36b88'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:00.177747 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-7f86fd0e-f342-4fca-bf0e-e91895f36b88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '868f8747ff7f4a6ebd7bd9aa97080b23', 'request_id': 'req-7f86fd0e-f342-4fca-bf0e-e91895f36b88'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:00.181009 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 995/2005] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:31:00 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:31:00.182591 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8059d5-7851-414b-bf1d-637efe3e8f49 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:00.204591 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-7f86fd0e-f342-4fca-bf0e-e91895f36b88 admin admin] The token cache is being invalidate because project 868f8747ff7f4a6ebd7bd9aa97080b23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:31:00.204900 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-7f86fd0e-f342-4fca-bf0e-e91895f36b88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:00.208076 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-7f86fd0e-f342-4fca-bf0e-e91895f36b88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:00.209891 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8059d5-7851-414b-bf1d-637efe3e8f49 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:00.211654 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1011/2006] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:30:59 2022] DELETE /identity/v3/projects/868f8747ff7f4a6ebd7bd9aa97080b23 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:31:00.217083 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f86fd0e-f342-4fca-bf0e-e91895f36b88 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:00.219598 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-7f86fd0e-f342-4fca-bf0e-e91895f36b88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:00.329041 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95920c6-c79e-4378-912f-a9513677816a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:00.329838 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95920c6-c79e-4378-912f-a9513677816a admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:00.330138 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95920c6-c79e-4378-912f-a9513677816a admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:00.330414 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95920c6-c79e-4378-912f-a9513677816a admin admin] PATH_INFO: `/v3/projects/27180f8f2bc8404f9db1b51d9384c4f1/users/a5b9e6a5ab784777a6a7f2aaaa502b28/roles/13af81971c1c428eae0a571a22ea583d` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:00.331456 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f86fd0e-f342-4fca-bf0e-e91895f36b88 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:00.336820 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b2c7a-d82a-4502-937f-dde7afd10bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:00.337467 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b2c7a-d82a-4502-937f-dde7afd10bb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:00.337745 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b2c7a-d82a-4502-937f-dde7afd10bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:00.338019 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b2c7a-d82a-4502-937f-dde7afd10bb5 admin admin] PATH_INFO: `/v3/users/1cb89099b5054f7ba626e451e58724c8` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:00.339190 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8b2c7a-d82a-4502-937f-dde7afd10bb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cb89099b5054f7ba626e451e58724c8)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:00.341507 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8b2c7a-d82a-4502-937f-dde7afd10bb5 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:00.346749 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95920c6-c79e-4378-912f-a9513677816a admin admin] RBAC: Authorizing `identity:create_grant(project_id=27180f8f2bc8404f9db1b51d9384c4f1, user_id=a5b9e6a5ab784777a6a7f2aaaa502b28, role_id=13af81971c1c428eae0a571a22ea583d)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:00.349673 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95920c6-c79e-4378-912f-a9513677816a admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:00.358204 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:00.382634 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 996/2007] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:31:00 2022] PUT /identity/v3/projects/27180f8f2bc8404f9db1b51d9384c4f1/users/a5b9e6a5ab784777a6a7f2aaaa502b28/roles/13af81971c1c428eae0a571a22ea583d => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 01:31:00.393628 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e5a26-6e28-4849-a106-d2833105caa2 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:00.394820 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e5a26-6e28-4849-a106-d2833105caa2 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:00.394820 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e5a26-6e28-4849-a106-d2833105caa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:00.427482 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-5a6e5a26-6e28-4849-a106-d2833105caa2 None None] MFA Rules not processed for user `a5b9e6a5ab784777a6a7f2aaaa502b28`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:31:00.428853 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-5a6e5a26-6e28-4849-a106-d2833105caa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:00.430610 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-3f8b2c7a-d82a-4502-937f-dde7afd10bb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cb89099b5054f7ba626e451e58724c8'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:00.444054 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-3f8b2c7a-d82a-4502-937f-dde7afd10bb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cb89099b5054f7ba626e451e58724c8'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:00.444054 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-3f8b2c7a-d82a-4502-937f-dde7afd10bb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cb89099b5054f7ba626e451e58724c8'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:00.456151 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:00.457820 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-3f8b2c7a-d82a-4502-937f-dde7afd10bb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cb89099b5054f7ba626e451e58724c8'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:00.473313 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-3f8b2c7a-d82a-4502-937f-dde7afd10bb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cb89099b5054f7ba626e451e58724c8'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:00.482224 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1012/2008] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:31:00 2022] DELETE /identity/v3/users/1cb89099b5054f7ba626e451e58724c8 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:31:00.544301 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 997/2009] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:31:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 01:31:00.553091 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b2c7a-d82a-4502-937f-dde7afd10bb5 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:00.554849 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-3f8b2c7a-d82a-4502-937f-dde7afd10bb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:00.642787 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b2c7a-d82a-4502-937f-dde7afd10bb5 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:00.657178 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb89dc6-187d-4caa-b829-39ec5ecaf107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:00.658873 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb89dc6-187d-4caa-b829-39ec5ecaf107 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:00.659956 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb89dc6-187d-4caa-b829-39ec5ecaf107 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:00.660380 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb89dc6-187d-4caa-b829-39ec5ecaf107 admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:00.661648 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb89dc6-187d-4caa-b829-39ec5ecaf107 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:00.667758 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb89dc6-187d-4caa-b829-39ec5ecaf107 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:00.710930 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1013/2010] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:31:00 2022] POST /identity/v3/projects => generated 377 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:31:00.715695 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6e5a26-6e28-4849-a106-d2833105caa2 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:00.832615 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6e5a26-6e28-4849-a106-d2833105caa2 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:00.955188 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daee9b1-fea2-44d4-b554-b48da40e19a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:00.955906 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daee9b1-fea2-44d4-b554-b48da40e19a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:00.956184 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daee9b1-fea2-44d4-b554-b48da40e19a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:00.956450 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daee9b1-fea2-44d4-b554-b48da40e19a3 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:00.957245 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daee9b1-fea2-44d4-b554-b48da40e19a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:00.960815 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daee9b1-fea2-44d4-b554-b48da40e19a3 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:01.006235 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 998/2011] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:31:00 2022] POST /identity/v3/users => generated 295 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:31:01.013044 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb89dc6-187d-4caa-b829-39ec5ecaf107 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:01.021228 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daee9b1-fea2-44d4-b554-b48da40e19a3 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:01.023244 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2daee9b1-fea2-44d4-b554-b48da40e19a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:01.028760 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb89dc6-187d-4caa-b829-39ec5ecaf107 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:01.048825 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daee9b1-fea2-44d4-b554-b48da40e19a3 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:01.052903 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1fe817-a69d-4b61-bf77-cf1a68f47170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:01.056127 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1fe817-a69d-4b61-bf77-cf1a68f47170 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:01.057532 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1fe817-a69d-4b61-bf77-cf1a68f47170 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:01.057823 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1fe817-a69d-4b61-bf77-cf1a68f47170 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:01.058532 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1fe817-a69d-4b61-bf77-cf1a68f47170 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:01.061319 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f0a325-c3c1-4590-b84a-6a6ef2c03b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:01.062092 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f0a325-c3c1-4590-b84a-6a6ef2c03b62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:01.062503 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f0a325-c3c1-4590-b84a-6a6ef2c03b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:01.062868 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f0a325-c3c1-4590-b84a-6a6ef2c03b62 admin admin] PATH_INFO: `/v3/projects/80c625fb5b7a4887bc073fe7f7b18ef7` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:01.063422 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1fe817-a69d-4b61-bf77-cf1a68f47170 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:01.064626 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f0a325-c3c1-4590-b84a-6a6ef2c03b62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80c625fb5b7a4887bc073fe7f7b18ef7)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:01.067130 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f0a325-c3c1-4590-b84a-6a6ef2c03b62 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:01.109206 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1014/2012] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:31:01 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:31:01.111631 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1fe817-a69d-4b61-bf77-cf1a68f47170 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:01.140658 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1fe817-a69d-4b61-bf77-cf1a68f47170 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:01.171736 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-24f0a325-c3c1-4590-b84a-6a6ef2c03b62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80c625fb5b7a4887bc073fe7f7b18ef7', 'request_id': 'req-24f0a325-c3c1-4590-b84a-6a6ef2c03b62'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:01.175566 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:01.185370 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-24f0a325-c3c1-4590-b84a-6a6ef2c03b62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80c625fb5b7a4887bc073fe7f7b18ef7', 'request_id': 'req-24f0a325-c3c1-4590-b84a-6a6ef2c03b62'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:01.195947 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-24f0a325-c3c1-4590-b84a-6a6ef2c03b62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80c625fb5b7a4887bc073fe7f7b18ef7', 'request_id': 'req-24f0a325-c3c1-4590-b84a-6a6ef2c03b62'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:01.213999 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-24f0a325-c3c1-4590-b84a-6a6ef2c03b62 admin admin] The token cache is being invalidate because project 80c625fb5b7a4887bc073fe7f7b18ef7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:31:01.215623 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-24f0a325-c3c1-4590-b84a-6a6ef2c03b62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:01.216771 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-24f0a325-c3c1-4590-b84a-6a6ef2c03b62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:01.218703 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 999/2013] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:31:01 2022] DELETE /identity/v3/projects/80c625fb5b7a4887bc073fe7f7b18ef7 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 01:31:01.225418 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5678bbe9-8109-49a8-a12c-3d884ddd8cfb None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:01.226406 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5678bbe9-8109-49a8-a12c-3d884ddd8cfb None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:01.227096 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5678bbe9-8109-49a8-a12c-3d884ddd8cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:01.238010 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00bc599-2ee0-4bbb-82c4-eec1fb890c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:01.238854 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00bc599-2ee0-4bbb-82c4-eec1fb890c03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:01.239195 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00bc599-2ee0-4bbb-82c4-eec1fb890c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:01.239496 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00bc599-2ee0-4bbb-82c4-eec1fb890c03 admin admin] PATH_INFO: `/v3/projects/08998688cc264987baf12eb82388bb09/users/750d4b4d09b4478ab4d9af904161a973/roles/fb48693810be495fb4b1893a79429b78` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:01.260072 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-5678bbe9-8109-49a8-a12c-3d884ddd8cfb None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:31:01.261283 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-5678bbe9-8109-49a8-a12c-3d884ddd8cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:01.267334 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:01.276609 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00bc599-2ee0-4bbb-82c4-eec1fb890c03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08998688cc264987baf12eb82388bb09, user_id=750d4b4d09b4478ab4d9af904161a973, role_id=fb48693810be495fb4b1893a79429b78)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:01.280440 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00bc599-2ee0-4bbb-82c4-eec1fb890c03 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:01.289513 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1000/2014] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:31:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:31:01.292564 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a07c740-734a-4951-bdaa-4475a77a64c2 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:01.292846 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a07c740-734a-4951-bdaa-4475a77a64c2 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:01.293782 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a07c740-734a-4951-bdaa-4475a77a64c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:01.318007 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1015/2015] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:31:01 2022] PUT /identity/v3/projects/08998688cc264987baf12eb82388bb09/users/750d4b4d09b4478ab4d9af904161a973/roles/fb48693810be495fb4b1893a79429b78 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:31:01.325249 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00bc599-2ee0-4bbb-82c4-eec1fb890c03 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:01.329992 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-8a07c740-734a-4951-bdaa-4475a77a64c2 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:31:01.330795 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-c00bc599-2ee0-4bbb-82c4-eec1fb890c03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:01.331414 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-8a07c740-734a-4951-bdaa-4475a77a64c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:01.408542 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1001/2016] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:31:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:31:01.412710 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a07c740-734a-4951-bdaa-4475a77a64c2 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:01.423092 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a07c740-734a-4951-bdaa-4475a77a64c2 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:01.423316 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00bc599-2ee0-4bbb-82c4-eec1fb890c03 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:01.428505 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b75393-cb24-46f0-be1d-93a2fb43df6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:01.428885 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b57c04-4554-4bce-926e-7d83a2192cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:01.429148 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b75393-cb24-46f0-be1d-93a2fb43df6f admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:01.429438 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b75393-cb24-46f0-be1d-93a2fb43df6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:01.429539 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b57c04-4554-4bce-926e-7d83a2192cfe admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:01.429757 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b57c04-4554-4bce-926e-7d83a2192cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:01.429867 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b75393-cb24-46f0-be1d-93a2fb43df6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:01.430015 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b57c04-4554-4bce-926e-7d83a2192cfe admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:01.430528 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b75393-cb24-46f0-be1d-93a2fb43df6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:01.430692 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b57c04-4554-4bce-926e-7d83a2192cfe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:31:01.430980 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b57c04-4554-4bce-926e-7d83a2192cfe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:01.432158 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b75393-cb24-46f0-be1d-93a2fb43df6f admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:01.432548 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b57c04-4554-4bce-926e-7d83a2192cfe admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:01.448982 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1016/2017] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:31:01 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:31:01.450277 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b75393-cb24-46f0-be1d-93a2fb43df6f admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:01.454298 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1002/2018] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 01:31:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:31:01.459146 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b57c04-4554-4bce-926e-7d83a2192cfe admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:01.469779 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b75393-cb24-46f0-be1d-93a2fb43df6f admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:01.472844 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b57c04-4554-4bce-926e-7d83a2192cfe admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:01.475748 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c672a170-bddb-497f-ad3e-0d026fd4fa8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:01.476982 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672a170-bddb-497f-ad3e-0d026fd4fa8c admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:01.477259 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672a170-bddb-497f-ad3e-0d026fd4fa8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:01.477536 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672a170-bddb-497f-ad3e-0d026fd4fa8c admin admin] PATH_INFO: `/v3/projects/08998688cc264987baf12eb82388bb09/users/750d4b4d09b4478ab4d9af904161a973/roles/fb48693810be495fb4b1893a79429b78` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:01.479529 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c672a170-bddb-497f-ad3e-0d026fd4fa8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=08998688cc264987baf12eb82388bb09, user_id=750d4b4d09b4478ab4d9af904161a973, role_id=fb48693810be495fb4b1893a79429b78)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:01.482419 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c672a170-bddb-497f-ad3e-0d026fd4fa8c admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:01.485099 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4726c214-e791-4201-b676-6f43d91888a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:01.485099 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726c214-e791-4201-b676-6f43d91888a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:01.490463 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726c214-e791-4201-b676-6f43d91888a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:01.491171 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726c214-e791-4201-b676-6f43d91888a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:01.493547 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4726c214-e791-4201-b676-6f43d91888a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:01.495842 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4726c214-e791-4201-b676-6f43d91888a6 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:01.504967 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1017/2019] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:31:01 2022] PUT /identity/v3/projects/08998688cc264987baf12eb82388bb09/users/750d4b4d09b4478ab4d9af904161a973/roles/fb48693810be495fb4b1893a79429b78 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:31:01.514997 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42bd61e-12b2-4d52-b5fc-e868c1d75cd9 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:01.515313 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42bd61e-12b2-4d52-b5fc-e868c1d75cd9 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:01.515542 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42bd61e-12b2-4d52-b5fc-e868c1d75cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:01.549246 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1003/2020] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:31:01 2022] POST /identity/v3/projects => generated 383 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:31:01.553790 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4726c214-e791-4201-b676-6f43d91888a6 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:01.555874 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-d42bd61e-12b2-4d52-b5fc-e868c1d75cd9 None None] MFA Rules not processed for user `750d4b4d09b4478ab4d9af904161a973`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:31:01.557163 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-d42bd61e-12b2-4d52-b5fc-e868c1d75cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:01.644661 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4726c214-e791-4201-b676-6f43d91888a6 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:01.666529 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e5e945-4242-4863-8ee0-3cf6aae1d79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:01.667715 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5e945-4242-4863-8ee0-3cf6aae1d79e admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:01.667715 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5e945-4242-4863-8ee0-3cf6aae1d79e admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:01.670460 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5e945-4242-4863-8ee0-3cf6aae1d79e admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:01.671141 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e5e945-4242-4863-8ee0-3cf6aae1d79e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:01.675357 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e5e945-4242-4863-8ee0-3cf6aae1d79e admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:01.704013 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1018/2021] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:31:01 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:31:01.719270 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42bd61e-12b2-4d52-b5fc-e868c1d75cd9 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:01.720700 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-d42bd61e-12b2-4d52-b5fc-e868c1d75cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:01.758549 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1004/2022] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:31:01 2022] POST /identity/v3/users => generated 292 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 01:31:01.762797 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e5e945-4242-4863-8ee0-3cf6aae1d79e admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:01.777621 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e5e945-4242-4863-8ee0-3cf6aae1d79e admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:01.783495 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3a0fd1-c413-45ec-b031-6f74356dd352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:01.785326 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a0fd1-c413-45ec-b031-6f74356dd352 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:01.785649 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a0fd1-c413-45ec-b031-6f74356dd352 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:01.785921 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a0fd1-c413-45ec-b031-6f74356dd352 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:01.786608 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3a0fd1-c413-45ec-b031-6f74356dd352 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:01.788530 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3a0fd1-c413-45ec-b031-6f74356dd352 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:01.802916 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1005/2023] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:31:01 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 01:31:01.803580 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42bd61e-12b2-4d52-b5fc-e868c1d75cd9 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:01.807621 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3a0fd1-c413-45ec-b031-6f74356dd352 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:01.808963 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a528cc05-cea2-4a60-b454-c5291329726e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7853d40c29af424c8d7913950d89750b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:01.809535 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528cc05-cea2-4a60-b454-c5291329726e service cinder] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:01.809923 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528cc05-cea2-4a60-b454-c5291329726e service cinder] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:01.810261 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528cc05-cea2-4a60-b454-c5291329726e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:01.812419 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-a528cc05-cea2-4a60-b454-c5291329726e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:01.820960 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3a0fd1-c413-45ec-b031-6f74356dd352 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:01.829081 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:01.833686 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add216f1-d3ae-459d-ba77-10fe9a0ed5d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:01.834349 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add216f1-d3ae-459d-ba77-10fe9a0ed5d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:01.834625 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add216f1-d3ae-459d-ba77-10fe9a0ed5d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:01.834892 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add216f1-d3ae-459d-ba77-10fe9a0ed5d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:01.836188 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add216f1-d3ae-459d-ba77-10fe9a0ed5d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:01.838316 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add216f1-d3ae-459d-ba77-10fe9a0ed5d8 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:01.854287 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1006/2024] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:31:01 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:31:01.858641 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add216f1-d3ae-459d-ba77-10fe9a0ed5d8 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:01.875582 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add216f1-d3ae-459d-ba77-10fe9a0ed5d8 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:01.882616 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef13aebc-a3a1-4893-895d-99a43e49e7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:01.884325 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13aebc-a3a1-4893-895d-99a43e49e7d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:01.884620 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13aebc-a3a1-4893-895d-99a43e49e7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:01.884962 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13aebc-a3a1-4893-895d-99a43e49e7d8 admin admin] PATH_INFO: `/v3/projects/30a50d3f16e340b39e9cb19122b59312/users/e21cc6cf351b420ba044078bf78ff87a/roles/13af81971c1c428eae0a571a22ea583d` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:01.888232 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:01.899712 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a528cc05-cea2-4a60-b454-c5291329726e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:01.901648 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a528cc05-cea2-4a60-b454-c5291329726e service cinder] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:01.916144 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef13aebc-a3a1-4893-895d-99a43e49e7d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30a50d3f16e340b39e9cb19122b59312, user_id=e21cc6cf351b420ba044078bf78ff87a, role_id=13af81971c1c428eae0a571a22ea583d)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:01.931736 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef13aebc-a3a1-4893-895d-99a43e49e7d8 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:01.932080 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1019/2025] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:31:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:31:01.951472 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1007/2026] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:31:01 2022] PUT /identity/v3/projects/30a50d3f16e340b39e9cb19122b59312/users/e21cc6cf351b420ba044078bf78ff87a/roles/13af81971c1c428eae0a571a22ea583d => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:31:01.962629 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883afafa-e101-46ce-916a-bfffbc1a7881 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:01.962974 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883afafa-e101-46ce-916a-bfffbc1a7881 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:01.963176 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883afafa-e101-46ce-916a-bfffbc1a7881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:02.005445 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-883afafa-e101-46ce-916a-bfffbc1a7881 None None] MFA Rules not processed for user `e21cc6cf351b420ba044078bf78ff87a`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:31:02.006860 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-883afafa-e101-46ce-916a-bfffbc1a7881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:02.123637 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1020/2027] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:31:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:31:02.125267 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef13aebc-a3a1-4893-895d-99a43e49e7d8 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:02.199549 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef13aebc-a3a1-4893-895d-99a43e49e7d8 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:02.205320 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb531123-18a2-4f7c-bd05-e23af4acaca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:02.205941 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb531123-18a2-4f7c-bd05-e23af4acaca9 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:02.206280 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb531123-18a2-4f7c-bd05-e23af4acaca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:02.206744 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb531123-18a2-4f7c-bd05-e23af4acaca9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:02.207537 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb531123-18a2-4f7c-bd05-e23af4acaca9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:02.210211 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb531123-18a2-4f7c-bd05-e23af4acaca9 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:02.248624 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1008/2028] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:31:02 2022] POST /identity/v3/projects => generated 379 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:31:02.249305 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883afafa-e101-46ce-916a-bfffbc1a7881 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:02.262478 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883afafa-e101-46ce-916a-bfffbc1a7881 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:02.350560 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168e20a1-9c91-4278-8b71-1ffe82d5755e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:02.351276 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e20a1-9c91-4278-8b71-1ffe82d5755e admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:02.351620 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e20a1-9c91-4278-8b71-1ffe82d5755e admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:02.352103 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e20a1-9c91-4278-8b71-1ffe82d5755e admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:02.352673 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168e20a1-9c91-4278-8b71-1ffe82d5755e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:02.354760 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168e20a1-9c91-4278-8b71-1ffe82d5755e admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:02.379927 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1021/2029] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:31:02 2022] POST /identity/v3/users => generated 296 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 01:31:02.383973 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb531123-18a2-4f7c-bd05-e23af4acaca9 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:02.397198 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb531123-18a2-4f7c-bd05-e23af4acaca9 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:02.403397 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65307f4a-d650-4e9c-80ff-ce8b66cb41c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:02.404024 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65307f4a-d650-4e9c-80ff-ce8b66cb41c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:02.404391 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65307f4a-d650-4e9c-80ff-ce8b66cb41c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:02.404626 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65307f4a-d650-4e9c-80ff-ce8b66cb41c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:02.405687 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65307f4a-d650-4e9c-80ff-ce8b66cb41c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:02.407316 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65307f4a-d650-4e9c-80ff-ce8b66cb41c0 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:02.430894 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1009/2030] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:31:02 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:31:02.435057 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168e20a1-9c91-4278-8b71-1ffe82d5755e admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:02.445770 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168e20a1-9c91-4278-8b71-1ffe82d5755e admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:02.450670 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee144a04-ba9d-47b9-a3e7-3925a49c4c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:02.451393 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee144a04-ba9d-47b9-a3e7-3925a49c4c0e admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:02.451670 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee144a04-ba9d-47b9-a3e7-3925a49c4c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:02.451973 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee144a04-ba9d-47b9-a3e7-3925a49c4c0e admin admin] PATH_INFO: `/v3/projects/2aec2db91065482a8c6ef9c42ae548f5/users/29c8666494174d07b465f2317e24f7b8/roles/fb48693810be495fb4b1893a79429b78` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:02.468062 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee144a04-ba9d-47b9-a3e7-3925a49c4c0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2aec2db91065482a8c6ef9c42ae548f5, user_id=29c8666494174d07b465f2317e24f7b8, role_id=fb48693810be495fb4b1893a79429b78)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:02.470837 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee144a04-ba9d-47b9-a3e7-3925a49c4c0e admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:02.496408 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1022/2031] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:31:02 2022] PUT /identity/v3/projects/2aec2db91065482a8c6ef9c42ae548f5/users/29c8666494174d07b465f2317e24f7b8/roles/fb48693810be495fb4b1893a79429b78 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:31:02.500807 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65307f4a-d650-4e9c-80ff-ce8b66cb41c0 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:02.510878 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65307f4a-d650-4e9c-80ff-ce8b66cb41c0 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:02.567817 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba5fa86-17f1-4e17-bcb4-925c77985942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:02.568568 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba5fa86-17f1-4e17-bcb4-925c77985942 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:02.568841 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba5fa86-17f1-4e17-bcb4-925c77985942 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:02.569103 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba5fa86-17f1-4e17-bcb4-925c77985942 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:02.569742 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba5fa86-17f1-4e17-bcb4-925c77985942 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:02.571413 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba5fa86-17f1-4e17-bcb4-925c77985942 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:02.582487 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1010/2032] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:31:02 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:31:02.587152 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee144a04-ba9d-47b9-a3e7-3925a49c4c0e admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:02.599255 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee144a04-ba9d-47b9-a3e7-3925a49c4c0e admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:02.604929 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44ee86c-112d-4984-b7ab-54415786061a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:02.605627 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ee86c-112d-4984-b7ab-54415786061a admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:02.605930 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ee86c-112d-4984-b7ab-54415786061a admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:02.606160 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ee86c-112d-4984-b7ab-54415786061a admin admin] PATH_INFO: `/v3/projects/2aec2db91065482a8c6ef9c42ae548f5/users/29c8666494174d07b465f2317e24f7b8/roles/fb48693810be495fb4b1893a79429b78` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:02.608352 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44ee86c-112d-4984-b7ab-54415786061a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2aec2db91065482a8c6ef9c42ae548f5, user_id=29c8666494174d07b465f2317e24f7b8, role_id=fb48693810be495fb4b1893a79429b78)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:02.611112 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44ee86c-112d-4984-b7ab-54415786061a admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:02.615118 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:02.624709 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1023/2033] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:31:02 2022] PUT /identity/v3/projects/2aec2db91065482a8c6ef9c42ae548f5/users/29c8666494174d07b465f2317e24f7b8/roles/fb48693810be495fb4b1893a79429b78 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:31:02.635212 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68023e3f-9403-454e-9f24-9d1bedeb09c7 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:02.635500 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68023e3f-9403-454e-9f24-9d1bedeb09c7 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:02.635773 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68023e3f-9403-454e-9f24-9d1bedeb09c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:02.668065 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-68023e3f-9403-454e-9f24-9d1bedeb09c7 None None] MFA Rules not processed for user `29c8666494174d07b465f2317e24f7b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:31:02.669421 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-68023e3f-9403-454e-9f24-9d1bedeb09c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:02.719395 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:02.760472 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1011/2034] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:31:02 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:31:02.777161 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44ee86c-112d-4984-b7ab-54415786061a admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:02.779100 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-a44ee86c-112d-4984-b7ab-54415786061a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:02.865302 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44ee86c-112d-4984-b7ab-54415786061a admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:02.869944 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff32935-b72a-45e1-86c2-0f4767590478 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7853d40c29af424c8d7913950d89750b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:02.870651 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff32935-b72a-45e1-86c2-0f4767590478 service cinder] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:02.870935 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff32935-b72a-45e1-86c2-0f4767590478 service cinder] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:02.871245 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff32935-b72a-45e1-86c2-0f4767590478 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:02.882585 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff32935-b72a-45e1-86c2-0f4767590478 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:02.884063 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff32935-b72a-45e1-86c2-0f4767590478 service cinder] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:02.896287 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1024/2035] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:31:02 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:31:02.995397 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68023e3f-9403-454e-9f24-9d1bedeb09c7 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:03.008664 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68023e3f-9403-454e-9f24-9d1bedeb09c7 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:03.013360 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac06ed4d-a108-4645-8668-63142e5b6848 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7853d40c29af424c8d7913950d89750b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:03.014262 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06ed4d-a108-4645-8668-63142e5b6848 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:03.014746 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06ed4d-a108-4645-8668-63142e5b6848 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:03.015018 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06ed4d-a108-4645-8668-63142e5b6848 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:03.115907 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac06ed4d-a108-4645-8668-63142e5b6848 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:03.117349 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac06ed4d-a108-4645-8668-63142e5b6848 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:03.126038 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1012/2036] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:31:02 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:31:03.625937 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff32935-b72a-45e1-86c2-0f4767590478 service cinder] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:03.657289 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac06ed4d-a108-4645-8668-63142e5b6848 service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:03.666929 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac06ed4d-a108-4645-8668-63142e5b6848 service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:03.671096 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cf01c3-2cd7-46f4-b7c6-0f5838d8749d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7853d40c29af424c8d7913950d89750b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:03.671959 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf01c3-2cd7-46f4-b7c6-0f5838d8749d service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:03.672716 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf01c3-2cd7-46f4-b7c6-0f5838d8749d service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:03.673192 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf01c3-2cd7-46f4-b7c6-0f5838d8749d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:03.675553 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-e5cf01c3-2cd7-46f4-b7c6-0f5838d8749d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:03.723147 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff32935-b72a-45e1-86c2-0f4767590478 service cinder] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:03.729421 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cb7e3f-c247-4fac-a540-cf5d03ab9b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:03.730275 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb7e3f-c247-4fac-a540-cf5d03ab9b52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:03.730531 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb7e3f-c247-4fac-a540-cf5d03ab9b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:03.730991 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb7e3f-c247-4fac-a540-cf5d03ab9b52 admin admin] PATH_INFO: `/v3/users/e21cc6cf351b420ba044078bf78ff87a` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:03.732215 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cb7e3f-c247-4fac-a540-cf5d03ab9b52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e21cc6cf351b420ba044078bf78ff87a)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:03.734419 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cb7e3f-c247-4fac-a540-cf5d03ab9b52 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:03.752435 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cf01c3-2cd7-46f4-b7c6-0f5838d8749d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:03.754671 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cf01c3-2cd7-46f4-b7c6-0f5838d8749d service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:03.765979 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1013/2037] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:31:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 01:31:03.796861 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-a3cb7e3f-c247-4fac-a540-cf5d03ab9b52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e21cc6cf351b420ba044078bf78ff87a'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:03.812486 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-a3cb7e3f-c247-4fac-a540-cf5d03ab9b52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e21cc6cf351b420ba044078bf78ff87a'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:03.813056 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-a3cb7e3f-c247-4fac-a540-cf5d03ab9b52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e21cc6cf351b420ba044078bf78ff87a'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:03.824408 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-a3cb7e3f-c247-4fac-a540-cf5d03ab9b52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e21cc6cf351b420ba044078bf78ff87a'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:03.839731 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-a3cb7e3f-c247-4fac-a540-cf5d03ab9b52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e21cc6cf351b420ba044078bf78ff87a'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:03.847866 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1025/2038] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:31:03 2022] DELETE /identity/v3/users/e21cc6cf351b420ba044078bf78ff87a => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:31:03.852492 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec7fa2-f606-44fd-8606-a9b4ed6fb6c8 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:03.852966 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec7fa2-f606-44fd-8606-a9b4ed6fb6c8 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:03.853302 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aec7fa2-f606-44fd-8606-a9b4ed6fb6c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:03.890078 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-5aec7fa2-f606-44fd-8606-a9b4ed6fb6c8 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:31:03.891688 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-5aec7fa2-f606-44fd-8606-a9b4ed6fb6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:04.058714 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1014/2039] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:31:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 01:31:04.087130 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cb7e3f-c247-4fac-a540-cf5d03ab9b52 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:04.089574 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-a3cb7e3f-c247-4fac-a540-cf5d03ab9b52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:04.127523 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:04.194400 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cb7e3f-c247-4fac-a540-cf5d03ab9b52 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:04.198485 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e881d935-79a2-482b-83fc-0a97b7883206 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:04.199095 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e881d935-79a2-482b-83fc-0a97b7883206 service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:04.199363 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e881d935-79a2-482b-83fc-0a97b7883206 service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:04.199629 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e881d935-79a2-482b-83fc-0a97b7883206 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:04.223279 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e881d935-79a2-482b-83fc-0a97b7883206 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:04.225073 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e881d935-79a2-482b-83fc-0a97b7883206 service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:04.247198 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1026/2040] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:31:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:31:04.623494 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aec7fa2-f606-44fd-8606-a9b4ed6fb6c8 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:04.623494 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-5aec7fa2-f606-44fd-8606-a9b4ed6fb6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:04.648152 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:04.733236 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aec7fa2-f606-44fd-8606-a9b4ed6fb6c8 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:04.741384 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af2fbca-66f4-4375-bb00-c2aa79c1b66e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7853d40c29af424c8d7913950d89750b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:04.741384 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af2fbca-66f4-4375-bb00-c2aa79c1b66e service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:04.741384 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af2fbca-66f4-4375-bb00-c2aa79c1b66e service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:04.741756 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af2fbca-66f4-4375-bb00-c2aa79c1b66e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:04.745110 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-4af2fbca-66f4-4375-bb00-c2aa79c1b66e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:04.756692 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e881d935-79a2-482b-83fc-0a97b7883206 service neutron] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:04.758175 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-e881d935-79a2-482b-83fc-0a97b7883206 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:04.781230 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e881d935-79a2-482b-83fc-0a97b7883206 service neutron] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:04.787399 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e131830-d831-427e-a125-6d1cfb37c903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:04.787948 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e131830-d831-427e-a125-6d1cfb37c903 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:04.788250 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e131830-d831-427e-a125-6d1cfb37c903 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:04.788490 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e131830-d831-427e-a125-6d1cfb37c903 admin admin] PATH_INFO: `/v3/projects/30a50d3f16e340b39e9cb19122b59312` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:04.789664 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e131830-d831-427e-a125-6d1cfb37c903 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30a50d3f16e340b39e9cb19122b59312)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:04.791709 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e131830-d831-427e-a125-6d1cfb37c903 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:04.851154 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af2fbca-66f4-4375-bb00-c2aa79c1b66e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:04.852740 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af2fbca-66f4-4375-bb00-c2aa79c1b66e service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:04.864316 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1015/2041] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:31:04 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:31:04.867930 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-1e131830-d831-427e-a125-6d1cfb37c903 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30a50d3f16e340b39e9cb19122b59312', 'request_id': 'req-1e131830-d831-427e-a125-6d1cfb37c903'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:04.875216 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-1e131830-d831-427e-a125-6d1cfb37c903 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30a50d3f16e340b39e9cb19122b59312', 'request_id': 'req-1e131830-d831-427e-a125-6d1cfb37c903'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:04.882362 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-1e131830-d831-427e-a125-6d1cfb37c903 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30a50d3f16e340b39e9cb19122b59312', 'request_id': 'req-1e131830-d831-427e-a125-6d1cfb37c903'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:04.898086 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-1e131830-d831-427e-a125-6d1cfb37c903 admin admin] The token cache is being invalidate because project 30a50d3f16e340b39e9cb19122b59312 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:31:04.898423 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-1e131830-d831-427e-a125-6d1cfb37c903 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:04.900298 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-1e131830-d831-427e-a125-6d1cfb37c903 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:04.902042 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1027/2042] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:31:04 2022] DELETE /identity/v3/projects/30a50d3f16e340b39e9cb19122b59312 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 01:31:04.906383 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af2fbca-66f4-4375-bb00-c2aa79c1b66e service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:04.917661 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af2fbca-66f4-4375-bb00-c2aa79c1b66e service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:04.985284 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a86f7-4eb3-4c8a-9913-ee120c29dced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:04.986461 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a86f7-4eb3-4c8a-9913-ee120c29dced admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:04.986739 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a86f7-4eb3-4c8a-9913-ee120c29dced admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:04.987108 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a86f7-4eb3-4c8a-9913-ee120c29dced admin admin] PATH_INFO: `/v3/users/29c8666494174d07b465f2317e24f7b8` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:04.988804 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37a86f7-4eb3-4c8a-9913-ee120c29dced admin admin] RBAC: Authorizing `identity:delete_user(user_id=29c8666494174d07b465f2317e24f7b8)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:04.991258 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37a86f7-4eb3-4c8a-9913-ee120c29dced admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:05.052004 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b37a86f7-4eb3-4c8a-9913-ee120c29dced admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29c8666494174d07b465f2317e24f7b8'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:05.060668 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b37a86f7-4eb3-4c8a-9913-ee120c29dced admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29c8666494174d07b465f2317e24f7b8'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:05.061415 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b37a86f7-4eb3-4c8a-9913-ee120c29dced admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29c8666494174d07b465f2317e24f7b8'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:05.074198 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b37a86f7-4eb3-4c8a-9913-ee120c29dced admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29c8666494174d07b465f2317e24f7b8'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:05.080299 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:05.100369 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b37a86f7-4eb3-4c8a-9913-ee120c29dced admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29c8666494174d07b465f2317e24f7b8'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:05.108908 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1016/2043] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:31:04 2022] DELETE /identity/v3/users/29c8666494174d07b465f2317e24f7b8 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:31:05.612171 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e131830-d831-427e-a125-6d1cfb37c903 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:05.614155 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-1e131830-d831-427e-a125-6d1cfb37c903 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:05.630014 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e131830-d831-427e-a125-6d1cfb37c903 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:05.702334 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513d75c5-7b8c-42d9-9d8e-fb33d9265850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:05.703087 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d75c5-7b8c-42d9-9d8e-fb33d9265850 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:05.703429 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d75c5-7b8c-42d9-9d8e-fb33d9265850 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:05.703704 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d75c5-7b8c-42d9-9d8e-fb33d9265850 admin admin] PATH_INFO: `/v3/projects/2aec2db91065482a8c6ef9c42ae548f5` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:05.704826 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513d75c5-7b8c-42d9-9d8e-fb33d9265850 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2aec2db91065482a8c6ef9c42ae548f5)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:05.706813 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513d75c5-7b8c-42d9-9d8e-fb33d9265850 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:05.753575 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:05.756673 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-513d75c5-7b8c-42d9-9d8e-fb33d9265850 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2aec2db91065482a8c6ef9c42ae548f5', 'request_id': 'req-513d75c5-7b8c-42d9-9d8e-fb33d9265850'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:05.764172 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-513d75c5-7b8c-42d9-9d8e-fb33d9265850 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2aec2db91065482a8c6ef9c42ae548f5', 'request_id': 'req-513d75c5-7b8c-42d9-9d8e-fb33d9265850'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:05.771084 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-513d75c5-7b8c-42d9-9d8e-fb33d9265850 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2aec2db91065482a8c6ef9c42ae548f5', 'request_id': 'req-513d75c5-7b8c-42d9-9d8e-fb33d9265850'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:05.784701 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-513d75c5-7b8c-42d9-9d8e-fb33d9265850 admin admin] The token cache is being invalidate because project 2aec2db91065482a8c6ef9c42ae548f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:31:05.785061 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-513d75c5-7b8c-42d9-9d8e-fb33d9265850 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:05.785683 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-513d75c5-7b8c-42d9-9d8e-fb33d9265850 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:05.787370 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1028/2044] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:31:05 2022] DELETE /identity/v3/projects/2aec2db91065482a8c6ef9c42ae548f5 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:31:05.792341 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f99c0-98a4-4ab5-8aa2-993afafa08bf None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:05.792886 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f99c0-98a4-4ab5-8aa2-993afafa08bf None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:05.792886 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f99c0-98a4-4ab5-8aa2-993afafa08bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:05.812825 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-739f99c0-98a4-4ab5-8aa2-993afafa08bf None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:31:05.814027 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-739f99c0-98a4-4ab5-8aa2-993afafa08bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:05.872394 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1017/2045] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:31:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:31:05.881547 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30815b0-5999-4591-9034-097c7869dbb9 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:05.881833 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30815b0-5999-4591-9034-097c7869dbb9 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:05.882105 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30815b0-5999-4591-9034-097c7869dbb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:05.902843 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-b30815b0-5999-4591-9034-097c7869dbb9 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:31:05.904074 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-b30815b0-5999-4591-9034-097c7869dbb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:05.912858 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1029/2046] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:31:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:31:05.917329 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739f99c0-98a4-4ab5-8aa2-993afafa08bf None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:05.928115 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739f99c0-98a4-4ab5-8aa2-993afafa08bf None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:05.933901 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23490eb-ff94-4af8-a1d1-0a5aa828d6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:05.934598 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23490eb-ff94-4af8-a1d1-0a5aa828d6eb admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:05.934936 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23490eb-ff94-4af8-a1d1-0a5aa828d6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:05.935204 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23490eb-ff94-4af8-a1d1-0a5aa828d6eb admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:05.935872 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23490eb-ff94-4af8-a1d1-0a5aa828d6eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:31:05.936199 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23490eb-ff94-4af8-a1d1-0a5aa828d6eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:05.937798 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23490eb-ff94-4af8-a1d1-0a5aa828d6eb admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:05.950256 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1018/2047] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 01:31:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:31:05.955104 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30815b0-5999-4591-9034-097c7869dbb9 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:05.965866 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30815b0-5999-4591-9034-097c7869dbb9 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:05.970850 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffed44b-c1d8-4218-b0ba-45087c6d1ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:05.971452 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffed44b-c1d8-4218-b0ba-45087c6d1ca1 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:05.971725 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffed44b-c1d8-4218-b0ba-45087c6d1ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:05.972544 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffed44b-c1d8-4218-b0ba-45087c6d1ca1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:05.973197 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffed44b-c1d8-4218-b0ba-45087c6d1ca1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:05.975156 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffed44b-c1d8-4218-b0ba-45087c6d1ca1 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:06.005611 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1030/2048] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:31:05 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:31:06.010400 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23490eb-ff94-4af8-a1d1-0a5aa828d6eb admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:06.021891 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23490eb-ff94-4af8-a1d1-0a5aa828d6eb admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:06.093141 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1b75c4-ad08-4e51-9510-5b4fb071bc66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:06.093855 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b75c4-ad08-4e51-9510-5b4fb071bc66 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:06.094400 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b75c4-ad08-4e51-9510-5b4fb071bc66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:06.094668 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b75c4-ad08-4e51-9510-5b4fb071bc66 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:06.095298 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1b75c4-ad08-4e51-9510-5b4fb071bc66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:06.097222 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1b75c4-ad08-4e51-9510-5b4fb071bc66 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:06.123325 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1019/2049] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:31:06 2022] POST /identity/v3/users => generated 287 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:31:06.124869 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffed44b-c1d8-4218-b0ba-45087c6d1ca1 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:06.135804 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffed44b-c1d8-4218-b0ba-45087c6d1ca1 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:06.141003 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f5d553-2eba-4544-b627-5e72a2656e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:06.141653 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5d553-2eba-4544-b627-5e72a2656e18 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:06.141932 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5d553-2eba-4544-b627-5e72a2656e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:06.142305 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5d553-2eba-4544-b627-5e72a2656e18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:06.143017 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f5d553-2eba-4544-b627-5e72a2656e18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:06.144770 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f5d553-2eba-4544-b627-5e72a2656e18 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:06.158291 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1031/2050] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:31:06.159750 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1b75c4-ad08-4e51-9510-5b4fb071bc66 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:06.170271 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1b75c4-ad08-4e51-9510-5b4fb071bc66 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:06.184761 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc885cb1-7d48-40a0-bc3b-e2ac7c0790df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:06.185405 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc885cb1-7d48-40a0-bc3b-e2ac7c0790df admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:06.185713 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc885cb1-7d48-40a0-bc3b-e2ac7c0790df admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:06.185986 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc885cb1-7d48-40a0-bc3b-e2ac7c0790df admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:06.186685 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc885cb1-7d48-40a0-bc3b-e2ac7c0790df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:06.188349 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc885cb1-7d48-40a0-bc3b-e2ac7c0790df admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:06.201622 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1020/2051] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:31:06.206200 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f5d553-2eba-4544-b627-5e72a2656e18 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:06.217233 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f5d553-2eba-4544-b627-5e72a2656e18 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:06.222014 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aba202-d2c0-490e-b026-8138a8cd85d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:06.222808 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aba202-d2c0-490e-b026-8138a8cd85d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:06.223086 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aba202-d2c0-490e-b026-8138a8cd85d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:06.223362 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aba202-d2c0-490e-b026-8138a8cd85d2 admin admin] PATH_INFO: `/v3/projects/5a21dc810ea346d49c837bcae1da47ac/users/3e63d9e7094543a58699e2bf86cc8844/roles/13af81971c1c428eae0a571a22ea583d` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:06.240726 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aba202-d2c0-490e-b026-8138a8cd85d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a21dc810ea346d49c837bcae1da47ac, user_id=3e63d9e7094543a58699e2bf86cc8844, role_id=13af81971c1c428eae0a571a22ea583d)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:06.243611 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aba202-d2c0-490e-b026-8138a8cd85d2 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:06.259604 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1032/2052] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:31:06 2022] PUT /identity/v3/projects/5a21dc810ea346d49c837bcae1da47ac/users/3e63d9e7094543a58699e2bf86cc8844/roles/13af81971c1c428eae0a571a22ea583d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:31:06.275967 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e715bd-823b-4839-ba72-4ae93fe758ed None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:06.276250 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e715bd-823b-4839-ba72-4ae93fe758ed None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:06.276527 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e715bd-823b-4839-ba72-4ae93fe758ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:06.310883 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-96e715bd-823b-4839-ba72-4ae93fe758ed None None] MFA Rules not processed for user `3e63d9e7094543a58699e2bf86cc8844`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:31:06.312222 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-96e715bd-823b-4839-ba72-4ae93fe758ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:06.353916 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:06.381379 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1021/2053] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:31:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:31:06.385883 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aba202-d2c0-490e-b026-8138a8cd85d2 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:06.449598 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aba202-d2c0-490e-b026-8138a8cd85d2 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:06.454489 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad62f3a6-dccc-4558-b3a5-4711e7f5e1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:06.455093 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62f3a6-dccc-4558-b3a5-4711e7f5e1a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:06.455368 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62f3a6-dccc-4558-b3a5-4711e7f5e1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:06.455634 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62f3a6-dccc-4558-b3a5-4711e7f5e1a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:06.456293 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad62f3a6-dccc-4558-b3a5-4711e7f5e1a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:06.458228 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad62f3a6-dccc-4558-b3a5-4711e7f5e1a6 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:06.491407 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1033/2054] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:31:06 2022] POST /identity/v3/projects => generated 375 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:31:06.492685 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e715bd-823b-4839-ba72-4ae93fe758ed None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:06.505185 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e715bd-823b-4839-ba72-4ae93fe758ed None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:06.569825 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def8fa66-ff9a-40df-9357-63520fd3213b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:06.570487 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8fa66-ff9a-40df-9357-63520fd3213b admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:06.570764 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8fa66-ff9a-40df-9357-63520fd3213b admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:06.571029 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8fa66-ff9a-40df-9357-63520fd3213b admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:06.571696 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def8fa66-ff9a-40df-9357-63520fd3213b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:06.573648 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def8fa66-ff9a-40df-9357-63520fd3213b admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:06.597914 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1022/2055] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:31:06 2022] POST /identity/v3/users => generated 294 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:31:06.601700 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad62f3a6-dccc-4558-b3a5-4711e7f5e1a6 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:06.612581 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad62f3a6-dccc-4558-b3a5-4711e7f5e1a6 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:06.617195 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baf01a0-e351-4969-bf49-d3e225690f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:06.617920 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baf01a0-e351-4969-bf49-d3e225690f31 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:06.618314 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baf01a0-e351-4969-bf49-d3e225690f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:06.618792 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baf01a0-e351-4969-bf49-d3e225690f31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:06.619690 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baf01a0-e351-4969-bf49-d3e225690f31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:06.621394 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baf01a0-e351-4969-bf49-d3e225690f31 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:06.634968 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1034/2056] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:31:06.639776 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def8fa66-ff9a-40df-9357-63520fd3213b admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:06.651948 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def8fa66-ff9a-40df-9357-63520fd3213b admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:06.662841 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e902337-20ed-422b-b558-8373e83b5014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:06.663533 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e902337-20ed-422b-b558-8373e83b5014 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:06.663917 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e902337-20ed-422b-b558-8373e83b5014 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:06.664198 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e902337-20ed-422b-b558-8373e83b5014 admin admin] PATH_INFO: `/v3/projects/e217a467ba5249df9bee715883700dd6/users/7f70207c8d0a45b4ac2e9cd275c7eefc/roles/fb48693810be495fb4b1893a79429b78` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:06.683092 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e902337-20ed-422b-b558-8373e83b5014 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e217a467ba5249df9bee715883700dd6, user_id=7f70207c8d0a45b4ac2e9cd275c7eefc, role_id=fb48693810be495fb4b1893a79429b78)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:06.686580 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e902337-20ed-422b-b558-8373e83b5014 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:06.708146 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1023/2057] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:31:06 2022] PUT /identity/v3/projects/e217a467ba5249df9bee715883700dd6/users/7f70207c8d0a45b4ac2e9cd275c7eefc/roles/fb48693810be495fb4b1893a79429b78 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 01:31:06.712241 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baf01a0-e351-4969-bf49-d3e225690f31 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:06.724099 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baf01a0-e351-4969-bf49-d3e225690f31 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:06.776631 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:06.794911 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fe7bc5-46dd-4870-9370-c9bfb9f7b681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:06.795900 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe7bc5-46dd-4870-9370-c9bfb9f7b681 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:06.796181 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe7bc5-46dd-4870-9370-c9bfb9f7b681 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:06.796501 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe7bc5-46dd-4870-9370-c9bfb9f7b681 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:06.797213 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fe7bc5-46dd-4870-9370-c9bfb9f7b681 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:06.799004 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fe7bc5-46dd-4870-9370-c9bfb9f7b681 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:06.810354 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1035/2058] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:31:06.814901 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e902337-20ed-422b-b558-8373e83b5014 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:06.826184 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e902337-20ed-422b-b558-8373e83b5014 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:06.830754 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784b7613-1838-4762-909b-61b6af74f169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:06.832061 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b7613-1838-4762-909b-61b6af74f169 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:06.832342 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b7613-1838-4762-909b-61b6af74f169 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:06.832608 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b7613-1838-4762-909b-61b6af74f169 admin admin] PATH_INFO: `/v3/projects/e217a467ba5249df9bee715883700dd6/users/7f70207c8d0a45b4ac2e9cd275c7eefc/roles/fb48693810be495fb4b1893a79429b78` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:06.834682 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784b7613-1838-4762-909b-61b6af74f169 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e217a467ba5249df9bee715883700dd6, user_id=7f70207c8d0a45b4ac2e9cd275c7eefc, role_id=fb48693810be495fb4b1893a79429b78)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:06.837346 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784b7613-1838-4762-909b-61b6af74f169 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:06.851682 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1024/2059] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:31:06 2022] PUT /identity/v3/projects/e217a467ba5249df9bee715883700dd6/users/7f70207c8d0a45b4ac2e9cd275c7eefc/roles/fb48693810be495fb4b1893a79429b78 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 01:31:06.863233 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6916db-b2f0-4b81-b7ca-cee953d1a8f7 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:06.863551 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6916db-b2f0-4b81-b7ca-cee953d1a8f7 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:06.863792 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6916db-b2f0-4b81-b7ca-cee953d1a8f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:06.893085 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-7c6916db-b2f0-4b81-b7ca-cee953d1a8f7 None None] MFA Rules not processed for user `7f70207c8d0a45b4ac2e9cd275c7eefc`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:31:06.894608 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-7c6916db-b2f0-4b81-b7ca-cee953d1a8f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:06.968938 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1036/2060] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:31:06 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:31:06.980102 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784b7613-1838-4762-909b-61b6af74f169 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:06.982003 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-784b7613-1838-4762-909b-61b6af74f169 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:07.043457 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784b7613-1838-4762-909b-61b6af74f169 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:07.047317 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3812a7-e05c-4796-adfb-d6caf9202849 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7853d40c29af424c8d7913950d89750b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:07.047924 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3812a7-e05c-4796-adfb-d6caf9202849 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:07.048197 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3812a7-e05c-4796-adfb-d6caf9202849 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:07.048462 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3812a7-e05c-4796-adfb-d6caf9202849 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:07.099784 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:07.113862 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3812a7-e05c-4796-adfb-d6caf9202849 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:07.115400 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3812a7-e05c-4796-adfb-d6caf9202849 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:07.125315 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1025/2061] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:31:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:31:08.992097 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6916db-b2f0-4b81-b7ca-cee953d1a8f7 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:08.993699 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-7c6916db-b2f0-4b81-b7ca-cee953d1a8f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:09.068651 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6916db-b2f0-4b81-b7ca-cee953d1a8f7 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:09.073080 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf80a0d-2abd-4123-bfc9-af487558814e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:09.073736 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf80a0d-2abd-4123-bfc9-af487558814e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:09.074014 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf80a0d-2abd-4123-bfc9-af487558814e admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:09.074317 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf80a0d-2abd-4123-bfc9-af487558814e admin admin] PATH_INFO: `/v3/users/1cdbf237296147b489d1f741ea92d4c7` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:09.076607 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf80a0d-2abd-4123-bfc9-af487558814e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cdbf237296147b489d1f741ea92d4c7)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:09.078769 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf80a0d-2abd-4123-bfc9-af487558814e admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:09.128659 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-acf80a0d-2abd-4123-bfc9-af487558814e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cdbf237296147b489d1f741ea92d4c7'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:09.137581 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-acf80a0d-2abd-4123-bfc9-af487558814e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cdbf237296147b489d1f741ea92d4c7'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:09.138189 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-acf80a0d-2abd-4123-bfc9-af487558814e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cdbf237296147b489d1f741ea92d4c7'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:09.145839 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-acf80a0d-2abd-4123-bfc9-af487558814e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cdbf237296147b489d1f741ea92d4c7'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:09.151495 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:09.163597 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-acf80a0d-2abd-4123-bfc9-af487558814e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cdbf237296147b489d1f741ea92d4c7'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:09.175798 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1037/2062] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:31:08 2022] DELETE /identity/v3/users/1cdbf237296147b489d1f741ea92d4c7 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:31:09.180705 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9cff48-6d53-4a64-82e4-fc3737135581 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:09.181189 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9cff48-6d53-4a64-82e4-fc3737135581 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:09.181282 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9cff48-6d53-4a64-82e4-fc3737135581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:09.201319 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-dc9cff48-6d53-4a64-82e4-fc3737135581 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:31:09.202580 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-dc9cff48-6d53-4a64-82e4-fc3737135581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:09.284288 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1026/2063] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:31:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:31:09.296600 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf80a0d-2abd-4123-bfc9-af487558814e admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:09.298443 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-acf80a0d-2abd-4123-bfc9-af487558814e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:09.368134 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf80a0d-2abd-4123-bfc9-af487558814e admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:09.371748 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbfc644-2189-4c1f-a160-dc42f19f52d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:09.372362 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbfc644-2189-4c1f-a160-dc42f19f52d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:09.372634 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbfc644-2189-4c1f-a160-dc42f19f52d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:09.372901 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbfc644-2189-4c1f-a160-dc42f19f52d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:09.382796 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbfc644-2189-4c1f-a160-dc42f19f52d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:09.384228 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbfc644-2189-4c1f-a160-dc42f19f52d1 service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:09.395950 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1038/2064] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:31:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:31:09.705530 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9cff48-6d53-4a64-82e4-fc3737135581 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:09.708307 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-dc9cff48-6d53-4a64-82e4-fc3737135581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:09.722342 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9cff48-6d53-4a64-82e4-fc3737135581 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:09.727401 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb1b14-c17c-4e65-8175-f5d25d778406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:09.728054 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb1b14-c17c-4e65-8175-f5d25d778406 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:09.728542 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb1b14-c17c-4e65-8175-f5d25d778406 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:09.728820 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb1b14-c17c-4e65-8175-f5d25d778406 admin admin] PATH_INFO: `/v3/users/3e63d9e7094543a58699e2bf86cc8844` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:09.729999 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fb1b14-c17c-4e65-8175-f5d25d778406 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e63d9e7094543a58699e2bf86cc8844)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:09.731972 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fb1b14-c17c-4e65-8175-f5d25d778406 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:09.800948 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f9fb1b14-c17c-4e65-8175-f5d25d778406 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e63d9e7094543a58699e2bf86cc8844'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:09.813030 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f9fb1b14-c17c-4e65-8175-f5d25d778406 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e63d9e7094543a58699e2bf86cc8844'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:09.813668 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f9fb1b14-c17c-4e65-8175-f5d25d778406 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e63d9e7094543a58699e2bf86cc8844'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:09.822951 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f9fb1b14-c17c-4e65-8175-f5d25d778406 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e63d9e7094543a58699e2bf86cc8844'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:09.836398 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f9fb1b14-c17c-4e65-8175-f5d25d778406 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e63d9e7094543a58699e2bf86cc8844'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:09.843010 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1027/2065] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:31:09 2022] DELETE /identity/v3/users/3e63d9e7094543a58699e2bf86cc8844 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:31:09.847832 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f7704-3b74-4dd8-90fa-c2b0e22d3a3b None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:09.848172 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f7704-3b74-4dd8-90fa-c2b0e22d3a3b None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:09.848443 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f7704-3b74-4dd8-90fa-c2b0e22d3a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:09.868581 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-547f7704-3b74-4dd8-90fa-c2b0e22d3a3b None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:31:09.869766 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-547f7704-3b74-4dd8-90fa-c2b0e22d3a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:09.996635 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1039/2066] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:31:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:31:10.006532 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb1b14-c17c-4e65-8175-f5d25d778406 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:10.008029 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f9fb1b14-c17c-4e65-8175-f5d25d778406 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:10.069416 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb1b14-c17c-4e65-8175-f5d25d778406 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:10.073066 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8d74a4-805f-43fa-a547-cdba89ac111f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:10.073673 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8d74a4-805f-43fa-a547-cdba89ac111f service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:10.073940 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8d74a4-805f-43fa-a547-cdba89ac111f service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:10.074229 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8d74a4-805f-43fa-a547-cdba89ac111f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:10.083994 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8d74a4-805f-43fa-a547-cdba89ac111f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:10.085431 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8d74a4-805f-43fa-a547-cdba89ac111f service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:10.095704 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1028/2067] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:31:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 01:31:10.329500 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f7704-3b74-4dd8-90fa-c2b0e22d3a3b None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:10.331220 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-547f7704-3b74-4dd8-90fa-c2b0e22d3a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:10.343392 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f7704-3b74-4dd8-90fa-c2b0e22d3a3b None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:10.348588 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37abb0da-93dd-4e1c-9fd0-5c7f67cd9ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:10.349235 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37abb0da-93dd-4e1c-9fd0-5c7f67cd9ef1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:10.349546 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37abb0da-93dd-4e1c-9fd0-5c7f67cd9ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:10.349813 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37abb0da-93dd-4e1c-9fd0-5c7f67cd9ef1 admin admin] PATH_INFO: `/v3/projects/2a645c296ba34ce58344ac931c2a258d` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:10.351000 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37abb0da-93dd-4e1c-9fd0-5c7f67cd9ef1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a645c296ba34ce58344ac931c2a258d)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:10.352907 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37abb0da-93dd-4e1c-9fd0-5c7f67cd9ef1 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:10.427700 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-37abb0da-93dd-4e1c-9fd0-5c7f67cd9ef1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a645c296ba34ce58344ac931c2a258d', 'request_id': 'req-37abb0da-93dd-4e1c-9fd0-5c7f67cd9ef1'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:10.436262 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-37abb0da-93dd-4e1c-9fd0-5c7f67cd9ef1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a645c296ba34ce58344ac931c2a258d', 'request_id': 'req-37abb0da-93dd-4e1c-9fd0-5c7f67cd9ef1'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:10.442017 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8d74a4-805f-43fa-a547-cdba89ac111f service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:10.444377 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-0a8d74a4-805f-43fa-a547-cdba89ac111f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:10.453002 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-37abb0da-93dd-4e1c-9fd0-5c7f67cd9ef1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a645c296ba34ce58344ac931c2a258d', 'request_id': 'req-37abb0da-93dd-4e1c-9fd0-5c7f67cd9ef1'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:10.455951 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:10.469798 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8d74a4-805f-43fa-a547-cdba89ac111f service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:10.475977 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-37abb0da-93dd-4e1c-9fd0-5c7f67cd9ef1 admin admin] The token cache is being invalidate because project 2a645c296ba34ce58344ac931c2a258d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:31:10.476293 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-37abb0da-93dd-4e1c-9fd0-5c7f67cd9ef1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:10.476994 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-37abb0da-93dd-4e1c-9fd0-5c7f67cd9ef1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:10.483178 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1040/2068] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:31:10 2022] DELETE /identity/v3/projects/2a645c296ba34ce58344ac931c2a258d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:31:10.484751 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37abb0da-93dd-4e1c-9fd0-5c7f67cd9ef1 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:10.488353 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-37abb0da-93dd-4e1c-9fd0-5c7f67cd9ef1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:10.521295 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:10.586988 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a284a-cc75-464e-8a45-bb2518a9ecf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:10.588780 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a284a-cc75-464e-8a45-bb2518a9ecf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:10.589154 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a284a-cc75-464e-8a45-bb2518a9ecf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:10.589513 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a284a-cc75-464e-8a45-bb2518a9ecf2 admin admin] PATH_INFO: `/v3/projects/5a21dc810ea346d49c837bcae1da47ac` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:10.590781 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713a284a-cc75-464e-8a45-bb2518a9ecf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a21dc810ea346d49c837bcae1da47ac)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:10.593486 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713a284a-cc75-464e-8a45-bb2518a9ecf2 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:10.593764 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37abb0da-93dd-4e1c-9fd0-5c7f67cd9ef1 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:10.599685 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9027666f-f5e5-41f8-808a-24fb456ad3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:10.600351 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9027666f-f5e5-41f8-808a-24fb456ad3a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:10.600629 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9027666f-f5e5-41f8-808a-24fb456ad3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:10.600902 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9027666f-f5e5-41f8-808a-24fb456ad3a7 admin admin] PATH_INFO: `/v3/users/a5b9e6a5ab784777a6a7f2aaaa502b28` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:10.602264 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9027666f-f5e5-41f8-808a-24fb456ad3a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5b9e6a5ab784777a6a7f2aaaa502b28)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:10.604768 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9027666f-f5e5-41f8-808a-24fb456ad3a7 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:10.667198 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-713a284a-cc75-464e-8a45-bb2518a9ecf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a21dc810ea346d49c837bcae1da47ac', 'request_id': 'req-713a284a-cc75-464e-8a45-bb2518a9ecf2'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:10.673664 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-9027666f-f5e5-41f8-808a-24fb456ad3a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5b9e6a5ab784777a6a7f2aaaa502b28'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:10.677429 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-713a284a-cc75-464e-8a45-bb2518a9ecf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a21dc810ea346d49c837bcae1da47ac', 'request_id': 'req-713a284a-cc75-464e-8a45-bb2518a9ecf2'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:10.683364 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-9027666f-f5e5-41f8-808a-24fb456ad3a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5b9e6a5ab784777a6a7f2aaaa502b28'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:10.684152 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-9027666f-f5e5-41f8-808a-24fb456ad3a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5b9e6a5ab784777a6a7f2aaaa502b28'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:10.685049 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-713a284a-cc75-464e-8a45-bb2518a9ecf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a21dc810ea346d49c837bcae1da47ac', 'request_id': 'req-713a284a-cc75-464e-8a45-bb2518a9ecf2'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:10.692329 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-9027666f-f5e5-41f8-808a-24fb456ad3a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5b9e6a5ab784777a6a7f2aaaa502b28'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:10.697364 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-713a284a-cc75-464e-8a45-bb2518a9ecf2 admin admin] The token cache is being invalidate because project 5a21dc810ea346d49c837bcae1da47ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:31:10.697664 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-713a284a-cc75-464e-8a45-bb2518a9ecf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:10.698949 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-713a284a-cc75-464e-8a45-bb2518a9ecf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:10.701166 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1029/2069] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:31:10 2022] DELETE /identity/v3/projects/5a21dc810ea346d49c837bcae1da47ac => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:31:10.706419 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a284a-cc75-464e-8a45-bb2518a9ecf2 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:10.709469 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-9027666f-f5e5-41f8-808a-24fb456ad3a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5b9e6a5ab784777a6a7f2aaaa502b28'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:10.709685 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-713a284a-cc75-464e-8a45-bb2518a9ecf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:10.716364 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1041/2070] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:31:10 2022] DELETE /identity/v3/users/a5b9e6a5ab784777a6a7f2aaaa502b28 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 01:31:10.813737 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a284a-cc75-464e-8a45-bb2518a9ecf2 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:10.867930 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:10.904121 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e63af43-a72b-444f-944b-07c43e59eb7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:10.905142 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63af43-a72b-444f-944b-07c43e59eb7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:10.905452 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63af43-a72b-444f-944b-07c43e59eb7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:10.905828 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63af43-a72b-444f-944b-07c43e59eb7c admin admin] PATH_INFO: `/v3/users/7f70207c8d0a45b4ac2e9cd275c7eefc` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:10.907172 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e63af43-a72b-444f-944b-07c43e59eb7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f70207c8d0a45b4ac2e9cd275c7eefc)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:10.909346 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e63af43-a72b-444f-944b-07c43e59eb7c admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:10.989066 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-6e63af43-a72b-444f-944b-07c43e59eb7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f70207c8d0a45b4ac2e9cd275c7eefc'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:11.010682 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-6e63af43-a72b-444f-944b-07c43e59eb7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f70207c8d0a45b4ac2e9cd275c7eefc'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:11.013366 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-6e63af43-a72b-444f-944b-07c43e59eb7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f70207c8d0a45b4ac2e9cd275c7eefc'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:11.030074 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-6e63af43-a72b-444f-944b-07c43e59eb7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f70207c8d0a45b4ac2e9cd275c7eefc'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:11.033213 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9027666f-f5e5-41f8-808a-24fb456ad3a7 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:11.035670 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-9027666f-f5e5-41f8-808a-24fb456ad3a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:11.052606 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9027666f-f5e5-41f8-808a-24fb456ad3a7 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:11.057317 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff07fbc-ef73-4513-af7a-7c72ae01b25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:11.058026 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff07fbc-ef73-4513-af7a-7c72ae01b25a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:11.058393 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff07fbc-ef73-4513-af7a-7c72ae01b25a admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:11.058777 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff07fbc-ef73-4513-af7a-7c72ae01b25a admin admin] PATH_INFO: `/v3/projects/27180f8f2bc8404f9db1b51d9384c4f1` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:11.059995 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff07fbc-ef73-4513-af7a-7c72ae01b25a admin admin] RBAC: Authorizing `identity:delete_project(project_id=27180f8f2bc8404f9db1b51d9384c4f1)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:11.062630 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff07fbc-ef73-4513-af7a-7c72ae01b25a admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:11.091199 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-6e63af43-a72b-444f-944b-07c43e59eb7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f70207c8d0a45b4ac2e9cd275c7eefc'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:11.107549 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1030/2071] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:31:10 2022] DELETE /identity/v3/users/7f70207c8d0a45b4ac2e9cd275c7eefc => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:31:11.139959 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-6ff07fbc-ef73-4513-af7a-7c72ae01b25a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27180f8f2bc8404f9db1b51d9384c4f1', 'request_id': 'req-6ff07fbc-ef73-4513-af7a-7c72ae01b25a'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:11.151892 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-6ff07fbc-ef73-4513-af7a-7c72ae01b25a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27180f8f2bc8404f9db1b51d9384c4f1', 'request_id': 'req-6ff07fbc-ef73-4513-af7a-7c72ae01b25a'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:11.161242 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-6ff07fbc-ef73-4513-af7a-7c72ae01b25a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27180f8f2bc8404f9db1b51d9384c4f1', 'request_id': 'req-6ff07fbc-ef73-4513-af7a-7c72ae01b25a'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:11.185346 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-6ff07fbc-ef73-4513-af7a-7c72ae01b25a admin admin] The token cache is being invalidate because project 27180f8f2bc8404f9db1b51d9384c4f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:31:11.186029 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-6ff07fbc-ef73-4513-af7a-7c72ae01b25a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:11.187585 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-6ff07fbc-ef73-4513-af7a-7c72ae01b25a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:11.193712 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1042/2072] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:31:11 2022] DELETE /identity/v3/projects/27180f8f2bc8404f9db1b51d9384c4f1 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:31:11.194866 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e63af43-a72b-444f-944b-07c43e59eb7c admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:11.197534 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-6e63af43-a72b-444f-944b-07c43e59eb7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:11.329544 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e63af43-a72b-444f-944b-07c43e59eb7c admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:11.404921 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b0bbe-116f-4123-84a2-35a839385a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:11.406163 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b0bbe-116f-4123-84a2-35a839385a3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:11.407242 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b0bbe-116f-4123-84a2-35a839385a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:11.407440 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b0bbe-116f-4123-84a2-35a839385a3f admin admin] PATH_INFO: `/v3/users/750d4b4d09b4478ab4d9af904161a973` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:11.408828 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b0bbe-116f-4123-84a2-35a839385a3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=750d4b4d09b4478ab4d9af904161a973)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:11.410987 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b0bbe-116f-4123-84a2-35a839385a3f admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:11.417503 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:11.470623 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-787b0bbe-116f-4123-84a2-35a839385a3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '750d4b4d09b4478ab4d9af904161a973'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:11.480042 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-787b0bbe-116f-4123-84a2-35a839385a3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '750d4b4d09b4478ab4d9af904161a973'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:11.480830 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-787b0bbe-116f-4123-84a2-35a839385a3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '750d4b4d09b4478ab4d9af904161a973'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:11.490043 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-787b0bbe-116f-4123-84a2-35a839385a3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '750d4b4d09b4478ab4d9af904161a973'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:11.503934 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-787b0bbe-116f-4123-84a2-35a839385a3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '750d4b4d09b4478ab4d9af904161a973'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:11.511612 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1031/2073] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:31:11 2022] DELETE /identity/v3/users/750d4b4d09b4478ab4d9af904161a973 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 01:31:11.756739 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff07fbc-ef73-4513-af7a-7c72ae01b25a admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:11.759274 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-6ff07fbc-ef73-4513-af7a-7c72ae01b25a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:11.775973 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff07fbc-ef73-4513-af7a-7c72ae01b25a admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:11.789218 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:11.891060 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41767385-7bad-4fa0-b6b8-6f2383464787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:11.891806 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41767385-7bad-4fa0-b6b8-6f2383464787 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:11.892161 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41767385-7bad-4fa0-b6b8-6f2383464787 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:11.892446 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41767385-7bad-4fa0-b6b8-6f2383464787 admin admin] PATH_INFO: `/v3/projects/e217a467ba5249df9bee715883700dd6` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:11.894485 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41767385-7bad-4fa0-b6b8-6f2383464787 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e217a467ba5249df9bee715883700dd6)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:11.896814 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41767385-7bad-4fa0-b6b8-6f2383464787 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:12.016811 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-41767385-7bad-4fa0-b6b8-6f2383464787 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e217a467ba5249df9bee715883700dd6', 'request_id': 'req-41767385-7bad-4fa0-b6b8-6f2383464787'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:12.031970 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-41767385-7bad-4fa0-b6b8-6f2383464787 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e217a467ba5249df9bee715883700dd6', 'request_id': 'req-41767385-7bad-4fa0-b6b8-6f2383464787'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:12.045069 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-41767385-7bad-4fa0-b6b8-6f2383464787 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e217a467ba5249df9bee715883700dd6', 'request_id': 'req-41767385-7bad-4fa0-b6b8-6f2383464787'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:12.071880 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-41767385-7bad-4fa0-b6b8-6f2383464787 admin admin] The token cache is being invalidate because project e217a467ba5249df9bee715883700dd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:31:12.072944 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-41767385-7bad-4fa0-b6b8-6f2383464787 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:12.075025 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-41767385-7bad-4fa0-b6b8-6f2383464787 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:12.078420 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1043/2074] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:31:11 2022] DELETE /identity/v3/projects/e217a467ba5249df9bee715883700dd6 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:31:12.083479 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e939a-9089-4429-b5e5-bc9885915d98 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:12.083789 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e939a-9089-4429-b5e5-bc9885915d98 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:12.083989 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e939a-9089-4429-b5e5-bc9885915d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:12.118822 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-cd9e939a-9089-4429-b5e5-bc9885915d98 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:31:12.121196 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-cd9e939a-9089-4429-b5e5-bc9885915d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:12.291737 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42122587-5d5a-437b-b4e3-54ce978700ed None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:12.292500 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42122587-5d5a-437b-b4e3-54ce978700ed None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:12.292848 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42122587-5d5a-437b-b4e3-54ce978700ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:12.297224 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1032/2075] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:31:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:31:12.321247 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-42122587-5d5a-437b-b4e3-54ce978700ed None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:31:12.323390 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-42122587-5d5a-437b-b4e3-54ce978700ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:12.336551 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1044/2076] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:31:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:31:12.342571 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e939a-9089-4429-b5e5-bc9885915d98 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:12.360995 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e939a-9089-4429-b5e5-bc9885915d98 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:12.370237 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a2151b-f3ad-4835-91c6-8b2162f5bc04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:12.371239 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2151b-f3ad-4835-91c6-8b2162f5bc04 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:12.371693 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2151b-f3ad-4835-91c6-8b2162f5bc04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:12.372107 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2151b-f3ad-4835-91c6-8b2162f5bc04 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:12.372988 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a2151b-f3ad-4835-91c6-8b2162f5bc04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:31:12.373442 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a2151b-f3ad-4835-91c6-8b2162f5bc04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:12.375718 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a2151b-f3ad-4835-91c6-8b2162f5bc04 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:12.391757 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1033/2077] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 01:31:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:31:12.399219 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42122587-5d5a-437b-b4e3-54ce978700ed None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:12.421475 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42122587-5d5a-437b-b4e3-54ce978700ed None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:12.428685 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c623290-930b-4b9e-aa84-be4d5b2c5822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:12.429694 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c623290-930b-4b9e-aa84-be4d5b2c5822 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:12.430180 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c623290-930b-4b9e-aa84-be4d5b2c5822 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:12.430635 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c623290-930b-4b9e-aa84-be4d5b2c5822 admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:12.431476 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c623290-930b-4b9e-aa84-be4d5b2c5822 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:12.435018 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c623290-930b-4b9e-aa84-be4d5b2c5822 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:12.477101 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a2151b-f3ad-4835-91c6-8b2162f5bc04 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:12.479644 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-e4a2151b-f3ad-4835-91c6-8b2162f5bc04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:12.499326 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a2151b-f3ad-4835-91c6-8b2162f5bc04 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:12.504631 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1045/2078] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:31:12 2022] POST /identity/v3/projects => generated 373 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 01:31:12.518543 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f80fe7-a93e-4dcb-b15f-b4005768491e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:12.519198 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f80fe7-a93e-4dcb-b15f-b4005768491e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:12.519466 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f80fe7-a93e-4dcb-b15f-b4005768491e admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:12.519907 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f80fe7-a93e-4dcb-b15f-b4005768491e admin admin] PATH_INFO: `/v3/projects/08998688cc264987baf12eb82388bb09` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:12.521249 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f80fe7-a93e-4dcb-b15f-b4005768491e admin admin] RBAC: Authorizing `identity:delete_project(project_id=08998688cc264987baf12eb82388bb09)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:12.521721 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c623290-930b-4b9e-aa84-be4d5b2c5822 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:12.523648 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f80fe7-a93e-4dcb-b15f-b4005768491e admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:12.643481 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-e7f80fe7-a93e-4dcb-b15f-b4005768491e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08998688cc264987baf12eb82388bb09', 'request_id': 'req-e7f80fe7-a93e-4dcb-b15f-b4005768491e'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:12.654397 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-e7f80fe7-a93e-4dcb-b15f-b4005768491e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08998688cc264987baf12eb82388bb09', 'request_id': 'req-e7f80fe7-a93e-4dcb-b15f-b4005768491e'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:12.662972 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-e7f80fe7-a93e-4dcb-b15f-b4005768491e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08998688cc264987baf12eb82388bb09', 'request_id': 'req-e7f80fe7-a93e-4dcb-b15f-b4005768491e'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:12.666753 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:12.683838 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-e7f80fe7-a93e-4dcb-b15f-b4005768491e admin admin] The token cache is being invalidate because project 08998688cc264987baf12eb82388bb09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:31:12.684361 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-e7f80fe7-a93e-4dcb-b15f-b4005768491e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:12.685259 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-e7f80fe7-a93e-4dcb-b15f-b4005768491e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:12.694483 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1034/2079] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:31:12 2022] DELETE /identity/v3/projects/08998688cc264987baf12eb82388bb09 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:31:12.702530 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c623290-930b-4b9e-aa84-be4d5b2c5822 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:12.768886 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:12.824763 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd6fed4-977d-4003-b036-d7f2d7230d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:12.825503 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd6fed4-977d-4003-b036-d7f2d7230d58 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:12.825845 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd6fed4-977d-4003-b036-d7f2d7230d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:12.826209 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd6fed4-977d-4003-b036-d7f2d7230d58 admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:12.826918 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd6fed4-977d-4003-b036-d7f2d7230d58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:12.828989 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd6fed4-977d-4003-b036-d7f2d7230d58 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:12.856304 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1046/2080] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:31:12 2022] POST /identity/v3/users => generated 287 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:31:12.862066 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f80fe7-a93e-4dcb-b15f-b4005768491e admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:12.864989 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-e7f80fe7-a93e-4dcb-b15f-b4005768491e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:12.886787 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f80fe7-a93e-4dcb-b15f-b4005768491e admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:12.893391 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eef923-8e6b-48ee-817a-e0443016644c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:12.894373 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eef923-8e6b-48ee-817a-e0443016644c admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:12.894867 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eef923-8e6b-48ee-817a-e0443016644c admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:12.895151 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eef923-8e6b-48ee-817a-e0443016644c admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:12.895815 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eef923-8e6b-48ee-817a-e0443016644c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:12.897700 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eef923-8e6b-48ee-817a-e0443016644c admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:12.912395 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1035/2081] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:31:12 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:31:12.916233 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd6fed4-977d-4003-b036-d7f2d7230d58 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:12.927571 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd6fed4-977d-4003-b036-d7f2d7230d58 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:12.934067 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39de1397-bc19-44da-8034-002ddd15794f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:12.934313 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de1397-bc19-44da-8034-002ddd15794f admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:12.934559 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de1397-bc19-44da-8034-002ddd15794f admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:12.934930 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de1397-bc19-44da-8034-002ddd15794f admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:12.937022 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39de1397-bc19-44da-8034-002ddd15794f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:12.938678 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39de1397-bc19-44da-8034-002ddd15794f admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:12.957687 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1047/2082] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:31:12 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:31:12.965552 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eef923-8e6b-48ee-817a-e0443016644c admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:12.992785 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eef923-8e6b-48ee-817a-e0443016644c admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:12.998021 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d81d62c-f4d8-40e5-a2f6-8af9aa4f95f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:12.998759 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81d62c-f4d8-40e5-a2f6-8af9aa4f95f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:12.999079 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81d62c-f4d8-40e5-a2f6-8af9aa4f95f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:12.999433 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81d62c-f4d8-40e5-a2f6-8af9aa4f95f9 admin admin] PATH_INFO: `/v3/projects/f4e99d6f6e5e41feb172b0220fbfd79c/users/8ed8e24eb5634ec58337aa7091c1b4b3/roles/13af81971c1c428eae0a571a22ea583d` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:13.020887 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d81d62c-f4d8-40e5-a2f6-8af9aa4f95f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4e99d6f6e5e41feb172b0220fbfd79c, user_id=8ed8e24eb5634ec58337aa7091c1b4b3, role_id=13af81971c1c428eae0a571a22ea583d)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:13.023074 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d81d62c-f4d8-40e5-a2f6-8af9aa4f95f9 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:13.039975 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1036/2083] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:31:12 2022] PUT /identity/v3/projects/f4e99d6f6e5e41feb172b0220fbfd79c/users/8ed8e24eb5634ec58337aa7091c1b4b3/roles/13af81971c1c428eae0a571a22ea583d => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:31:13.050732 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910fd1f7-02f8-492a-898d-6ad6c7b99e84 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:13.051309 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910fd1f7-02f8-492a-898d-6ad6c7b99e84 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:13.051309 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910fd1f7-02f8-492a-898d-6ad6c7b99e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:13.106064 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-910fd1f7-02f8-492a-898d-6ad6c7b99e84 None None] MFA Rules not processed for user `8ed8e24eb5634ec58337aa7091c1b4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:31:13.107895 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-910fd1f7-02f8-492a-898d-6ad6c7b99e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:13.188990 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1048/2084] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:31:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:31:13.206702 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d81d62c-f4d8-40e5-a2f6-8af9aa4f95f9 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:13.206702 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-7d81d62c-f4d8-40e5-a2f6-8af9aa4f95f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:13.269468 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d81d62c-f4d8-40e5-a2f6-8af9aa4f95f9 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:13.273440 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245fa52e-1ab5-432b-bf1a-bf5146c3705e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7853d40c29af424c8d7913950d89750b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:13.274089 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245fa52e-1ab5-432b-bf1a-bf5146c3705e service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:13.274435 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245fa52e-1ab5-432b-bf1a-bf5146c3705e service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:13.274723 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245fa52e-1ab5-432b-bf1a-bf5146c3705e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:13.284862 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245fa52e-1ab5-432b-bf1a-bf5146c3705e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:13.286795 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245fa52e-1ab5-432b-bf1a-bf5146c3705e service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:13.297550 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1037/2085] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:31:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:31:14.423362 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910fd1f7-02f8-492a-898d-6ad6c7b99e84 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:14.425825 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-910fd1f7-02f8-492a-898d-6ad6c7b99e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:14.476521 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245fa52e-1ab5-432b-bf1a-bf5146c3705e service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:14.492579 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245fa52e-1ab5-432b-bf1a-bf5146c3705e service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:14.497016 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16358a8d-12d9-48e8-937b-5ec562331fc6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7853d40c29af424c8d7913950d89750b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:14.497841 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16358a8d-12d9-48e8-937b-5ec562331fc6 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:14.498129 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16358a8d-12d9-48e8-937b-5ec562331fc6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:14.498419 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16358a8d-12d9-48e8-937b-5ec562331fc6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:14.499780 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910fd1f7-02f8-492a-898d-6ad6c7b99e84 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:14.500172 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-16358a8d-12d9-48e8-937b-5ec562331fc6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:14.504656 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bb9c2c-722a-4527-8c88-fbaa6ea8a058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:14.505280 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb9c2c-722a-4527-8c88-fbaa6ea8a058 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:14.505556 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb9c2c-722a-4527-8c88-fbaa6ea8a058 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:14.505952 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb9c2c-722a-4527-8c88-fbaa6ea8a058 admin admin] PATH_INFO: `/v3/users/f310c49470854e57a7870a0e317a2e54` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:14.507111 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bb9c2c-722a-4527-8c88-fbaa6ea8a058 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f310c49470854e57a7870a0e317a2e54)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:14.509053 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bb9c2c-722a-4527-8c88-fbaa6ea8a058 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:14.545231 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:14.564410 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-38bb9c2c-722a-4527-8c88-fbaa6ea8a058 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f310c49470854e57a7870a0e317a2e54'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:14.572355 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16358a8d-12d9-48e8-937b-5ec562331fc6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:14.574072 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16358a8d-12d9-48e8-937b-5ec562331fc6 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:14.575031 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-38bb9c2c-722a-4527-8c88-fbaa6ea8a058 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f310c49470854e57a7870a0e317a2e54'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:14.575811 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-38bb9c2c-722a-4527-8c88-fbaa6ea8a058 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f310c49470854e57a7870a0e317a2e54'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:14.584766 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1038/2086] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:31:14 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 01:31:14.585419 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-38bb9c2c-722a-4527-8c88-fbaa6ea8a058 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f310c49470854e57a7870a0e317a2e54'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:14.599324 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-38bb9c2c-722a-4527-8c88-fbaa6ea8a058 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f310c49470854e57a7870a0e317a2e54'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:14.605875 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1049/2087] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:31:14 2022] DELETE /identity/v3/users/f310c49470854e57a7870a0e317a2e54 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:31:14.766627 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f59c1-a2ac-465d-8438-54d6c07e1174 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:14.767025 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f59c1-a2ac-465d-8438-54d6c07e1174 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:14.767331 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f59c1-a2ac-465d-8438-54d6c07e1174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:14.788160 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-bd1f59c1-a2ac-465d-8438-54d6c07e1174 None None] MFA Rules not processed for user `8ed8e24eb5634ec58337aa7091c1b4b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:31:14.789439 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-bd1f59c1-a2ac-465d-8438-54d6c07e1174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:14.807457 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bb9c2c-722a-4527-8c88-fbaa6ea8a058 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:14.808725 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-38bb9c2c-722a-4527-8c88-fbaa6ea8a058 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:14.859852 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1039/2088] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:31:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:31:14.889555 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bb9c2c-722a-4527-8c88-fbaa6ea8a058 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:14.893861 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437a1c71-8b1a-4834-a54c-d048b1b9b451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:14.894631 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a1c71-8b1a-4834-a54c-d048b1b9b451 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:14.894990 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a1c71-8b1a-4834-a54c-d048b1b9b451 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:14.895265 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a1c71-8b1a-4834-a54c-d048b1b9b451 admin admin] PATH_INFO: `/v3/projects/59bf63baacb54f308e34809791f3258d` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:14.896383 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437a1c71-8b1a-4834-a54c-d048b1b9b451 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59bf63baacb54f308e34809791f3258d)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:14.898627 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437a1c71-8b1a-4834-a54c-d048b1b9b451 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:14.952072 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-437a1c71-8b1a-4834-a54c-d048b1b9b451 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59bf63baacb54f308e34809791f3258d', 'request_id': 'req-437a1c71-8b1a-4834-a54c-d048b1b9b451'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:14.958598 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-437a1c71-8b1a-4834-a54c-d048b1b9b451 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59bf63baacb54f308e34809791f3258d', 'request_id': 'req-437a1c71-8b1a-4834-a54c-d048b1b9b451'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:14.965532 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-437a1c71-8b1a-4834-a54c-d048b1b9b451 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59bf63baacb54f308e34809791f3258d', 'request_id': 'req-437a1c71-8b1a-4834-a54c-d048b1b9b451'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:14.980181 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-437a1c71-8b1a-4834-a54c-d048b1b9b451 admin admin] The token cache is being invalidate because project 59bf63baacb54f308e34809791f3258d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:31:14.980514 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-437a1c71-8b1a-4834-a54c-d048b1b9b451 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:14.981306 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-437a1c71-8b1a-4834-a54c-d048b1b9b451 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:14.983112 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1050/2089] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:31:14 2022] DELETE /identity/v3/projects/59bf63baacb54f308e34809791f3258d => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:31:14.989484 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa876836-abf5-4c33-8a9c-730b05fa9b32 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:14.989977 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa876836-abf5-4c33-8a9c-730b05fa9b32 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:14.990398 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa876836-abf5-4c33-8a9c-730b05fa9b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:14.998440 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:15.013300 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-aa876836-abf5-4c33-8a9c-730b05fa9b32 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:31:15.014531 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-aa876836-abf5-4c33-8a9c-730b05fa9b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:15.077199 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1040/2090] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:31:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:31:15.089938 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df8061-8b76-4615-bb6b-db2e5ff19be1 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:15.090271 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df8061-8b76-4615-bb6b-db2e5ff19be1 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:15.090547 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df8061-8b76-4615-bb6b-db2e5ff19be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:15.114248 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-24df8061-8b76-4615-bb6b-db2e5ff19be1 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:31:15.115674 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-24df8061-8b76-4615-bb6b-db2e5ff19be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:15.129259 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1051/2091] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:31:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:31:15.134063 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa876836-abf5-4c33-8a9c-730b05fa9b32 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:15.144671 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa876836-abf5-4c33-8a9c-730b05fa9b32 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:15.150133 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f45c61-cb9a-466b-96b3-307c4861b768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:15.150823 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f45c61-cb9a-466b-96b3-307c4861b768 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:15.151123 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f45c61-cb9a-466b-96b3-307c4861b768 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:15.151393 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f45c61-cb9a-466b-96b3-307c4861b768 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:15.152141 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f45c61-cb9a-466b-96b3-307c4861b768 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:31:15.152535 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f45c61-cb9a-466b-96b3-307c4861b768 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:15.154432 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f45c61-cb9a-466b-96b3-307c4861b768 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:15.172351 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1041/2092] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 01:31:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:31:15.173595 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24df8061-8b76-4615-bb6b-db2e5ff19be1 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:15.188365 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24df8061-8b76-4615-bb6b-db2e5ff19be1 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:15.194970 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de71d2-727c-47bc-8974-1630d5a6b245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:15.195677 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de71d2-727c-47bc-8974-1630d5a6b245 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:15.196017 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de71d2-727c-47bc-8974-1630d5a6b245 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:15.196351 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de71d2-727c-47bc-8974-1630d5a6b245 admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:15.197152 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88de71d2-727c-47bc-8974-1630d5a6b245 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:15.199171 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88de71d2-727c-47bc-8974-1630d5a6b245 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:15.237972 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1052/2093] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:31:15 2022] POST /identity/v3/projects => generated 385 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:31:15.242599 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f45c61-cb9a-466b-96b3-307c4861b768 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:15.253458 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f45c61-cb9a-466b-96b3-307c4861b768 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:15.329664 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8770b9fe-9463-4b3d-8604-29352a37176f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:15.331065 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770b9fe-9463-4b3d-8604-29352a37176f admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:15.331368 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770b9fe-9463-4b3d-8604-29352a37176f admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:15.340467 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770b9fe-9463-4b3d-8604-29352a37176f admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:15.340467 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8770b9fe-9463-4b3d-8604-29352a37176f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:15.340467 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8770b9fe-9463-4b3d-8604-29352a37176f admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:15.369369 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de71d2-727c-47bc-8974-1630d5a6b245 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:15.369647 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1042/2094] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:31:15 2022] POST /identity/v3/users => generated 293 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:31:15.381583 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de71d2-727c-47bc-8974-1630d5a6b245 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:15.394696 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec04e43f-836e-4c0f-b3bb-638ab932c5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:15.395451 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04e43f-836e-4c0f-b3bb-638ab932c5eb admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:15.395728 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04e43f-836e-4c0f-b3bb-638ab932c5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:15.395994 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04e43f-836e-4c0f-b3bb-638ab932c5eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:15.396643 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec04e43f-836e-4c0f-b3bb-638ab932c5eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:15.398463 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec04e43f-836e-4c0f-b3bb-638ab932c5eb admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:15.407119 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:15.420314 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1053/2095] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:31:15 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:31:15.425922 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8770b9fe-9463-4b3d-8604-29352a37176f admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:15.440550 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8770b9fe-9463-4b3d-8604-29352a37176f admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:15.446959 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b106af-5b51-4dd6-9a91-3ee490925f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:15.447851 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b106af-5b51-4dd6-9a91-3ee490925f42 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:15.448409 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b106af-5b51-4dd6-9a91-3ee490925f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:15.448798 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b106af-5b51-4dd6-9a91-3ee490925f42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:15.449649 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b106af-5b51-4dd6-9a91-3ee490925f42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:15.451644 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b106af-5b51-4dd6-9a91-3ee490925f42 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:15.466398 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1043/2096] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:31:15 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:31:15.471465 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec04e43f-836e-4c0f-b3bb-638ab932c5eb admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:15.484003 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec04e43f-836e-4c0f-b3bb-638ab932c5eb admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:15.494241 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cdcc97-1619-466b-b872-a0cf70f95c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:15.494623 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cdcc97-1619-466b-b872-a0cf70f95c6b admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:15.494997 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cdcc97-1619-466b-b872-a0cf70f95c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:15.495280 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cdcc97-1619-466b-b872-a0cf70f95c6b admin admin] PATH_INFO: `/v3/projects/be9bdeb95d8f4d94a9d85bd75d3f0a83/users/9168dfcbc0ab484d982dbbe5f013c79d/roles/13af81971c1c428eae0a571a22ea583d` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:15.512343 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cdcc97-1619-466b-b872-a0cf70f95c6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=be9bdeb95d8f4d94a9d85bd75d3f0a83, user_id=9168dfcbc0ab484d982dbbe5f013c79d, role_id=13af81971c1c428eae0a571a22ea583d)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:15.515040 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cdcc97-1619-466b-b872-a0cf70f95c6b admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:15.537292 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1054/2097] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:31:15 2022] PUT /identity/v3/projects/be9bdeb95d8f4d94a9d85bd75d3f0a83/users/9168dfcbc0ab484d982dbbe5f013c79d/roles/13af81971c1c428eae0a571a22ea583d => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:31:15.550041 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfe94c-5a56-48b9-951d-305575ee119f None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:15.550547 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfe94c-5a56-48b9-951d-305575ee119f None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:15.550735 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfe94c-5a56-48b9-951d-305575ee119f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:15.589087 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-1acfe94c-5a56-48b9-951d-305575ee119f None None] MFA Rules not processed for user `9168dfcbc0ab484d982dbbe5f013c79d`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:31:15.590744 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-1acfe94c-5a56-48b9-951d-305575ee119f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:15.672083 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:15.683876 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1044/2098] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:31:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:31:15.684543 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cdcc97-1619-466b-b872-a0cf70f95c6b admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:15.766237 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cdcc97-1619-466b-b872-a0cf70f95c6b admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:15.775178 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7c60d0-1de5-4bc0-8526-c6e61084b7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:15.775793 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c60d0-1de5-4bc0-8526-c6e61084b7e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:15.776089 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c60d0-1de5-4bc0-8526-c6e61084b7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:15.776562 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c60d0-1de5-4bc0-8526-c6e61084b7e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:15.777198 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7c60d0-1de5-4bc0-8526-c6e61084b7e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:15.784243 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7c60d0-1de5-4bc0-8526-c6e61084b7e6 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:15.843159 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1055/2099] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:31:15 2022] POST /identity/v3/projects => generated 387 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 01:31:15.844673 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acfe94c-5a56-48b9-951d-305575ee119f None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:15.856637 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acfe94c-5a56-48b9-951d-305575ee119f None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:15.920429 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c203163-df8c-49c0-a98c-df66196bc62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:15.921045 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c203163-df8c-49c0-a98c-df66196bc62e admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:15.921340 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c203163-df8c-49c0-a98c-df66196bc62e admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:15.921588 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c203163-df8c-49c0-a98c-df66196bc62e admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:15.922506 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c203163-df8c-49c0-a98c-df66196bc62e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:15.924937 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c203163-df8c-49c0-a98c-df66196bc62e admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:15.948134 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1045/2100] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:31:15 2022] POST /identity/v3/users => generated 294 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:31:15.952125 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7c60d0-1de5-4bc0-8526-c6e61084b7e6 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:15.964149 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7c60d0-1de5-4bc0-8526-c6e61084b7e6 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:15.969460 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13287772-2f66-4317-b55c-5d4121d75fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:15.970298 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13287772-2f66-4317-b55c-5d4121d75fa6 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:15.970590 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13287772-2f66-4317-b55c-5d4121d75fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:15.970920 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13287772-2f66-4317-b55c-5d4121d75fa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:15.971646 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13287772-2f66-4317-b55c-5d4121d75fa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:15.973463 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13287772-2f66-4317-b55c-5d4121d75fa6 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:15.984835 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1056/2101] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:31:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:31:15.989551 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c203163-df8c-49c0-a98c-df66196bc62e admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:15.999811 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c203163-df8c-49c0-a98c-df66196bc62e admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:16.005644 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712e1c17-6349-4e60-916d-7531524b6212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:16.006284 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e1c17-6349-4e60-916d-7531524b6212 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:16.006542 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e1c17-6349-4e60-916d-7531524b6212 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:16.006816 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e1c17-6349-4e60-916d-7531524b6212 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:16.007471 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712e1c17-6349-4e60-916d-7531524b6212 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:16.009092 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712e1c17-6349-4e60-916d-7531524b6212 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:16.024902 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1046/2102] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:31:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 01:31:16.026907 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13287772-2f66-4317-b55c-5d4121d75fa6 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:16.039537 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13287772-2f66-4317-b55c-5d4121d75fa6 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:16.044800 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6aedd5-6299-418b-bb93-c69cd196ebb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:16.045460 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6aedd5-6299-418b-bb93-c69cd196ebb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:16.045737 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6aedd5-6299-418b-bb93-c69cd196ebb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:16.046027 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6aedd5-6299-418b-bb93-c69cd196ebb6 admin admin] PATH_INFO: `/v3/projects/1587e991d7c2440d9b0418344aa1956a/users/da31dfdb0a264222bfe9d2e7aac025c5/roles/13af81971c1c428eae0a571a22ea583d` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:16.061343 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6aedd5-6299-418b-bb93-c69cd196ebb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1587e991d7c2440d9b0418344aa1956a, user_id=da31dfdb0a264222bfe9d2e7aac025c5, role_id=13af81971c1c428eae0a571a22ea583d)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:16.064180 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6aedd5-6299-418b-bb93-c69cd196ebb6 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:16.078652 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1057/2103] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:31:16 2022] PUT /identity/v3/projects/1587e991d7c2440d9b0418344aa1956a/users/da31dfdb0a264222bfe9d2e7aac025c5/roles/13af81971c1c428eae0a571a22ea583d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:31:16.090055 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f123ddd-2a52-4a26-8042-e21eb640ac93 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:16.090362 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f123ddd-2a52-4a26-8042-e21eb640ac93 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:16.090662 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f123ddd-2a52-4a26-8042-e21eb640ac93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:16.121254 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-4f123ddd-2a52-4a26-8042-e21eb640ac93 None None] MFA Rules not processed for user `da31dfdb0a264222bfe9d2e7aac025c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:31:16.122509 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-4f123ddd-2a52-4a26-8042-e21eb640ac93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:16.194703 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1047/2104] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:31:16 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:31:16.200227 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6aedd5-6299-418b-bb93-c69cd196ebb6 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:16.272814 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6aedd5-6299-418b-bb93-c69cd196ebb6 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:16.278923 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a74a0d-4f2f-4b9a-9c44-84a16ad15e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:16.279654 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a74a0d-4f2f-4b9a-9c44-84a16ad15e6d admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:16.280019 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a74a0d-4f2f-4b9a-9c44-84a16ad15e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:16.280354 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a74a0d-4f2f-4b9a-9c44-84a16ad15e6d admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:16.281150 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a74a0d-4f2f-4b9a-9c44-84a16ad15e6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:16.283697 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a74a0d-4f2f-4b9a-9c44-84a16ad15e6d admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:16.314450 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1058/2105] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:31:16 2022] POST /identity/v3/projects => generated 387 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:31:16.319224 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f123ddd-2a52-4a26-8042-e21eb640ac93 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:16.330683 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f123ddd-2a52-4a26-8042-e21eb640ac93 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:16.392285 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777c3408-dadd-488b-bf1c-445e74c86a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:16.392846 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c3408-dadd-488b-bf1c-445e74c86a91 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:16.393278 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c3408-dadd-488b-bf1c-445e74c86a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:16.394065 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c3408-dadd-488b-bf1c-445e74c86a91 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:16.394477 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777c3408-dadd-488b-bf1c-445e74c86a91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:16.396331 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777c3408-dadd-488b-bf1c-445e74c86a91 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:16.410088 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:16.422426 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1048/2106] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:31:16 2022] POST /identity/v3/users => generated 300 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:31:16.426881 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a74a0d-4f2f-4b9a-9c44-84a16ad15e6d admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:16.437260 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a74a0d-4f2f-4b9a-9c44-84a16ad15e6d admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:16.441974 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1da8f3-af7c-4701-ae96-de886368407d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:16.442716 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1da8f3-af7c-4701-ae96-de886368407d admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:16.443191 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1da8f3-af7c-4701-ae96-de886368407d admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:16.443501 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1da8f3-af7c-4701-ae96-de886368407d admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:16.444241 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1da8f3-af7c-4701-ae96-de886368407d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:16.445918 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1da8f3-af7c-4701-ae96-de886368407d admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:16.451725 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:16.459106 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1059/2107] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:31:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:31:16.464244 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777c3408-dadd-488b-bf1c-445e74c86a91 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:16.477621 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777c3408-dadd-488b-bf1c-445e74c86a91 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:16.483449 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f6b132-c160-476a-9325-9a6fd9ed8f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:16.484233 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f6b132-c160-476a-9325-9a6fd9ed8f6a admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:16.484537 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f6b132-c160-476a-9325-9a6fd9ed8f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:16.484826 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f6b132-c160-476a-9325-9a6fd9ed8f6a admin admin] PATH_INFO: `/v3/projects/0af747adb2fe45cabc677de2ff2d35d8/users/0927941670ab422dbb678d96f5a9b181/roles/fb48693810be495fb4b1893a79429b78` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:16.504034 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f6b132-c160-476a-9325-9a6fd9ed8f6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0af747adb2fe45cabc677de2ff2d35d8, user_id=0927941670ab422dbb678d96f5a9b181, role_id=fb48693810be495fb4b1893a79429b78)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:16.507109 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f6b132-c160-476a-9325-9a6fd9ed8f6a admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:16.522623 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1049/2108] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:31:16 2022] PUT /identity/v3/projects/0af747adb2fe45cabc677de2ff2d35d8/users/0927941670ab422dbb678d96f5a9b181/roles/fb48693810be495fb4b1893a79429b78 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 01:31:16.527508 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1da8f3-af7c-4701-ae96-de886368407d admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:16.540062 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1da8f3-af7c-4701-ae96-de886368407d admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:16.608701 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1916814c-5504-49a6-b3bf-7987e124a2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:16.609229 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916814c-5504-49a6-b3bf-7987e124a2b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:16.609496 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916814c-5504-49a6-b3bf-7987e124a2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:16.609769 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916814c-5504-49a6-b3bf-7987e124a2b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:16.610433 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1916814c-5504-49a6-b3bf-7987e124a2b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:16.612155 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1916814c-5504-49a6-b3bf-7987e124a2b2 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:16.622055 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1060/2109] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:31:16 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:31:16.627104 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f6b132-c160-476a-9325-9a6fd9ed8f6a admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:16.638423 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f6b132-c160-476a-9325-9a6fd9ed8f6a admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:16.643882 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcfc2d2-d7ca-4809-854b-57234d7bc144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:16.644557 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcfc2d2-d7ca-4809-854b-57234d7bc144 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:16.644838 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcfc2d2-d7ca-4809-854b-57234d7bc144 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:16.645112 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcfc2d2-d7ca-4809-854b-57234d7bc144 admin admin] PATH_INFO: `/v3/projects/0af747adb2fe45cabc677de2ff2d35d8/users/0927941670ab422dbb678d96f5a9b181/roles/fb48693810be495fb4b1893a79429b78` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:16.647180 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcfc2d2-d7ca-4809-854b-57234d7bc144 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0af747adb2fe45cabc677de2ff2d35d8, user_id=0927941670ab422dbb678d96f5a9b181, role_id=fb48693810be495fb4b1893a79429b78)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:16.649828 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcfc2d2-d7ca-4809-854b-57234d7bc144 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:16.661323 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1050/2110] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:31:16 2022] PUT /identity/v3/projects/0af747adb2fe45cabc677de2ff2d35d8/users/0927941670ab422dbb678d96f5a9b181/roles/fb48693810be495fb4b1893a79429b78 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:31:16.672564 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f90115-15bd-4dbd-a7cf-2aaa19f6451a None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:16.672854 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f90115-15bd-4dbd-a7cf-2aaa19f6451a None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:16.673116 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f90115-15bd-4dbd-a7cf-2aaa19f6451a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:16.715808 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-69f90115-15bd-4dbd-a7cf-2aaa19f6451a None None] MFA Rules not processed for user `0927941670ab422dbb678d96f5a9b181`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:31:16.717239 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-69f90115-15bd-4dbd-a7cf-2aaa19f6451a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:16.824070 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1061/2111] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:31:16 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:31:16.835548 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcfc2d2-d7ca-4809-854b-57234d7bc144 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:16.838142 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-abcfc2d2-d7ca-4809-854b-57234d7bc144 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:16.899374 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcfc2d2-d7ca-4809-854b-57234d7bc144 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:16.903077 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b4573c-7604-47e6-bc1a-cbfe2919feff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7853d40c29af424c8d7913950d89750b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:16.903685 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4573c-7604-47e6-bc1a-cbfe2919feff service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:16.903962 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4573c-7604-47e6-bc1a-cbfe2919feff service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:16.904232 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4573c-7604-47e6-bc1a-cbfe2919feff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:16.914773 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b4573c-7604-47e6-bc1a-cbfe2919feff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:16.916226 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b4573c-7604-47e6-bc1a-cbfe2919feff service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:16.926376 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1051/2112] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:31:16 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:31:17.517210 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f90115-15bd-4dbd-a7cf-2aaa19f6451a None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:17.518652 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-69f90115-15bd-4dbd-a7cf-2aaa19f6451a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:17.530570 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f90115-15bd-4dbd-a7cf-2aaa19f6451a None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:17.534289 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab3281a-0abc-4552-962d-89b5fa2eed46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7853d40c29af424c8d7913950d89750b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:17.534884 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab3281a-0abc-4552-962d-89b5fa2eed46 service cinder] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:17.535156 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab3281a-0abc-4552-962d-89b5fa2eed46 service cinder] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:17.535423 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab3281a-0abc-4552-962d-89b5fa2eed46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:17.606473 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab3281a-0abc-4552-962d-89b5fa2eed46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:17.607907 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab3281a-0abc-4552-962d-89b5fa2eed46 service cinder] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:17.617839 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1062/2113] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:31:17 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:31:21.980802 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b4573c-7604-47e6-bc1a-cbfe2919feff service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:21.993628 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b4573c-7604-47e6-bc1a-cbfe2919feff service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:22.004392 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a773a8-4c92-4c75-a02f-6e352087743c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7853d40c29af424c8d7913950d89750b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:22.005416 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a773a8-4c92-4c75-a02f-6e352087743c service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:22.005764 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a773a8-4c92-4c75-a02f-6e352087743c service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:22.006066 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a773a8-4c92-4c75-a02f-6e352087743c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:22.106549 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a773a8-4c92-4c75-a02f-6e352087743c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:22.108242 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a773a8-4c92-4c75-a02f-6e352087743c service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:22.131964 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1052/2114] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:31:21 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:31:24.404015 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab3281a-0abc-4552-962d-89b5fa2eed46 service cinder] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:24.425257 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:24.471725 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab3281a-0abc-4552-962d-89b5fa2eed46 service cinder] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:24.476566 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b8d06c-6611-47b4-881b-2ed37ba52ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:24.477215 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b8d06c-6611-47b4-881b-2ed37ba52ace admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:24.477492 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b8d06c-6611-47b4-881b-2ed37ba52ace admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:24.477768 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b8d06c-6611-47b4-881b-2ed37ba52ace admin admin] PATH_INFO: `/v3/users/9168dfcbc0ab484d982dbbe5f013c79d` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:24.481542 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b8d06c-6611-47b4-881b-2ed37ba52ace admin admin] RBAC: Authorizing `identity:delete_user(user_id=9168dfcbc0ab484d982dbbe5f013c79d)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:24.483520 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b8d06c-6611-47b4-881b-2ed37ba52ace admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:24.534430 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-e5b8d06c-6611-47b4-881b-2ed37ba52ace admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9168dfcbc0ab484d982dbbe5f013c79d'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:24.544471 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-e5b8d06c-6611-47b4-881b-2ed37ba52ace admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9168dfcbc0ab484d982dbbe5f013c79d'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:24.545623 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-e5b8d06c-6611-47b4-881b-2ed37ba52ace admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9168dfcbc0ab484d982dbbe5f013c79d'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:24.557786 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-e5b8d06c-6611-47b4-881b-2ed37ba52ace admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9168dfcbc0ab484d982dbbe5f013c79d'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:24.574397 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-e5b8d06c-6611-47b4-881b-2ed37ba52ace admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9168dfcbc0ab484d982dbbe5f013c79d'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:24.580693 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1063/2115] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:31:24 2022] DELETE /identity/v3/users/9168dfcbc0ab484d982dbbe5f013c79d => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:31:24.585306 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b54831-dffd-4cf0-ab9f-f02a8291831e None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:24.585888 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b54831-dffd-4cf0-ab9f-f02a8291831e None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:24.585888 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b54831-dffd-4cf0-ab9f-f02a8291831e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:24.606262 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-62b54831-dffd-4cf0-ab9f-f02a8291831e None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:31:24.607447 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-62b54831-dffd-4cf0-ab9f-f02a8291831e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:24.659585 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:24.674169 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1053/2116] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:31:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:31:24.685373 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b8d06c-6611-47b4-881b-2ed37ba52ace admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:24.687227 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-e5b8d06c-6611-47b4-881b-2ed37ba52ace admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:24.751624 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b8d06c-6611-47b4-881b-2ed37ba52ace admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:24.755304 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44871717-7e6a-416e-bd48-2930ce08ae44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:24.756034 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44871717-7e6a-416e-bd48-2930ce08ae44 service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:24.756157 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44871717-7e6a-416e-bd48-2930ce08ae44 service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:24.756435 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44871717-7e6a-416e-bd48-2930ce08ae44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:24.770049 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44871717-7e6a-416e-bd48-2930ce08ae44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:24.771527 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44871717-7e6a-416e-bd48-2930ce08ae44 service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:24.781083 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1064/2117] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:31:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:31:25.125941 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b54831-dffd-4cf0-ab9f-f02a8291831e None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:25.127436 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-62b54831-dffd-4cf0-ab9f-f02a8291831e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:25.143633 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b54831-dffd-4cf0-ab9f-f02a8291831e None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:25.150024 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5343bbb9-fdf9-4d42-875b-49e868061f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:25.150851 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5343bbb9-fdf9-4d42-875b-49e868061f84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:25.151166 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5343bbb9-fdf9-4d42-875b-49e868061f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:25.151451 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5343bbb9-fdf9-4d42-875b-49e868061f84 admin admin] PATH_INFO: `/v3/projects/be9bdeb95d8f4d94a9d85bd75d3f0a83` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:25.152723 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5343bbb9-fdf9-4d42-875b-49e868061f84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be9bdeb95d8f4d94a9d85bd75d3f0a83)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:25.155042 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5343bbb9-fdf9-4d42-875b-49e868061f84 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:25.215410 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-5343bbb9-fdf9-4d42-875b-49e868061f84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be9bdeb95d8f4d94a9d85bd75d3f0a83', 'request_id': 'req-5343bbb9-fdf9-4d42-875b-49e868061f84'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:25.223882 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-5343bbb9-fdf9-4d42-875b-49e868061f84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be9bdeb95d8f4d94a9d85bd75d3f0a83', 'request_id': 'req-5343bbb9-fdf9-4d42-875b-49e868061f84'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:25.230256 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-5343bbb9-fdf9-4d42-875b-49e868061f84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be9bdeb95d8f4d94a9d85bd75d3f0a83', 'request_id': 'req-5343bbb9-fdf9-4d42-875b-49e868061f84'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:25.241661 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-5343bbb9-fdf9-4d42-875b-49e868061f84 admin admin] The token cache is being invalidate because project be9bdeb95d8f4d94a9d85bd75d3f0a83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:31:25.241906 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-5343bbb9-fdf9-4d42-875b-49e868061f84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:25.242634 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-5343bbb9-fdf9-4d42-875b-49e868061f84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:25.244139 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1054/2118] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:31:25 2022] DELETE /identity/v3/projects/be9bdeb95d8f4d94a9d85bd75d3f0a83 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:31:25.248991 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44871717-7e6a-416e-bd48-2930ce08ae44 service neutron] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:25.260664 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44871717-7e6a-416e-bd48-2930ce08ae44 service neutron] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:25.301167 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:25.319721 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb20e3b-0cbb-4840-8dd9-d2d23c94902e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:25.320366 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb20e3b-0cbb-4840-8dd9-d2d23c94902e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:25.320665 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb20e3b-0cbb-4840-8dd9-d2d23c94902e admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:25.320916 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb20e3b-0cbb-4840-8dd9-d2d23c94902e admin admin] PATH_INFO: `/v3/users/da31dfdb0a264222bfe9d2e7aac025c5` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:25.322105 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb20e3b-0cbb-4840-8dd9-d2d23c94902e admin admin] RBAC: Authorizing `identity:delete_user(user_id=da31dfdb0a264222bfe9d2e7aac025c5)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:25.324496 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb20e3b-0cbb-4840-8dd9-d2d23c94902e admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:25.374528 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-4fb20e3b-0cbb-4840-8dd9-d2d23c94902e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da31dfdb0a264222bfe9d2e7aac025c5'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:25.383967 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-4fb20e3b-0cbb-4840-8dd9-d2d23c94902e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da31dfdb0a264222bfe9d2e7aac025c5'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:25.384571 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-4fb20e3b-0cbb-4840-8dd9-d2d23c94902e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da31dfdb0a264222bfe9d2e7aac025c5'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:25.393530 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-4fb20e3b-0cbb-4840-8dd9-d2d23c94902e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da31dfdb0a264222bfe9d2e7aac025c5'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:25.406219 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-4fb20e3b-0cbb-4840-8dd9-d2d23c94902e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da31dfdb0a264222bfe9d2e7aac025c5'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:25.412994 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1065/2119] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:31:25 2022] DELETE /identity/v3/users/da31dfdb0a264222bfe9d2e7aac025c5 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:31:25.795763 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5343bbb9-fdf9-4d42-875b-49e868061f84 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:25.797537 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-5343bbb9-fdf9-4d42-875b-49e868061f84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:25.814290 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5343bbb9-fdf9-4d42-875b-49e868061f84 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:25.889172 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013516ed-eb34-42f1-b8a6-a064e1b59010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:25.889949 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013516ed-eb34-42f1-b8a6-a064e1b59010 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:25.890264 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013516ed-eb34-42f1-b8a6-a064e1b59010 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:25.890526 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013516ed-eb34-42f1-b8a6-a064e1b59010 admin admin] PATH_INFO: `/v3/projects/1587e991d7c2440d9b0418344aa1956a` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:25.892169 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013516ed-eb34-42f1-b8a6-a064e1b59010 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1587e991d7c2440d9b0418344aa1956a)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:25.894251 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013516ed-eb34-42f1-b8a6-a064e1b59010 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:25.965341 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-013516ed-eb34-42f1-b8a6-a064e1b59010 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1587e991d7c2440d9b0418344aa1956a', 'request_id': 'req-013516ed-eb34-42f1-b8a6-a064e1b59010'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:25.976068 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-013516ed-eb34-42f1-b8a6-a064e1b59010 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1587e991d7c2440d9b0418344aa1956a', 'request_id': 'req-013516ed-eb34-42f1-b8a6-a064e1b59010'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:25.992025 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-013516ed-eb34-42f1-b8a6-a064e1b59010 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1587e991d7c2440d9b0418344aa1956a', 'request_id': 'req-013516ed-eb34-42f1-b8a6-a064e1b59010'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:26.005884 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-013516ed-eb34-42f1-b8a6-a064e1b59010 admin admin] The token cache is being invalidate because project 1587e991d7c2440d9b0418344aa1956a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:31:26.005884 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-013516ed-eb34-42f1-b8a6-a064e1b59010 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:26.008061 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-013516ed-eb34-42f1-b8a6-a064e1b59010 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:26.009804 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1055/2120] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:31:25 2022] DELETE /identity/v3/projects/1587e991d7c2440d9b0418344aa1956a => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:31:26.013911 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb20e3b-0cbb-4840-8dd9-d2d23c94902e admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:26.017074 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-4fb20e3b-0cbb-4840-8dd9-d2d23c94902e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:26.035088 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb20e3b-0cbb-4840-8dd9-d2d23c94902e admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:26.119546 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bc3794-ab23-4188-b0f4-2f63ab8a5046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:26.120454 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc3794-ab23-4188-b0f4-2f63ab8a5046 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:26.120793 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc3794-ab23-4188-b0f4-2f63ab8a5046 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:26.121082 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc3794-ab23-4188-b0f4-2f63ab8a5046 admin admin] PATH_INFO: `/v3/users/0927941670ab422dbb678d96f5a9b181` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:26.122713 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bc3794-ab23-4188-b0f4-2f63ab8a5046 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0927941670ab422dbb678d96f5a9b181)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:26.126826 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bc3794-ab23-4188-b0f4-2f63ab8a5046 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:26.194252 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-40bc3794-ab23-4188-b0f4-2f63ab8a5046 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0927941670ab422dbb678d96f5a9b181'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:26.232601 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-40bc3794-ab23-4188-b0f4-2f63ab8a5046 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0927941670ab422dbb678d96f5a9b181'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:26.233632 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-40bc3794-ab23-4188-b0f4-2f63ab8a5046 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0927941670ab422dbb678d96f5a9b181'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:26.248460 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-40bc3794-ab23-4188-b0f4-2f63ab8a5046 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0927941670ab422dbb678d96f5a9b181'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:26.249885 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:26.274506 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-40bc3794-ab23-4188-b0f4-2f63ab8a5046 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0927941670ab422dbb678d96f5a9b181'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:26.280344 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1066/2121] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:31:26 2022] DELETE /identity/v3/users/0927941670ab422dbb678d96f5a9b181 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:31:26.567568 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013516ed-eb34-42f1-b8a6-a064e1b59010 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:26.569141 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-013516ed-eb34-42f1-b8a6-a064e1b59010 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:26.584664 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013516ed-eb34-42f1-b8a6-a064e1b59010 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:26.595050 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:26.654414 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae3a337-ae45-44b3-b5b0-1c410afc5bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:26.655082 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3a337-ae45-44b3-b5b0-1c410afc5bad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:26.655361 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3a337-ae45-44b3-b5b0-1c410afc5bad admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:26.655625 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3a337-ae45-44b3-b5b0-1c410afc5bad admin admin] PATH_INFO: `/v3/projects/0af747adb2fe45cabc677de2ff2d35d8` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:26.656780 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae3a337-ae45-44b3-b5b0-1c410afc5bad admin admin] RBAC: Authorizing `identity:delete_project(project_id=0af747adb2fe45cabc677de2ff2d35d8)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:26.659356 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae3a337-ae45-44b3-b5b0-1c410afc5bad admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:26.710859 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-5ae3a337-ae45-44b3-b5b0-1c410afc5bad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0af747adb2fe45cabc677de2ff2d35d8', 'request_id': 'req-5ae3a337-ae45-44b3-b5b0-1c410afc5bad'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:26.720006 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-5ae3a337-ae45-44b3-b5b0-1c410afc5bad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0af747adb2fe45cabc677de2ff2d35d8', 'request_id': 'req-5ae3a337-ae45-44b3-b5b0-1c410afc5bad'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:26.727615 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-5ae3a337-ae45-44b3-b5b0-1c410afc5bad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0af747adb2fe45cabc677de2ff2d35d8', 'request_id': 'req-5ae3a337-ae45-44b3-b5b0-1c410afc5bad'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:26.740465 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-5ae3a337-ae45-44b3-b5b0-1c410afc5bad admin admin] The token cache is being invalidate because project 0af747adb2fe45cabc677de2ff2d35d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:31:26.740657 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-5ae3a337-ae45-44b3-b5b0-1c410afc5bad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:26.741968 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-5ae3a337-ae45-44b3-b5b0-1c410afc5bad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:26.743227 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1056/2122] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:31:26 2022] DELETE /identity/v3/projects/0af747adb2fe45cabc677de2ff2d35d8 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:31:26.749070 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90926ce-7679-43bf-83d9-68f15083cba7 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:26.749569 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90926ce-7679-43bf-83d9-68f15083cba7 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:26.749643 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90926ce-7679-43bf-83d9-68f15083cba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:26.772189 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-c90926ce-7679-43bf-83d9-68f15083cba7 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:31:26.773412 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-c90926ce-7679-43bf-83d9-68f15083cba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:26.837959 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1067/2123] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:31:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:31:26.846847 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405fb3a-c3c2-4c17-94aa-6451caa38ceb None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:26.847354 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405fb3a-c3c2-4c17-94aa-6451caa38ceb None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:26.847449 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405fb3a-c3c2-4c17-94aa-6451caa38ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:26.870997 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-d405fb3a-c3c2-4c17-94aa-6451caa38ceb None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:31:26.872265 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d405fb3a-c3c2-4c17-94aa-6451caa38ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:26.881910 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1057/2124] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:31:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:31:26.886296 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90926ce-7679-43bf-83d9-68f15083cba7 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:26.896849 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90926ce-7679-43bf-83d9-68f15083cba7 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:26.901380 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d0da00-6d12-428f-a67a-11e009c96093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:26.902008 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0da00-6d12-428f-a67a-11e009c96093 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:26.902316 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0da00-6d12-428f-a67a-11e009c96093 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:26.902585 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0da00-6d12-428f-a67a-11e009c96093 admin admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:26.903249 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d0da00-6d12-428f-a67a-11e009c96093 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:31:26.903554 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d0da00-6d12-428f-a67a-11e009c96093 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:26.905161 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d0da00-6d12-428f-a67a-11e009c96093 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:26.917039 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1068/2125] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 01:31:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:31:26.921352 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d405fb3a-c3c2-4c17-94aa-6451caa38ceb None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:26.931790 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d405fb3a-c3c2-4c17-94aa-6451caa38ceb None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:26.937853 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd916352-8891-40a0-a1b3-34249087b1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:26.938652 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd916352-8891-40a0-a1b3-34249087b1e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:26.939026 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd916352-8891-40a0-a1b3-34249087b1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:26.939297 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd916352-8891-40a0-a1b3-34249087b1e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:26.939933 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd916352-8891-40a0-a1b3-34249087b1e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:26.941998 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd916352-8891-40a0-a1b3-34249087b1e4 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:26.973358 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1058/2126] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:31:26 2022] POST /identity/v3/projects => generated 401 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 01:31:26.977587 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d0da00-6d12-428f-a67a-11e009c96093 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:26.987821 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d0da00-6d12-428f-a67a-11e009c96093 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:27.055594 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c495c8-b9e9-4d0f-9cc5-7d90e052c444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:27.056132 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c495c8-b9e9-4d0f-9cc5-7d90e052c444 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:27.056407 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c495c8-b9e9-4d0f-9cc5-7d90e052c444 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:27.056682 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c495c8-b9e9-4d0f-9cc5-7d90e052c444 admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:27.057335 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c495c8-b9e9-4d0f-9cc5-7d90e052c444 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:27.059320 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c495c8-b9e9-4d0f-9cc5-7d90e052c444 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:27.084535 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1069/2127] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:31:26 2022] POST /identity/v3/users => generated 301 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:31:27.089042 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd916352-8891-40a0-a1b3-34249087b1e4 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:27.099800 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd916352-8891-40a0-a1b3-34249087b1e4 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:27.104512 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5d6efb-28d1-4499-a9ca-4f15c77f67a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:27.105142 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d6efb-28d1-4499-a9ca-4f15c77f67a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:27.105417 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d6efb-28d1-4499-a9ca-4f15c77f67a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:27.105687 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d6efb-28d1-4499-a9ca-4f15c77f67a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:27.106449 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5d6efb-28d1-4499-a9ca-4f15c77f67a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:27.107937 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5d6efb-28d1-4499-a9ca-4f15c77f67a5 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:27.118234 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1059/2128] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:31:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:31:27.122333 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c495c8-b9e9-4d0f-9cc5-7d90e052c444 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:27.132619 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c495c8-b9e9-4d0f-9cc5-7d90e052c444 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:27.137282 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9b0ad2-6e16-4604-9100-74279979777f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:27.137889 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b0ad2-6e16-4604-9100-74279979777f admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:27.138207 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b0ad2-6e16-4604-9100-74279979777f admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:27.138485 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b0ad2-6e16-4604-9100-74279979777f admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:27.139153 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9b0ad2-6e16-4604-9100-74279979777f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:27.140755 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9b0ad2-6e16-4604-9100-74279979777f admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:27.151793 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1070/2129] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:31:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:31:27.156078 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5d6efb-28d1-4499-a9ca-4f15c77f67a5 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:27.166719 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5d6efb-28d1-4499-a9ca-4f15c77f67a5 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:27.171830 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53aaa01-2d1a-4412-940e-1f939b7d7c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:27.172485 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53aaa01-2d1a-4412-940e-1f939b7d7c4e admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:27.172802 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53aaa01-2d1a-4412-940e-1f939b7d7c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:27.173252 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53aaa01-2d1a-4412-940e-1f939b7d7c4e admin admin] PATH_INFO: `/v3/projects/69f9acaa64e74dd4be5f28e41d12f7ec/users/b1129aa982da43978edbdbdae3f9583f/roles/13af81971c1c428eae0a571a22ea583d` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:27.187943 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53aaa01-2d1a-4412-940e-1f939b7d7c4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=69f9acaa64e74dd4be5f28e41d12f7ec, user_id=b1129aa982da43978edbdbdae3f9583f, role_id=13af81971c1c428eae0a571a22ea583d)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:27.190781 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53aaa01-2d1a-4412-940e-1f939b7d7c4e admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:27.206943 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1060/2130] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:31:27 2022] PUT /identity/v3/projects/69f9acaa64e74dd4be5f28e41d12f7ec/users/b1129aa982da43978edbdbdae3f9583f/roles/13af81971c1c428eae0a571a22ea583d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 01:31:27.219571 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67cdfd-6f56-4b31-9166-1688437318bd None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:27.219927 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67cdfd-6f56-4b31-9166-1688437318bd None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:27.220202 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67cdfd-6f56-4b31-9166-1688437318bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:27.252407 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-7f67cdfd-6f56-4b31-9166-1688437318bd None None] MFA Rules not processed for user `b1129aa982da43978edbdbdae3f9583f`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:31:27.253637 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-7f67cdfd-6f56-4b31-9166-1688437318bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:27.293811 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:27.335655 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1071/2131] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:31:27 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:31:27.340439 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53aaa01-2d1a-4412-940e-1f939b7d7c4e admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:27.393255 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:27.428464 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53aaa01-2d1a-4412-940e-1f939b7d7c4e admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:27.433823 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02cd1c1-a1a6-4d60-8c4e-db8c690826e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:27.434497 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02cd1c1-a1a6-4d60-8c4e-db8c690826e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:27.434768 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02cd1c1-a1a6-4d60-8c4e-db8c690826e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:27.435035 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02cd1c1-a1a6-4d60-8c4e-db8c690826e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:27.435672 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02cd1c1-a1a6-4d60-8c4e-db8c690826e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:27.437630 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02cd1c1-a1a6-4d60-8c4e-db8c690826e1 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:27.478416 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1061/2132] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:31:27 2022] POST /identity/v3/projects => generated 399 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:31:27.478536 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f67cdfd-6f56-4b31-9166-1688437318bd None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:27.495497 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f67cdfd-6f56-4b31-9166-1688437318bd None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:27.568620 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f24e6-6a11-451b-888a-af56fc0906fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:27.569231 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f24e6-6a11-451b-888a-af56fc0906fd admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:27.569504 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f24e6-6a11-451b-888a-af56fc0906fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:27.569808 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f24e6-6a11-451b-888a-af56fc0906fd admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:27.570524 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9f24e6-6a11-451b-888a-af56fc0906fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:27.572497 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9f24e6-6a11-451b-888a-af56fc0906fd admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:27.598571 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1072/2133] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:31:27 2022] POST /identity/v3/users => generated 306 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 01:31:27.599920 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02cd1c1-a1a6-4d60-8c4e-db8c690826e1 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:27.612516 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02cd1c1-a1a6-4d60-8c4e-db8c690826e1 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:27.618428 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afc6c56-3d9e-42fb-a0dc-a493623be0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:27.619042 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc6c56-3d9e-42fb-a0dc-a493623be0e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:27.619372 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc6c56-3d9e-42fb-a0dc-a493623be0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:27.619667 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc6c56-3d9e-42fb-a0dc-a493623be0e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:27.620322 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afc6c56-3d9e-42fb-a0dc-a493623be0e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:27.621930 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afc6c56-3d9e-42fb-a0dc-a493623be0e3 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:27.633450 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1062/2134] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:31:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:31:27.638058 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f24e6-6a11-451b-888a-af56fc0906fd admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:27.649525 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f24e6-6a11-451b-888a-af56fc0906fd admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:27.655125 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549c088c-949d-41a9-8773-1b83d83c5673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:27.655802 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c088c-949d-41a9-8773-1b83d83c5673 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:27.656079 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c088c-949d-41a9-8773-1b83d83c5673 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:27.656338 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c088c-949d-41a9-8773-1b83d83c5673 admin admin] PATH_INFO: `/v3/projects/f0a3ec35605a49198476148ac30eb191/users/42fab596b0dd4d21895e160dafbb8ebd/roles/fb48693810be495fb4b1893a79429b78` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:27.671912 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549c088c-949d-41a9-8773-1b83d83c5673 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0a3ec35605a49198476148ac30eb191, user_id=42fab596b0dd4d21895e160dafbb8ebd, role_id=fb48693810be495fb4b1893a79429b78)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:27.674644 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549c088c-949d-41a9-8773-1b83d83c5673 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:27.689512 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1073/2135] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:31:27 2022] PUT /identity/v3/projects/f0a3ec35605a49198476148ac30eb191/users/42fab596b0dd4d21895e160dafbb8ebd/roles/fb48693810be495fb4b1893a79429b78 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:31:27.693980 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afc6c56-3d9e-42fb-a0dc-a493623be0e3 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:27.705309 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afc6c56-3d9e-42fb-a0dc-a493623be0e3 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:27.766887 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d313efc1-f6d7-48a3-b351-11e71ae225a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:27.767569 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d313efc1-f6d7-48a3-b351-11e71ae225a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:27.767842 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d313efc1-f6d7-48a3-b351-11e71ae225a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:27.768110 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d313efc1-f6d7-48a3-b351-11e71ae225a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:27.768839 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d313efc1-f6d7-48a3-b351-11e71ae225a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:27.770538 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d313efc1-f6d7-48a3-b351-11e71ae225a4 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:27.780786 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1063/2136] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:31:27 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:31:27.785274 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549c088c-949d-41a9-8773-1b83d83c5673 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:27.796519 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549c088c-949d-41a9-8773-1b83d83c5673 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:27.802606 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8a779a-90a7-4a96-a0f1-9e7d1132e5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:27.803261 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a779a-90a7-4a96-a0f1-9e7d1132e5d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:27.803706 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a779a-90a7-4a96-a0f1-9e7d1132e5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:27.803976 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a779a-90a7-4a96-a0f1-9e7d1132e5d6 admin admin] PATH_INFO: `/v3/projects/f0a3ec35605a49198476148ac30eb191/users/42fab596b0dd4d21895e160dafbb8ebd/roles/fb48693810be495fb4b1893a79429b78` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:27.806057 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8a779a-90a7-4a96-a0f1-9e7d1132e5d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0a3ec35605a49198476148ac30eb191, user_id=42fab596b0dd4d21895e160dafbb8ebd, role_id=fb48693810be495fb4b1893a79429b78)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:27.808817 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8a779a-90a7-4a96-a0f1-9e7d1132e5d6 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:27.820148 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1074/2137] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:31:27 2022] PUT /identity/v3/projects/f0a3ec35605a49198476148ac30eb191/users/42fab596b0dd4d21895e160dafbb8ebd/roles/fb48693810be495fb4b1893a79429b78 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:31:27.833578 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b759c44-35d3-42eb-a623-c29d50888b5c None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:27.833858 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b759c44-35d3-42eb-a623-c29d50888b5c None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:27.834138 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b759c44-35d3-42eb-a623-c29d50888b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:27.864294 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-7b759c44-35d3-42eb-a623-c29d50888b5c None None] MFA Rules not processed for user `42fab596b0dd4d21895e160dafbb8ebd`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:31:27.865601 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-7b759c44-35d3-42eb-a623-c29d50888b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:27.942430 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1064/2138] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:31:27 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:31:27.954626 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8a779a-90a7-4a96-a0f1-9e7d1132e5d6 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:27.956622 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-9e8a779a-90a7-4a96-a0f1-9e7d1132e5d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:28.015708 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8a779a-90a7-4a96-a0f1-9e7d1132e5d6 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:28.022030 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c556bf-5dd3-45f0-b788-bbdf67506986 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7853d40c29af424c8d7913950d89750b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:28.022030 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c556bf-5dd3-45f0-b788-bbdf67506986 service cinder] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:28.022030 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c556bf-5dd3-45f0-b788-bbdf67506986 service cinder] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:28.022030 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c556bf-5dd3-45f0-b788-bbdf67506986 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:28.032482 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c556bf-5dd3-45f0-b788-bbdf67506986 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:28.034344 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c556bf-5dd3-45f0-b788-bbdf67506986 service cinder] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:28.045947 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1075/2139] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:31:27 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:31:28.126056 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b759c44-35d3-42eb-a623-c29d50888b5c None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:28.136213 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b759c44-35d3-42eb-a623-c29d50888b5c None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:28.139856 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee01612-df68-44d5-a7f7-2c390e7d644d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7853d40c29af424c8d7913950d89750b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:28.140463 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee01612-df68-44d5-a7f7-2c390e7d644d service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:28.140734 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee01612-df68-44d5-a7f7-2c390e7d644d service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:28.141001 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee01612-df68-44d5-a7f7-2c390e7d644d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:28.177223 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:28.202502 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee01612-df68-44d5-a7f7-2c390e7d644d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:28.204030 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee01612-df68-44d5-a7f7-2c390e7d644d service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:28.213418 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1065/2140] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:31:28 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:31:32.349012 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c556bf-5dd3-45f0-b788-bbdf67506986 service cinder] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:32.394239 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:32.430804 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c556bf-5dd3-45f0-b788-bbdf67506986 service cinder] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:32.435274 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0882ebff-c649-40fd-9e35-4af7fd712888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:32.435902 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0882ebff-c649-40fd-9e35-4af7fd712888 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:32.436174 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0882ebff-c649-40fd-9e35-4af7fd712888 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:32.436451 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0882ebff-c649-40fd-9e35-4af7fd712888 admin admin] PATH_INFO: `/v3/users/b1129aa982da43978edbdbdae3f9583f` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:32.437933 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0882ebff-c649-40fd-9e35-4af7fd712888 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1129aa982da43978edbdbdae3f9583f)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:32.439768 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0882ebff-c649-40fd-9e35-4af7fd712888 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:32.495329 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-0882ebff-c649-40fd-9e35-4af7fd712888 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1129aa982da43978edbdbdae3f9583f'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:32.505429 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-0882ebff-c649-40fd-9e35-4af7fd712888 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1129aa982da43978edbdbdae3f9583f'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:32.506218 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-0882ebff-c649-40fd-9e35-4af7fd712888 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1129aa982da43978edbdbdae3f9583f'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:32.524830 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-0882ebff-c649-40fd-9e35-4af7fd712888 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1129aa982da43978edbdbdae3f9583f'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:32.540519 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-0882ebff-c649-40fd-9e35-4af7fd712888 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1129aa982da43978edbdbdae3f9583f'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:32.547234 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1076/2141] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:31:32 2022] DELETE /identity/v3/users/b1129aa982da43978edbdbdae3f9583f => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:31:32.551742 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637626e-53cc-4bec-9901-218ac1b6c2ae None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:32.552226 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637626e-53cc-4bec-9901-218ac1b6c2ae None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:32.553097 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637626e-53cc-4bec-9901-218ac1b6c2ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:32.576008 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-2637626e-53cc-4bec-9901-218ac1b6c2ae None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:31:32.577239 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2637626e-53cc-4bec-9901-218ac1b6c2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:32.614422 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad117bc-3874-40ce-bdab-1dca62599724 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:32.614603 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad117bc-3874-40ce-bdab-1dca62599724 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:32.614813 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad117bc-3874-40ce-bdab-1dca62599724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:32.636022 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-8ad117bc-3874-40ce-bdab-1dca62599724 None None] MFA Rules not processed for user `f3643631cf2d4a9592d465bdeba99669`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:31:32.637261 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-8ad117bc-3874-40ce-bdab-1dca62599724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:32.664052 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1066/2142] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:31:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:31:32.676251 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2637626e-53cc-4bec-9901-218ac1b6c2ae None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:32.677684 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2637626e-53cc-4bec-9901-218ac1b6c2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:32.724233 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1077/2143] 10.222.0.26 () {58 vars in 1009 bytes} [Fri Aug 12 01:31:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 01:31:32.777794 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2637626e-53cc-4bec-9901-218ac1b6c2ae None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:32.781962 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468f5f55-c856-4c75-b6ac-a5cf06715a8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:32.783171 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f5f55-c856-4c75-b6ac-a5cf06715a8e service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:32.785573 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f5f55-c856-4c75-b6ac-a5cf06715a8e service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:32.785858 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f5f55-c856-4c75-b6ac-a5cf06715a8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:32.811305 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad117bc-3874-40ce-bdab-1dca62599724 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:32.814920 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-8ad117bc-3874-40ce-bdab-1dca62599724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:32.822558 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468f5f55-c856-4c75-b6ac-a5cf06715a8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:32.824019 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468f5f55-c856-4c75-b6ac-a5cf06715a8e service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:32.847751 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1067/2144] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:31:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 01:31:32.900861 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:32.935158 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad117bc-3874-40ce-bdab-1dca62599724 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:32.947343 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdffb012-b33a-478e-abf2-cf17cd476c19 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32c1ba237f864b5d9699cb817e42e647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:32.948303 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdffb012-b33a-478e-abf2-cf17cd476c19 service swift] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:32.948905 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdffb012-b33a-478e-abf2-cf17cd476c19 service swift] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:32.949551 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdffb012-b33a-478e-abf2-cf17cd476c19 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:32.965224 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdffb012-b33a-478e-abf2-cf17cd476c19 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:32.967035 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdffb012-b33a-478e-abf2-cf17cd476c19 service swift] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:32.981820 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1078/2145] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Aug 12 01:31:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 12 01:31:33.293376 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468f5f55-c856-4c75-b6ac-a5cf06715a8e service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:33.295576 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-468f5f55-c856-4c75-b6ac-a5cf06715a8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:33.318388 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468f5f55-c856-4c75-b6ac-a5cf06715a8e service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:33.350865 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8da0ead-45a1-424c-bc96-c035c8533a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:33.351948 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da0ead-45a1-424c-bc96-c035c8533a80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:33.352588 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da0ead-45a1-424c-bc96-c035c8533a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:33.352990 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da0ead-45a1-424c-bc96-c035c8533a80 admin admin] PATH_INFO: `/v3/projects/69f9acaa64e74dd4be5f28e41d12f7ec` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:33.355013 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8da0ead-45a1-424c-bc96-c035c8533a80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69f9acaa64e74dd4be5f28e41d12f7ec)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:33.359016 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8da0ead-45a1-424c-bc96-c035c8533a80 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:33.426873 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-e8da0ead-45a1-424c-bc96-c035c8533a80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69f9acaa64e74dd4be5f28e41d12f7ec', 'request_id': 'req-e8da0ead-45a1-424c-bc96-c035c8533a80'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:33.445634 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-e8da0ead-45a1-424c-bc96-c035c8533a80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69f9acaa64e74dd4be5f28e41d12f7ec', 'request_id': 'req-e8da0ead-45a1-424c-bc96-c035c8533a80'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:33.457646 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-e8da0ead-45a1-424c-bc96-c035c8533a80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69f9acaa64e74dd4be5f28e41d12f7ec', 'request_id': 'req-e8da0ead-45a1-424c-bc96-c035c8533a80'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:33.467944 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:33.474290 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-e8da0ead-45a1-424c-bc96-c035c8533a80 admin admin] The token cache is being invalidate because project 69f9acaa64e74dd4be5f28e41d12f7ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:31:33.474990 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-e8da0ead-45a1-424c-bc96-c035c8533a80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:33.475965 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-e8da0ead-45a1-424c-bc96-c035c8533a80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:33.497632 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1068/2146] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:31:33 2022] DELETE /identity/v3/projects/69f9acaa64e74dd4be5f28e41d12f7ec => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:31:33.502474 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdffb012-b33a-478e-abf2-cf17cd476c19 service swift] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:33.516228 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdffb012-b33a-478e-abf2-cf17cd476c19 service swift] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:33.603701 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36278a87-851d-4b71-8a81-40787529aab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:33.604430 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36278a87-851d-4b71-8a81-40787529aab5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:33.604904 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36278a87-851d-4b71-8a81-40787529aab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:33.605311 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36278a87-851d-4b71-8a81-40787529aab5 admin admin] PATH_INFO: `/v3/users/42fab596b0dd4d21895e160dafbb8ebd` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:33.606486 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36278a87-851d-4b71-8a81-40787529aab5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42fab596b0dd4d21895e160dafbb8ebd)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:33.608599 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36278a87-851d-4b71-8a81-40787529aab5 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:33.667370 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-36278a87-851d-4b71-8a81-40787529aab5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42fab596b0dd4d21895e160dafbb8ebd'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:33.677268 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-36278a87-851d-4b71-8a81-40787529aab5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42fab596b0dd4d21895e160dafbb8ebd'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:33.677958 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-36278a87-851d-4b71-8a81-40787529aab5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42fab596b0dd4d21895e160dafbb8ebd'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:33.689318 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-36278a87-851d-4b71-8a81-40787529aab5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42fab596b0dd4d21895e160dafbb8ebd'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:33.703096 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-36278a87-851d-4b71-8a81-40787529aab5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42fab596b0dd4d21895e160dafbb8ebd'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:33.710545 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1079/2147] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:31:33 2022] DELETE /identity/v3/users/42fab596b0dd4d21895e160dafbb8ebd => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:31:33.793276 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd1b17-8b15-4dde-82ed-3dc988187e53 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:33.793960 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd1b17-8b15-4dde-82ed-3dc988187e53 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:33.794328 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd1b17-8b15-4dde-82ed-3dc988187e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:33.815542 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-43dd1b17-8b15-4dde-82ed-3dc988187e53 None None] MFA Rules not processed for user `f3643631cf2d4a9592d465bdeba99669`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:31:33.816763 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-43dd1b17-8b15-4dde-82ed-3dc988187e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:33.885879 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1069/2148] 10.222.0.26 () {58 vars in 967 bytes} [Fri Aug 12 01:31:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:31:33.899611 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36278a87-851d-4b71-8a81-40787529aab5 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:33.901226 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-36278a87-851d-4b71-8a81-40787529aab5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:33.972332 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36278a87-851d-4b71-8a81-40787529aab5 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:33.977457 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f24664-bb25-478b-9005-0c8149197dca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32c1ba237f864b5d9699cb817e42e647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:33.978076 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f24664-bb25-478b-9005-0c8149197dca service swift] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:33.978371 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f24664-bb25-478b-9005-0c8149197dca service swift] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:33.978642 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f24664-bb25-478b-9005-0c8149197dca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:33.984802 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:33.989518 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f24664-bb25-478b-9005-0c8149197dca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:33.991163 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f24664-bb25-478b-9005-0c8149197dca service swift] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:34.000292 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1080/2149] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Aug 12 01:31:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 12 01:31:34.018265 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dd1b17-8b15-4dde-82ed-3dc988187e53 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:34.019913 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-43dd1b17-8b15-4dde-82ed-3dc988187e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:34.105234 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dd1b17-8b15-4dde-82ed-3dc988187e53 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:34.111182 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f08a5c6-1348-4deb-8139-9fbb59cd446f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:34.112729 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f08a5c6-1348-4deb-8139-9fbb59cd446f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:34.113095 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f08a5c6-1348-4deb-8139-9fbb59cd446f admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:34.113375 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f08a5c6-1348-4deb-8139-9fbb59cd446f admin admin] PATH_INFO: `/v3/projects/f0a3ec35605a49198476148ac30eb191` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:34.114684 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f08a5c6-1348-4deb-8139-9fbb59cd446f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0a3ec35605a49198476148ac30eb191)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:34.118495 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f08a5c6-1348-4deb-8139-9fbb59cd446f admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:34.181150 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-1f08a5c6-1348-4deb-8139-9fbb59cd446f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0a3ec35605a49198476148ac30eb191', 'request_id': 'req-1f08a5c6-1348-4deb-8139-9fbb59cd446f'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:34.192518 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-1f08a5c6-1348-4deb-8139-9fbb59cd446f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0a3ec35605a49198476148ac30eb191', 'request_id': 'req-1f08a5c6-1348-4deb-8139-9fbb59cd446f'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:34.198805 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-1f08a5c6-1348-4deb-8139-9fbb59cd446f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0a3ec35605a49198476148ac30eb191', 'request_id': 'req-1f08a5c6-1348-4deb-8139-9fbb59cd446f'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:34.211203 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-1f08a5c6-1348-4deb-8139-9fbb59cd446f admin admin] The token cache is being invalidate because project f0a3ec35605a49198476148ac30eb191 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:31:34.211489 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-1f08a5c6-1348-4deb-8139-9fbb59cd446f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:34.212241 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-1f08a5c6-1348-4deb-8139-9fbb59cd446f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:34.213658 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1070/2150] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:31:34 2022] DELETE /identity/v3/projects/f0a3ec35605a49198476148ac30eb191 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:31:34.219058 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504167f8-c054-4ae3-8593-ab15908fa24e None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:34.219431 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504167f8-c054-4ae3-8593-ab15908fa24e None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:34.219731 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504167f8-c054-4ae3-8593-ab15908fa24e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:34.239979 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-504167f8-c054-4ae3-8593-ab15908fa24e None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:31:34.241195 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-504167f8-c054-4ae3-8593-ab15908fa24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:34.277183 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd713e8-5f02-4c6b-9d59-c5bda118bdc2 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:34.277514 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd713e8-5f02-4c6b-9d59-c5bda118bdc2 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:34.277791 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd713e8-5f02-4c6b-9d59-c5bda118bdc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:34.298789 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-fbd713e8-5f02-4c6b-9d59-c5bda118bdc2 None None] MFA Rules not processed for user `f3643631cf2d4a9592d465bdeba99669`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:31:34.300013 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-fbd713e8-5f02-4c6b-9d59-c5bda118bdc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:34.310043 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1081/2151] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:31:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:31:34.318108 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87178914-1fdc-48ef-88b2-2205c5c994ae None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:34.318420 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87178914-1fdc-48ef-88b2-2205c5c994ae None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:34.318696 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87178914-1fdc-48ef-88b2-2205c5c994ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:34.331313 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:34.338307 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-87178914-1fdc-48ef-88b2-2205c5c994ae None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:31:34.339517 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-87178914-1fdc-48ef-88b2-2205c5c994ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:34.348439 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1082/2152] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:31:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 01:31:34.352519 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87178914-1fdc-48ef-88b2-2205c5c994ae None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:34.361317 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1071/2153] 10.222.0.26 () {58 vars in 1009 bytes} [Fri Aug 12 01:31:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 01:31:34.361538 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87178914-1fdc-48ef-88b2-2205c5c994ae None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:34.366271 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa2ca1a-4494-445d-b1e7-ee6552d64938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:34.366861 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2ca1a-4494-445d-b1e7-ee6552d64938 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:34.367106 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2ca1a-4494-445d-b1e7-ee6552d64938 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:34.367375 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2ca1a-4494-445d-b1e7-ee6552d64938 admin admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:34.368017 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa2ca1a-4494-445d-b1e7-ee6552d64938 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:31:34.368305 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa2ca1a-4494-445d-b1e7-ee6552d64938 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:34.369868 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa2ca1a-4494-445d-b1e7-ee6552d64938 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:34.374243 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd713e8-5f02-4c6b-9d59-c5bda118bdc2 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:34.375838 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-fbd713e8-5f02-4c6b-9d59-c5bda118bdc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:34.385399 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1083/2154] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 01:31:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:31:34.386347 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa2ca1a-4494-445d-b1e7-ee6552d64938 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:34.395993 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa2ca1a-4494-445d-b1e7-ee6552d64938 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:34.400555 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdae76a2-93a3-4dbd-a5dc-205204f6124b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:34.401126 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae76a2-93a3-4dbd-a5dc-205204f6124b admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:34.401431 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae76a2-93a3-4dbd-a5dc-205204f6124b admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:34.401695 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae76a2-93a3-4dbd-a5dc-205204f6124b admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:34.402332 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdae76a2-93a3-4dbd-a5dc-205204f6124b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:34.404203 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdae76a2-93a3-4dbd-a5dc-205204f6124b admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:34.432261 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1084/2155] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:31:34 2022] POST /identity/v3/projects => generated 407 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 01:31:34.436256 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdae76a2-93a3-4dbd-a5dc-205204f6124b admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:34.448419 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd713e8-5f02-4c6b-9d59-c5bda118bdc2 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:34.515179 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdae76a2-93a3-4dbd-a5dc-205204f6124b admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:34.520409 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae25a382-0df2-4496-aae6-bd2f429561dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:34.521026 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae25a382-0df2-4496-aae6-bd2f429561dc admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:34.521298 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae25a382-0df2-4496-aae6-bd2f429561dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:34.521571 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae25a382-0df2-4496-aae6-bd2f429561dc admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:34.522348 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae25a382-0df2-4496-aae6-bd2f429561dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:34.523423 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7715e756-ba5f-45a6-86c8-3dc1f24133d0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32c1ba237f864b5d9699cb817e42e647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:34.524160 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7715e756-ba5f-45a6-86c8-3dc1f24133d0 service swift] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:34.524268 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae25a382-0df2-4496-aae6-bd2f429561dc admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:34.524536 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7715e756-ba5f-45a6-86c8-3dc1f24133d0 service swift] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:34.524869 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7715e756-ba5f-45a6-86c8-3dc1f24133d0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:34.550208 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1085/2156] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:31:34 2022] POST /identity/v3/users => generated 304 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:31:34.554082 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae25a382-0df2-4496-aae6-bd2f429561dc admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:34.564029 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae25a382-0df2-4496-aae6-bd2f429561dc admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:34.568662 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f895ae-3823-49e5-9916-fbae2314a74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:34.569262 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f895ae-3823-49e5-9916-fbae2314a74f admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:34.569546 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f895ae-3823-49e5-9916-fbae2314a74f admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:34.569820 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f895ae-3823-49e5-9916-fbae2314a74f admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:34.570525 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f895ae-3823-49e5-9916-fbae2314a74f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:34.572157 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f895ae-3823-49e5-9916-fbae2314a74f admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:34.583648 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1086/2157] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:31:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 01:31:34.587440 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f895ae-3823-49e5-9916-fbae2314a74f admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:34.588000 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7715e756-ba5f-45a6-86c8-3dc1f24133d0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:34.589784 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7715e756-ba5f-45a6-86c8-3dc1f24133d0 service swift] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:34.599369 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f895ae-3823-49e5-9916-fbae2314a74f admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:34.604948 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a904d89d-bf48-4cad-961e-9521c484f8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:34.605656 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a904d89d-bf48-4cad-961e-9521c484f8a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:34.605994 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a904d89d-bf48-4cad-961e-9521c484f8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:34.606354 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a904d89d-bf48-4cad-961e-9521c484f8a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:34.607069 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a904d89d-bf48-4cad-961e-9521c484f8a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:34.609040 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a904d89d-bf48-4cad-961e-9521c484f8a4 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:34.614313 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1072/2158] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Aug 12 01:31:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 12 01:31:34.621245 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1087/2159] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:31:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 01:31:34.625648 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7715e756-ba5f-45a6-86c8-3dc1f24133d0 service swift] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:34.636481 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7715e756-ba5f-45a6-86c8-3dc1f24133d0 service swift] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:34.642014 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7957a39a-a74c-49b2-9bff-b5f09888c7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:34.642851 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957a39a-a74c-49b2-9bff-b5f09888c7b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:34.643092 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957a39a-a74c-49b2-9bff-b5f09888c7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:34.643371 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7957a39a-a74c-49b2-9bff-b5f09888c7b2 admin admin] PATH_INFO: `/v3/projects/1ec43c5f38624116a6dd93ae5656fbea/users/cb8a08e76d0e4313bd0581ec7b1229ca/roles/13af81971c1c428eae0a571a22ea583d` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:34.662309 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7957a39a-a74c-49b2-9bff-b5f09888c7b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ec43c5f38624116a6dd93ae5656fbea, user_id=cb8a08e76d0e4313bd0581ec7b1229ca, role_id=13af81971c1c428eae0a571a22ea583d)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:34.664938 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7957a39a-a74c-49b2-9bff-b5f09888c7b2 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:34.677617 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:34.685262 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1073/2160] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:31:34 2022] PUT /identity/v3/projects/1ec43c5f38624116a6dd93ae5656fbea/users/cb8a08e76d0e4313bd0581ec7b1229ca/roles/13af81971c1c428eae0a571a22ea583d => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:31:34.697717 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d8c65b-bb92-4605-8e88-fdbd1ea3cbf9 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:34.697997 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d8c65b-bb92-4605-8e88-fdbd1ea3cbf9 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:34.698318 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d8c65b-bb92-4605-8e88-fdbd1ea3cbf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:34.735996 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-77d8c65b-bb92-4605-8e88-fdbd1ea3cbf9 None None] MFA Rules not processed for user `cb8a08e76d0e4313bd0581ec7b1229ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:31:34.737208 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-77d8c65b-bb92-4605-8e88-fdbd1ea3cbf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:34.746109 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:34.812846 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1088/2161] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:31:34 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:31:34.817686 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7957a39a-a74c-49b2-9bff-b5f09888c7b2 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:34.891883 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7957a39a-a74c-49b2-9bff-b5f09888c7b2 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:34.897237 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb878e06-7bec-45ad-bd0c-34743758f1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:34.898008 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb878e06-7bec-45ad-bd0c-34743758f1fa admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:34.898321 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb878e06-7bec-45ad-bd0c-34743758f1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:34.898590 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb878e06-7bec-45ad-bd0c-34743758f1fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:34.899239 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb878e06-7bec-45ad-bd0c-34743758f1fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:34.901297 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb878e06-7bec-45ad-bd0c-34743758f1fa admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:34.931147 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1074/2162] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:31:34 2022] POST /identity/v3/projects => generated 409 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:31:34.935229 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d8c65b-bb92-4605-8e88-fdbd1ea3cbf9 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:34.946511 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d8c65b-bb92-4605-8e88-fdbd1ea3cbf9 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:35.014723 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6905d756-1d4c-47eb-93e4-8965a9993a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:35.015460 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6905d756-1d4c-47eb-93e4-8965a9993a1e admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:35.016117 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6905d756-1d4c-47eb-93e4-8965a9993a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:35.016399 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6905d756-1d4c-47eb-93e4-8965a9993a1e admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:35.017107 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6905d756-1d4c-47eb-93e4-8965a9993a1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:35.019424 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6905d756-1d4c-47eb-93e4-8965a9993a1e admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:35.041308 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f3b1e-5c96-487f-9ff6-10992bd70738 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:35.041597 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f3b1e-5c96-487f-9ff6-10992bd70738 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:35.041868 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f3b1e-5c96-487f-9ff6-10992bd70738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:35.045995 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1089/2163] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:31:34 2022] POST /identity/v3/users => generated 311 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 01:31:35.046993 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6905d756-1d4c-47eb-93e4-8965a9993a1e admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:35.056758 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6905d756-1d4c-47eb-93e4-8965a9993a1e admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:35.061445 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a41557-35a2-4dc5-8e1b-b1e4d8fb5055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:35.062045 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a41557-35a2-4dc5-8e1b-b1e4d8fb5055 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:35.062355 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a41557-35a2-4dc5-8e1b-b1e4d8fb5055 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:35.062666 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-9d8f3b1e-5c96-487f-9ff6-10992bd70738 None None] MFA Rules not processed for user `f3643631cf2d4a9592d465bdeba99669`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:31:35.062769 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a41557-35a2-4dc5-8e1b-b1e4d8fb5055 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:35.063873 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-9d8f3b1e-5c96-487f-9ff6-10992bd70738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:35.063996 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a41557-35a2-4dc5-8e1b-b1e4d8fb5055 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:35.065522 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a41557-35a2-4dc5-8e1b-b1e4d8fb5055 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:35.079849 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1090/2164] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:31:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 01:31:35.080838 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a41557-35a2-4dc5-8e1b-b1e4d8fb5055 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:35.091080 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a41557-35a2-4dc5-8e1b-b1e4d8fb5055 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:35.096194 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a0875-01fc-4e74-873d-9e5f0c6f8483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:35.096837 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a0875-01fc-4e74-873d-9e5f0c6f8483 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:35.097113 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a0875-01fc-4e74-873d-9e5f0c6f8483 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:35.097382 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a0875-01fc-4e74-873d-9e5f0c6f8483 admin admin] PATH_INFO: `/v3/projects/4058fbe4af9a4a39ade91385a5d1e662/users/13e02de9ef194393bb5e7789ef5bf9e3/roles/fb48693810be495fb4b1893a79429b78` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:35.118275 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1a0875-01fc-4e74-873d-9e5f0c6f8483 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4058fbe4af9a4a39ade91385a5d1e662, user_id=13e02de9ef194393bb5e7789ef5bf9e3, role_id=fb48693810be495fb4b1893a79429b78)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:35.118496 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1a0875-01fc-4e74-873d-9e5f0c6f8483 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:35.135125 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1075/2165] 10.222.0.26 () {58 vars in 967 bytes} [Fri Aug 12 01:31:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 01:31:35.136310 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1091/2166] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:31:35 2022] PUT /identity/v3/projects/4058fbe4af9a4a39ade91385a5d1e662/users/13e02de9ef194393bb5e7789ef5bf9e3/roles/fb48693810be495fb4b1893a79429b78 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 01:31:35.140588 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f3b1e-5c96-487f-9ff6-10992bd70738 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:35.152926 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f3b1e-5c96-487f-9ff6-10992bd70738 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:35.157991 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a0875-01fc-4e74-873d-9e5f0c6f8483 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:35.214211 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a123c433-8fc7-4767-ab92-2ee0cb74d68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:35.214850 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123c433-8fc7-4767-ab92-2ee0cb74d68b admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:35.215155 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123c433-8fc7-4767-ab92-2ee0cb74d68b admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:35.215430 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123c433-8fc7-4767-ab92-2ee0cb74d68b admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:35.216168 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a123c433-8fc7-4767-ab92-2ee0cb74d68b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:35.217695 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a123c433-8fc7-4767-ab92-2ee0cb74d68b admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:35.230161 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1076/2167] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:31:35 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 01:31:35.232230 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a123c433-8fc7-4767-ab92-2ee0cb74d68b admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:35.235739 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a0875-01fc-4e74-873d-9e5f0c6f8483 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:35.241929 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d054b9d-5b1a-4d3d-b191-3bb9fc1f5b3f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32c1ba237f864b5d9699cb817e42e647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:35.242605 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d054b9d-5b1a-4d3d-b191-3bb9fc1f5b3f service swift] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:35.242884 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d054b9d-5b1a-4d3d-b191-3bb9fc1f5b3f service swift] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:35.243158 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d054b9d-5b1a-4d3d-b191-3bb9fc1f5b3f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:35.245190 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a123c433-8fc7-4767-ab92-2ee0cb74d68b admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:35.247927 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:35.251725 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb6994-ebb9-4b19-bd83-d90bfc01ef29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:35.252396 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb6994-ebb9-4b19-bd83-d90bfc01ef29 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:35.252806 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb6994-ebb9-4b19-bd83-d90bfc01ef29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:35.253085 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb6994-ebb9-4b19-bd83-d90bfc01ef29 admin admin] PATH_INFO: `/v3/projects/4058fbe4af9a4a39ade91385a5d1e662/users/13e02de9ef194393bb5e7789ef5bf9e3/roles/fb48693810be495fb4b1893a79429b78` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:35.256092 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eb6994-ebb9-4b19-bd83-d90bfc01ef29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4058fbe4af9a4a39ade91385a5d1e662, user_id=13e02de9ef194393bb5e7789ef5bf9e3, role_id=fb48693810be495fb4b1893a79429b78)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:35.262441 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eb6994-ebb9-4b19-bd83-d90bfc01ef29 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:35.277102 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1077/2168] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:31:35 2022] PUT /identity/v3/projects/4058fbe4af9a4a39ade91385a5d1e662/users/13e02de9ef194393bb5e7789ef5bf9e3/roles/fb48693810be495fb4b1893a79429b78 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 01:31:35.287705 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95560a4-3d56-4d1f-8a78-47e198ed549d None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:35.288047 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95560a4-3d56-4d1f-8a78-47e198ed549d None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:35.288355 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95560a4-3d56-4d1f-8a78-47e198ed549d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:35.316704 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:35.320213 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-a95560a4-3d56-4d1f-8a78-47e198ed549d None None] MFA Rules not processed for user `13e02de9ef194393bb5e7789ef5bf9e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:31:35.322905 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-a95560a4-3d56-4d1f-8a78-47e198ed549d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:35.323415 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d054b9d-5b1a-4d3d-b191-3bb9fc1f5b3f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:35.325633 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d054b9d-5b1a-4d3d-b191-3bb9fc1f5b3f service swift] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:35.334902 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1092/2169] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Aug 12 01:31:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 12 01:31:35.412520 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1078/2170] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:31:35 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 01:31:35.424507 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d054b9d-5b1a-4d3d-b191-3bb9fc1f5b3f service swift] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:35.426344 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-4d054b9d-5b1a-4d3d-b191-3bb9fc1f5b3f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:35.496094 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d054b9d-5b1a-4d3d-b191-3bb9fc1f5b3f service swift] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:35.550206 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaf1a08-cac6-4965-9720-b64010894e5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7853d40c29af424c8d7913950d89750b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:35.552128 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf1a08-cac6-4965-9720-b64010894e5a service cinder] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:35.552407 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf1a08-cac6-4965-9720-b64010894e5a service cinder] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:35.552680 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf1a08-cac6-4965-9720-b64010894e5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:35.563269 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaf1a08-cac6-4965-9720-b64010894e5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:35.564700 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaf1a08-cac6-4965-9720-b64010894e5a service cinder] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:35.574475 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1093/2171] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:31:35 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:31:35.747207 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95560a4-3d56-4d1f-8a78-47e198ed549d None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:35.757315 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95560a4-3d56-4d1f-8a78-47e198ed549d None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:35.760955 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be65cecb-36cb-4dca-bee9-a7db5f4e0312 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7853d40c29af424c8d7913950d89750b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:35.761576 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be65cecb-36cb-4dca-bee9-a7db5f4e0312 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:35.761853 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be65cecb-36cb-4dca-bee9-a7db5f4e0312 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:35.762148 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be65cecb-36cb-4dca-bee9-a7db5f4e0312 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:35.822680 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be65cecb-36cb-4dca-bee9-a7db5f4e0312 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:35.823823 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be65cecb-36cb-4dca-bee9-a7db5f4e0312 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:35.833214 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1079/2172] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:31:35 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:31:37.009690 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaf1a08-cac6-4965-9720-b64010894e5a service cinder] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:37.011222 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-1eaf1a08-cac6-4965-9720-b64010894e5a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:37.081422 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaf1a08-cac6-4965-9720-b64010894e5a service cinder] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:37.090418 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445d38ef-6c7e-4f24-af04-e734da3bf086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:37.091441 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d38ef-6c7e-4f24-af04-e734da3bf086 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:37.091827 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d38ef-6c7e-4f24-af04-e734da3bf086 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:37.092174 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d38ef-6c7e-4f24-af04-e734da3bf086 admin admin] PATH_INFO: `/v3/users/b4d9cc1f930a467780a84aea77999aab` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:37.094105 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445d38ef-6c7e-4f24-af04-e734da3bf086 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4d9cc1f930a467780a84aea77999aab)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:37.096269 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445d38ef-6c7e-4f24-af04-e734da3bf086 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:37.101517 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:37.149902 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-445d38ef-6c7e-4f24-af04-e734da3bf086 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4d9cc1f930a467780a84aea77999aab'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:37.158743 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-445d38ef-6c7e-4f24-af04-e734da3bf086 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4d9cc1f930a467780a84aea77999aab'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:37.159392 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-445d38ef-6c7e-4f24-af04-e734da3bf086 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4d9cc1f930a467780a84aea77999aab'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:37.167072 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-445d38ef-6c7e-4f24-af04-e734da3bf086 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4d9cc1f930a467780a84aea77999aab'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:37.179469 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-445d38ef-6c7e-4f24-af04-e734da3bf086 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4d9cc1f930a467780a84aea77999aab'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:37.185576 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1094/2173] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:31:37 2022] DELETE /identity/v3/users/b4d9cc1f930a467780a84aea77999aab => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 01:31:37.373406 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be65cecb-36cb-4dca-bee9-a7db5f4e0312 service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:37.391303 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be65cecb-36cb-4dca-bee9-a7db5f4e0312 service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:37.479304 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca79659-9678-412a-b77f-6b5ebc69f0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:37.479958 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca79659-9678-412a-b77f-6b5ebc69f0a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:37.480378 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca79659-9678-412a-b77f-6b5ebc69f0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:37.480724 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca79659-9678-412a-b77f-6b5ebc69f0a4 admin admin] PATH_INFO: `/v3/projects/3476ab6a476144c290a08405f6e4b48d` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:37.482012 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca79659-9678-412a-b77f-6b5ebc69f0a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3476ab6a476144c290a08405f6e4b48d)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:37.484192 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca79659-9678-412a-b77f-6b5ebc69f0a4 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:37.529423 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:37.536705 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-eca79659-9678-412a-b77f-6b5ebc69f0a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3476ab6a476144c290a08405f6e4b48d', 'request_id': 'req-eca79659-9678-412a-b77f-6b5ebc69f0a4'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:37.544798 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-eca79659-9678-412a-b77f-6b5ebc69f0a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3476ab6a476144c290a08405f6e4b48d', 'request_id': 'req-eca79659-9678-412a-b77f-6b5ebc69f0a4'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:37.551352 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-eca79659-9678-412a-b77f-6b5ebc69f0a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3476ab6a476144c290a08405f6e4b48d', 'request_id': 'req-eca79659-9678-412a-b77f-6b5ebc69f0a4'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:37.563699 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-eca79659-9678-412a-b77f-6b5ebc69f0a4 admin admin] The token cache is being invalidate because project 3476ab6a476144c290a08405f6e4b48d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:31:37.564079 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-eca79659-9678-412a-b77f-6b5ebc69f0a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:37.564820 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-eca79659-9678-412a-b77f-6b5ebc69f0a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:37.566527 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1080/2174] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:31:37 2022] DELETE /identity/v3/projects/3476ab6a476144c290a08405f6e4b48d => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:31:37.571552 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445d38ef-6c7e-4f24-af04-e734da3bf086 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:37.573301 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-445d38ef-6c7e-4f24-af04-e734da3bf086 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:37.589874 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445d38ef-6c7e-4f24-af04-e734da3bf086 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:37.639315 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca79659-9678-412a-b77f-6b5ebc69f0a4 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:37.641589 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-eca79659-9678-412a-b77f-6b5ebc69f0a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:37.660575 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209af1fd-7922-4a4d-83cb-d05757be89d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:37.661174 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209af1fd-7922-4a4d-83cb-d05757be89d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:37.661451 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209af1fd-7922-4a4d-83cb-d05757be89d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:37.661724 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209af1fd-7922-4a4d-83cb-d05757be89d3 admin admin] PATH_INFO: `/v3/users/3c887579697742d49dc6a293b6d67c4e` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:37.662959 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209af1fd-7922-4a4d-83cb-d05757be89d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c887579697742d49dc6a293b6d67c4e)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:37.665006 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209af1fd-7922-4a4d-83cb-d05757be89d3 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:37.733673 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca79659-9678-412a-b77f-6b5ebc69f0a4 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:37.735817 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-209af1fd-7922-4a4d-83cb-d05757be89d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c887579697742d49dc6a293b6d67c4e'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:37.739538 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03760e0-099d-46e0-a49e-ae4c8065ace7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:37.740375 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03760e0-099d-46e0-a49e-ae4c8065ace7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:37.740721 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03760e0-099d-46e0-a49e-ae4c8065ace7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:37.741060 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03760e0-099d-46e0-a49e-ae4c8065ace7 admin admin] PATH_INFO: `/v3/users/8ed8e24eb5634ec58337aa7091c1b4b3` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:37.742390 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03760e0-099d-46e0-a49e-ae4c8065ace7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ed8e24eb5634ec58337aa7091c1b4b3)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:37.744613 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03760e0-099d-46e0-a49e-ae4c8065ace7 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:37.744730 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-209af1fd-7922-4a4d-83cb-d05757be89d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c887579697742d49dc6a293b6d67c4e'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:37.745349 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-209af1fd-7922-4a4d-83cb-d05757be89d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c887579697742d49dc6a293b6d67c4e'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:37.756392 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-209af1fd-7922-4a4d-83cb-d05757be89d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c887579697742d49dc6a293b6d67c4e'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:37.773682 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-209af1fd-7922-4a4d-83cb-d05757be89d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c887579697742d49dc6a293b6d67c4e'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:37.781558 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1095/2175] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:31:37 2022] DELETE /identity/v3/users/3c887579697742d49dc6a293b6d67c4e => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:31:37.814449 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d03760e0-099d-46e0-a49e-ae4c8065ace7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ed8e24eb5634ec58337aa7091c1b4b3'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:37.823391 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d03760e0-099d-46e0-a49e-ae4c8065ace7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ed8e24eb5634ec58337aa7091c1b4b3'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:37.824015 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d03760e0-099d-46e0-a49e-ae4c8065ace7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ed8e24eb5634ec58337aa7091c1b4b3'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:37.831358 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d03760e0-099d-46e0-a49e-ae4c8065ace7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ed8e24eb5634ec58337aa7091c1b4b3'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:37.844300 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d03760e0-099d-46e0-a49e-ae4c8065ace7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ed8e24eb5634ec58337aa7091c1b4b3'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:37.850304 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1081/2176] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:31:37 2022] DELETE /identity/v3/users/8ed8e24eb5634ec58337aa7091c1b4b3 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:31:37.854922 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61882c13-efcb-42b5-ab9f-1d628c75d016 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:37.855203 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61882c13-efcb-42b5-ab9f-1d628c75d016 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:37.855486 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61882c13-efcb-42b5-ab9f-1d628c75d016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:37.862945 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:37.877842 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-61882c13-efcb-42b5-ab9f-1d628c75d016 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:31:37.879185 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-61882c13-efcb-42b5-ab9f-1d628c75d016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:37.943040 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1096/2177] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:31:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:31:37.955290 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03760e0-099d-46e0-a49e-ae4c8065ace7 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:37.956961 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d03760e0-099d-46e0-a49e-ae4c8065ace7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:37.981870 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61882c13-efcb-42b5-ab9f-1d628c75d016 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:37.983461 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-61882c13-efcb-42b5-ab9f-1d628c75d016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:37.995726 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61882c13-efcb-42b5-ab9f-1d628c75d016 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:38.000908 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fd59b3-c035-4d3f-a382-0eab9efd5d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:38.001659 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fd59b3-c035-4d3f-a382-0eab9efd5d91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:38.002216 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fd59b3-c035-4d3f-a382-0eab9efd5d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:38.002585 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fd59b3-c035-4d3f-a382-0eab9efd5d91 admin admin] PATH_INFO: `/v3/projects/ea6ba8eac5034e0f9c8394bfe8267ce4` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:38.003940 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fd59b3-c035-4d3f-a382-0eab9efd5d91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea6ba8eac5034e0f9c8394bfe8267ce4)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:38.007036 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fd59b3-c035-4d3f-a382-0eab9efd5d91 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:38.024751 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:38.030213 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03760e0-099d-46e0-a49e-ae4c8065ace7 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:38.037143 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b528b55-0147-4efd-bf73-b1a9fbbb4f7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:38.037997 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b528b55-0147-4efd-bf73-b1a9fbbb4f7d service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:38.038332 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b528b55-0147-4efd-bf73-b1a9fbbb4f7d service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:38.038885 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b528b55-0147-4efd-bf73-b1a9fbbb4f7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:38.052707 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b528b55-0147-4efd-bf73-b1a9fbbb4f7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:38.054529 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b528b55-0147-4efd-bf73-b1a9fbbb4f7d service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:38.066083 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1082/2178] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:31:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:31:38.067236 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-06fd59b3-c035-4d3f-a382-0eab9efd5d91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea6ba8eac5034e0f9c8394bfe8267ce4', 'request_id': 'req-06fd59b3-c035-4d3f-a382-0eab9efd5d91'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:38.073158 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-06fd59b3-c035-4d3f-a382-0eab9efd5d91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea6ba8eac5034e0f9c8394bfe8267ce4', 'request_id': 'req-06fd59b3-c035-4d3f-a382-0eab9efd5d91'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:38.079950 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-06fd59b3-c035-4d3f-a382-0eab9efd5d91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea6ba8eac5034e0f9c8394bfe8267ce4', 'request_id': 'req-06fd59b3-c035-4d3f-a382-0eab9efd5d91'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:38.095121 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-06fd59b3-c035-4d3f-a382-0eab9efd5d91 admin admin] The token cache is being invalidate because project ea6ba8eac5034e0f9c8394bfe8267ce4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:31:38.095425 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-06fd59b3-c035-4d3f-a382-0eab9efd5d91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:38.096066 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-06fd59b3-c035-4d3f-a382-0eab9efd5d91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:38.097582 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1097/2179] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:31:37 2022] DELETE /identity/v3/projects/ea6ba8eac5034e0f9c8394bfe8267ce4 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 01:31:38.103555 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2c87e-434a-4efd-b764-f80950fb2c1c None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:38.104061 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2c87e-434a-4efd-b764-f80950fb2c1c None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:38.104426 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2c87e-434a-4efd-b764-f80950fb2c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:38.124234 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-eee2c87e-434a-4efd-b764-f80950fb2c1c None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:31:38.125534 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-eee2c87e-434a-4efd-b764-f80950fb2c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:38.188983 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1083/2180] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:31:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:31:38.196870 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056d806-b73b-4034-be19-fa17f53e9616 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:38.197155 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056d806-b73b-4034-be19-fa17f53e9616 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:38.197425 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056d806-b73b-4034-be19-fa17f53e9616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:38.217939 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-f056d806-b73b-4034-be19-fa17f53e9616 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:31:38.219210 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-f056d806-b73b-4034-be19-fa17f53e9616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:38.233851 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1098/2181] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:31:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:31:38.235969 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee2c87e-434a-4efd-b764-f80950fb2c1c None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:38.250661 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f056d806-b73b-4034-be19-fa17f53e9616 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:38.252765 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-f056d806-b73b-4034-be19-fa17f53e9616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:38.255886 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee2c87e-434a-4efd-b764-f80950fb2c1c None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:38.266721 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e74332-13fd-40e8-8786-7a5f7f2e9e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:38.267748 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e74332-13fd-40e8-8786-7a5f7f2e9e2b admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:38.268215 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e74332-13fd-40e8-8786-7a5f7f2e9e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:38.270606 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e74332-13fd-40e8-8786-7a5f7f2e9e2b admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:38.271624 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f056d806-b73b-4034-be19-fa17f53e9616 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:38.271973 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e74332-13fd-40e8-8786-7a5f7f2e9e2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:31:38.272598 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e74332-13fd-40e8-8786-7a5f7f2e9e2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:38.275696 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e74332-13fd-40e8-8786-7a5f7f2e9e2b admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:38.277786 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ffc9b6-20be-46f6-a492-03e3764e9aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:38.278483 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ffc9b6-20be-46f6-a492-03e3764e9aa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:38.278943 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ffc9b6-20be-46f6-a492-03e3764e9aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:38.279285 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ffc9b6-20be-46f6-a492-03e3764e9aa7 admin admin] PATH_INFO: `/v3/projects/f4e99d6f6e5e41feb172b0220fbfd79c` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:38.281481 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ffc9b6-20be-46f6-a492-03e3764e9aa7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4e99d6f6e5e41feb172b0220fbfd79c)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:38.283743 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ffc9b6-20be-46f6-a492-03e3764e9aa7 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:38.298692 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1084/2182] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 01:31:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:31:38.303673 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e74332-13fd-40e8-8786-7a5f7f2e9e2b admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:38.318763 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e74332-13fd-40e8-8786-7a5f7f2e9e2b admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:38.324134 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff70625-c7df-435b-bbce-3360aa954910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:38.324745 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff70625-c7df-435b-bbce-3360aa954910 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:38.325031 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff70625-c7df-435b-bbce-3360aa954910 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:38.325309 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff70625-c7df-435b-bbce-3360aa954910 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:38.325940 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff70625-c7df-435b-bbce-3360aa954910 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:38.327973 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff70625-c7df-435b-bbce-3360aa954910 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:38.354819 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-d4ffc9b6-20be-46f6-a492-03e3764e9aa7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4e99d6f6e5e41feb172b0220fbfd79c', 'request_id': 'req-d4ffc9b6-20be-46f6-a492-03e3764e9aa7'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:38.356740 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1085/2183] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:31:38 2022] POST /identity/v3/projects => generated 369 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 01:31:38.361168 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff70625-c7df-435b-bbce-3360aa954910 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:38.361414 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-d4ffc9b6-20be-46f6-a492-03e3764e9aa7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4e99d6f6e5e41feb172b0220fbfd79c', 'request_id': 'req-d4ffc9b6-20be-46f6-a492-03e3764e9aa7'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:38.367759 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-d4ffc9b6-20be-46f6-a492-03e3764e9aa7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4e99d6f6e5e41feb172b0220fbfd79c', 'request_id': 'req-d4ffc9b6-20be-46f6-a492-03e3764e9aa7'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:38.382144 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-d4ffc9b6-20be-46f6-a492-03e3764e9aa7 admin admin] The token cache is being invalidate because project f4e99d6f6e5e41feb172b0220fbfd79c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:31:38.382463 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-d4ffc9b6-20be-46f6-a492-03e3764e9aa7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:38.383400 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-d4ffc9b6-20be-46f6-a492-03e3764e9aa7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:38.384977 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1099/2184] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:31:38 2022] DELETE /identity/v3/projects/f4e99d6f6e5e41feb172b0220fbfd79c => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 01:31:38.389801 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c842b-9efa-4279-91dd-a2534de6c669 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:38.390202 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c842b-9efa-4279-91dd-a2534de6c669 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:38.390578 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c842b-9efa-4279-91dd-a2534de6c669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:38.398141 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:38.411185 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-551c842b-9efa-4279-91dd-a2534de6c669 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:31:38.412583 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-551c842b-9efa-4279-91dd-a2534de6c669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:38.428170 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff70625-c7df-435b-bbce-3360aa954910 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:38.433148 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d897b98-2df1-483f-a7b2-e7a69c69c50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:38.433755 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d897b98-2df1-483f-a7b2-e7a69c69c50a admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:38.434033 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d897b98-2df1-483f-a7b2-e7a69c69c50a admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:38.434327 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d897b98-2df1-483f-a7b2-e7a69c69c50a admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:38.434995 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d897b98-2df1-483f-a7b2-e7a69c69c50a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:38.436869 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d897b98-2df1-483f-a7b2-e7a69c69c50a admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:38.464706 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1086/2185] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:31:38 2022] POST /identity/v3/users => generated 285 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 01:31:38.479360 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d897b98-2df1-483f-a7b2-e7a69c69c50a admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:38.483790 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-4d897b98-2df1-483f-a7b2-e7a69c69c50a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:38.490898 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1100/2186] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:31:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 01:31:38.498025 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e781dc8d-2cfa-4d6a-b490-2455fb41fb5d None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:38.498407 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e781dc8d-2cfa-4d6a-b490-2455fb41fb5d None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:38.498691 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e781dc8d-2cfa-4d6a-b490-2455fb41fb5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:38.500724 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d897b98-2df1-483f-a7b2-e7a69c69c50a admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:38.506440 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf58811a-fb27-4c6c-bc4f-30f216a9de43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:38.507477 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58811a-fb27-4c6c-bc4f-30f216a9de43 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:38.508934 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58811a-fb27-4c6c-bc4f-30f216a9de43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:38.509340 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58811a-fb27-4c6c-bc4f-30f216a9de43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:38.510203 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf58811a-fb27-4c6c-bc4f-30f216a9de43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:38.511857 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf58811a-fb27-4c6c-bc4f-30f216a9de43 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:38.522135 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-e781dc8d-2cfa-4d6a-b490-2455fb41fb5d None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:31:38.523759 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1087/2187] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:31:38 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:31:38.524243 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-e781dc8d-2cfa-4d6a-b490-2455fb41fb5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:38.528037 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf58811a-fb27-4c6c-bc4f-30f216a9de43 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:38.534012 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1101/2188] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:31:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 01:31:38.538072 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e781dc8d-2cfa-4d6a-b490-2455fb41fb5d None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:38.539137 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf58811a-fb27-4c6c-bc4f-30f216a9de43 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:38.544674 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7175389-bfa5-4e03-bdcc-c71584d7e22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:38.545421 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7175389-bfa5-4e03-bdcc-c71584d7e22f admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:38.545773 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7175389-bfa5-4e03-bdcc-c71584d7e22f admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:38.546104 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7175389-bfa5-4e03-bdcc-c71584d7e22f admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:38.546899 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7175389-bfa5-4e03-bdcc-c71584d7e22f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:38.548482 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e781dc8d-2cfa-4d6a-b490-2455fb41fb5d None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:38.548801 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7175389-bfa5-4e03-bdcc-c71584d7e22f admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:38.553455 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295f2cb6-bbed-4533-9eb4-8e46f41ddac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:38.554412 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f2cb6-bbed-4533-9eb4-8e46f41ddac3 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:38.554542 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f2cb6-bbed-4533-9eb4-8e46f41ddac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:38.554904 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f2cb6-bbed-4533-9eb4-8e46f41ddac3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:38.555830 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295f2cb6-bbed-4533-9eb4-8e46f41ddac3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:31:38.556203 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295f2cb6-bbed-4533-9eb4-8e46f41ddac3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:38.557808 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295f2cb6-bbed-4533-9eb4-8e46f41ddac3 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:38.562346 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1088/2189] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:31:38 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 01:31:38.566351 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7175389-bfa5-4e03-bdcc-c71584d7e22f admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:38.571634 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1102/2190] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 01:31:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:31:38.575929 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295f2cb6-bbed-4533-9eb4-8e46f41ddac3 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:38.578893 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7175389-bfa5-4e03-bdcc-c71584d7e22f admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:38.583961 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c18ca16-4ae6-4512-815f-660c68c0ab9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:38.584727 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18ca16-4ae6-4512-815f-660c68c0ab9f admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:38.585099 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18ca16-4ae6-4512-815f-660c68c0ab9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:38.585787 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18ca16-4ae6-4512-815f-660c68c0ab9f admin admin] PATH_INFO: `/v3/projects/a230575e19a545e0a39cc99557f5acae/users/42e5b065b0224f80a07450747be3bdca/roles/13af81971c1c428eae0a571a22ea583d` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:38.588718 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295f2cb6-bbed-4533-9eb4-8e46f41ddac3 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:38.593447 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a42302-07a1-4d87-b42e-4618075621c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:38.594085 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a42302-07a1-4d87-b42e-4618075621c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:38.594398 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a42302-07a1-4d87-b42e-4618075621c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:38.594675 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a42302-07a1-4d87-b42e-4618075621c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:38.596038 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a42302-07a1-4d87-b42e-4618075621c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:38.597971 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a42302-07a1-4d87-b42e-4618075621c8 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:38.606262 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c18ca16-4ae6-4512-815f-660c68c0ab9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a230575e19a545e0a39cc99557f5acae, user_id=42e5b065b0224f80a07450747be3bdca, role_id=13af81971c1c428eae0a571a22ea583d)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:38.609360 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c18ca16-4ae6-4512-815f-660c68c0ab9f admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:38.620485 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:38.628086 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1089/2191] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:31:38 2022] PUT /identity/v3/projects/a230575e19a545e0a39cc99557f5acae/users/42e5b065b0224f80a07450747be3bdca/roles/13af81971c1c428eae0a571a22ea583d => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 01:31:38.638538 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f3dd2-5d82-4920-99fa-cf7e289670d3 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:38.639004 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f3dd2-5d82-4920-99fa-cf7e289670d3 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:38.639279 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f3dd2-5d82-4920-99fa-cf7e289670d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:38.641608 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1103/2192] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:31:38 2022] POST /identity/v3/projects => generated 399 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 01:31:38.645678 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a42302-07a1-4d87-b42e-4618075621c8 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:38.675333 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-236f3dd2-5d82-4920-99fa-cf7e289670d3 None None] MFA Rules not processed for user `42e5b065b0224f80a07450747be3bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:31:38.676568 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-236f3dd2-5d82-4920-99fa-cf7e289670d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:38.725946 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a42302-07a1-4d87-b42e-4618075621c8 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:38.731435 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb16060-8ba6-477c-8d38-304e82c835ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:38.732277 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb16060-8ba6-477c-8d38-304e82c835ad admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:38.732546 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb16060-8ba6-477c-8d38-304e82c835ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:38.732835 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb16060-8ba6-477c-8d38-304e82c835ad admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:38.733439 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb16060-8ba6-477c-8d38-304e82c835ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:38.735491 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb16060-8ba6-477c-8d38-304e82c835ad admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:38.746252 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1090/2193] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:31:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 01:31:38.758535 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236f3dd2-5d82-4920-99fa-cf7e289670d3 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:38.761710 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-236f3dd2-5d82-4920-99fa-cf7e289670d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:38.768647 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1104/2194] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:31:38 2022] POST /identity/v3/users => generated 300 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 01:31:38.772742 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb16060-8ba6-477c-8d38-304e82c835ad admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:38.782765 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb16060-8ba6-477c-8d38-304e82c835ad admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:38.788892 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d983aa2d-a627-4c43-bdca-2c974c0b7dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:38.789515 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d983aa2d-a627-4c43-bdca-2c974c0b7dfe admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:38.789790 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d983aa2d-a627-4c43-bdca-2c974c0b7dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:38.790059 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d983aa2d-a627-4c43-bdca-2c974c0b7dfe admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:38.790742 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d983aa2d-a627-4c43-bdca-2c974c0b7dfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:38.792822 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d983aa2d-a627-4c43-bdca-2c974c0b7dfe admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:38.820240 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1105/2195] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:31:38 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 01:31:38.821921 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d983aa2d-a627-4c43-bdca-2c974c0b7dfe admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:38.834510 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d983aa2d-a627-4c43-bdca-2c974c0b7dfe admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:38.840568 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e3ff54-d237-4405-9358-d2241ded6b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:38.841296 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e3ff54-d237-4405-9358-d2241ded6b57 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:38.841685 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e3ff54-d237-4405-9358-d2241ded6b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:38.841963 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e3ff54-d237-4405-9358-d2241ded6b57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:38.842698 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e3ff54-d237-4405-9358-d2241ded6b57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:38.844370 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236f3dd2-5d82-4920-99fa-cf7e289670d3 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:38.844607 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e3ff54-d237-4405-9358-d2241ded6b57 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:38.851873 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67bb62c-8865-4d38-9d0e-516bac649577 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd73d9b9b63a499d909fec034bf9a259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:38.852765 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67bb62c-8865-4d38-9d0e-516bac649577 service glance] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:38.853132 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67bb62c-8865-4d38-9d0e-516bac649577 service glance] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:38.853492 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67bb62c-8865-4d38-9d0e-516bac649577 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:38.857496 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1106/2196] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:31:38 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 01:31:38.862237 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e3ff54-d237-4405-9358-d2241ded6b57 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:38.872553 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67bb62c-8865-4d38-9d0e-516bac649577 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:38.872741 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e3ff54-d237-4405-9358-d2241ded6b57 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:38.875916 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67bb62c-8865-4d38-9d0e-516bac649577 service glance] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:38.880170 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c62d4f2-1d57-475c-8427-29c230cb0866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:38.880853 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c62d4f2-1d57-475c-8427-29c230cb0866 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:38.881127 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c62d4f2-1d57-475c-8427-29c230cb0866 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:38.881399 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c62d4f2-1d57-475c-8427-29c230cb0866 admin admin] PATH_INFO: `/v3/projects/37aa368333e4471cb05b5e67bf8a22d6/users/a06fb8064b9f448e8f55227f602647f1/roles/13af81971c1c428eae0a571a22ea583d` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:38.889728 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1091/2197] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:31:38 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 01:31:38.899352 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c62d4f2-1d57-475c-8427-29c230cb0866 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37aa368333e4471cb05b5e67bf8a22d6, user_id=a06fb8064b9f448e8f55227f602647f1, role_id=13af81971c1c428eae0a571a22ea583d)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:38.902247 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c62d4f2-1d57-475c-8427-29c230cb0866 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:38.926430 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1107/2198] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:31:38 2022] PUT /identity/v3/projects/37aa368333e4471cb05b5e67bf8a22d6/users/a06fb8064b9f448e8f55227f602647f1/roles/13af81971c1c428eae0a571a22ea583d => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:31:38.936807 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583512a-4892-4b63-a146-ccecf75436dc None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:38.937191 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583512a-4892-4b63-a146-ccecf75436dc None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:38.937807 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583512a-4892-4b63-a146-ccecf75436dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:38.973393 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-2583512a-4892-4b63-a146-ccecf75436dc None None] MFA Rules not processed for user `a06fb8064b9f448e8f55227f602647f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:31:38.975136 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2583512a-4892-4b63-a146-ccecf75436dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:39.074964 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1092/2199] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:31:38 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:31:39.087418 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c62d4f2-1d57-475c-8427-29c230cb0866 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:39.089183 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-6c62d4f2-1d57-475c-8427-29c230cb0866 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:39.098015 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:39.154943 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c62d4f2-1d57-475c-8427-29c230cb0866 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:39.158868 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc74e8c-ef75-4ccf-ba64-6a735e3a951f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7853d40c29af424c8d7913950d89750b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:39.159638 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc74e8c-ef75-4ccf-ba64-6a735e3a951f service cinder] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:39.159917 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc74e8c-ef75-4ccf-ba64-6a735e3a951f service cinder] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:39.160212 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc74e8c-ef75-4ccf-ba64-6a735e3a951f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:39.169045 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc74e8c-ef75-4ccf-ba64-6a735e3a951f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:39.170565 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc74e8c-ef75-4ccf-ba64-6a735e3a951f service cinder] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:39.179835 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1108/2200] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:31:39 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:31:41.338957 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2583512a-4892-4b63-a146-ccecf75436dc None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:41.340633 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2583512a-4892-4b63-a146-ccecf75436dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:41.362896 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:41.408463 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2583512a-4892-4b63-a146-ccecf75436dc None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:41.413422 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74669c1b-3338-41d7-8c29-afa6cc494ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:41.414096 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74669c1b-3338-41d7-8c29-afa6cc494ce6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:41.414413 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74669c1b-3338-41d7-8c29-afa6cc494ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:41.414707 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74669c1b-3338-41d7-8c29-afa6cc494ce6 admin admin] PATH_INFO: `/v3/users/cb8a08e76d0e4313bd0581ec7b1229ca` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:41.415846 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74669c1b-3338-41d7-8c29-afa6cc494ce6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb8a08e76d0e4313bd0581ec7b1229ca)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:41.417793 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74669c1b-3338-41d7-8c29-afa6cc494ce6 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:41.468715 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-74669c1b-3338-41d7-8c29-afa6cc494ce6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb8a08e76d0e4313bd0581ec7b1229ca'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:41.477270 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-74669c1b-3338-41d7-8c29-afa6cc494ce6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb8a08e76d0e4313bd0581ec7b1229ca'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:41.477911 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-74669c1b-3338-41d7-8c29-afa6cc494ce6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb8a08e76d0e4313bd0581ec7b1229ca'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:41.487943 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-74669c1b-3338-41d7-8c29-afa6cc494ce6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb8a08e76d0e4313bd0581ec7b1229ca'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:41.503756 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-74669c1b-3338-41d7-8c29-afa6cc494ce6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb8a08e76d0e4313bd0581ec7b1229ca'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:41.511823 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1093/2201] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:31:41 2022] DELETE /identity/v3/users/cb8a08e76d0e4313bd0581ec7b1229ca => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:31:41.516923 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3498725f-d14a-40ec-b251-89e494fa3754 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:41.517398 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3498725f-d14a-40ec-b251-89e494fa3754 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:41.517493 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3498725f-d14a-40ec-b251-89e494fa3754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:41.539258 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-3498725f-d14a-40ec-b251-89e494fa3754 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:31:41.540442 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-3498725f-d14a-40ec-b251-89e494fa3754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:41.610495 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1109/2202] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:31:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:31:41.620626 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74669c1b-3338-41d7-8c29-afa6cc494ce6 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:41.622331 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-74669c1b-3338-41d7-8c29-afa6cc494ce6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:41.682372 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74669c1b-3338-41d7-8c29-afa6cc494ce6 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:41.687923 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db89e0b5-a19a-4980-b7cd-cdb1bd7f8de5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:41.688568 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89e0b5-a19a-4980-b7cd-cdb1bd7f8de5 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:41.688843 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89e0b5-a19a-4980-b7cd-cdb1bd7f8de5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:41.689111 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89e0b5-a19a-4980-b7cd-cdb1bd7f8de5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:41.699191 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db89e0b5-a19a-4980-b7cd-cdb1bd7f8de5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:41.700632 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db89e0b5-a19a-4980-b7cd-cdb1bd7f8de5 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:41.711025 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1094/2203] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:31:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:31:42.027003 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3498725f-d14a-40ec-b251-89e494fa3754 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:42.028669 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-3498725f-d14a-40ec-b251-89e494fa3754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:42.041725 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3498725f-d14a-40ec-b251-89e494fa3754 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:42.048662 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad931fd-1d72-4ab6-bd2d-175fd81951d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:42.049550 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad931fd-1d72-4ab6-bd2d-175fd81951d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:42.049832 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad931fd-1d72-4ab6-bd2d-175fd81951d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:42.050101 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad931fd-1d72-4ab6-bd2d-175fd81951d2 admin admin] PATH_INFO: `/v3/projects/1ec43c5f38624116a6dd93ae5656fbea` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:42.051315 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad931fd-1d72-4ab6-bd2d-175fd81951d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ec43c5f38624116a6dd93ae5656fbea)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:42.053230 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad931fd-1d72-4ab6-bd2d-175fd81951d2 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:42.104944 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-dad931fd-1d72-4ab6-bd2d-175fd81951d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ec43c5f38624116a6dd93ae5656fbea', 'request_id': 'req-dad931fd-1d72-4ab6-bd2d-175fd81951d2'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:42.110730 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-dad931fd-1d72-4ab6-bd2d-175fd81951d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ec43c5f38624116a6dd93ae5656fbea', 'request_id': 'req-dad931fd-1d72-4ab6-bd2d-175fd81951d2'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:42.116837 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-dad931fd-1d72-4ab6-bd2d-175fd81951d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ec43c5f38624116a6dd93ae5656fbea', 'request_id': 'req-dad931fd-1d72-4ab6-bd2d-175fd81951d2'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:42.130001 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-dad931fd-1d72-4ab6-bd2d-175fd81951d2 admin admin] The token cache is being invalidate because project 1ec43c5f38624116a6dd93ae5656fbea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:31:42.130318 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-dad931fd-1d72-4ab6-bd2d-175fd81951d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:42.130953 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-dad931fd-1d72-4ab6-bd2d-175fd81951d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:42.132451 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1110/2204] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:31:42 2022] DELETE /identity/v3/projects/1ec43c5f38624116a6dd93ae5656fbea => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:31:42.136511 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db89e0b5-a19a-4980-b7cd-cdb1bd7f8de5 service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:42.146756 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db89e0b5-a19a-4980-b7cd-cdb1bd7f8de5 service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:42.190844 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:42.210889 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e2a4c4-944c-49e7-85a6-b35069f9200f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:42.211522 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e2a4c4-944c-49e7-85a6-b35069f9200f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:42.211796 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e2a4c4-944c-49e7-85a6-b35069f9200f admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:42.212067 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e2a4c4-944c-49e7-85a6-b35069f9200f admin admin] PATH_INFO: `/v3/users/13e02de9ef194393bb5e7789ef5bf9e3` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:42.213269 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e2a4c4-944c-49e7-85a6-b35069f9200f admin admin] RBAC: Authorizing `identity:delete_user(user_id=13e02de9ef194393bb5e7789ef5bf9e3)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:42.215228 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e2a4c4-944c-49e7-85a6-b35069f9200f admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:42.263767 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d6e2a4c4-944c-49e7-85a6-b35069f9200f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13e02de9ef194393bb5e7789ef5bf9e3'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:42.276265 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d6e2a4c4-944c-49e7-85a6-b35069f9200f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13e02de9ef194393bb5e7789ef5bf9e3'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:42.276970 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d6e2a4c4-944c-49e7-85a6-b35069f9200f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13e02de9ef194393bb5e7789ef5bf9e3'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:42.285748 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d6e2a4c4-944c-49e7-85a6-b35069f9200f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13e02de9ef194393bb5e7789ef5bf9e3'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:42.297918 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d6e2a4c4-944c-49e7-85a6-b35069f9200f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13e02de9ef194393bb5e7789ef5bf9e3'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:42.303861 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1095/2205] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:31:42 2022] DELETE /identity/v3/users/13e02de9ef194393bb5e7789ef5bf9e3 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:31:42.627298 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad931fd-1d72-4ab6-bd2d-175fd81951d2 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:42.629073 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-dad931fd-1d72-4ab6-bd2d-175fd81951d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:42.642958 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad931fd-1d72-4ab6-bd2d-175fd81951d2 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:42.673355 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:42.703427 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2207775-3dd9-4954-ab71-86fd48bb1653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:42.703997 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2207775-3dd9-4954-ab71-86fd48bb1653 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:42.704298 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2207775-3dd9-4954-ab71-86fd48bb1653 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:42.704551 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2207775-3dd9-4954-ab71-86fd48bb1653 admin admin] PATH_INFO: `/v3/projects/4058fbe4af9a4a39ade91385a5d1e662` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:42.705796 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2207775-3dd9-4954-ab71-86fd48bb1653 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4058fbe4af9a4a39ade91385a5d1e662)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:42.708087 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2207775-3dd9-4954-ab71-86fd48bb1653 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:42.757445 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-a2207775-3dd9-4954-ab71-86fd48bb1653 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4058fbe4af9a4a39ade91385a5d1e662', 'request_id': 'req-a2207775-3dd9-4954-ab71-86fd48bb1653'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:42.762767 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-a2207775-3dd9-4954-ab71-86fd48bb1653 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4058fbe4af9a4a39ade91385a5d1e662', 'request_id': 'req-a2207775-3dd9-4954-ab71-86fd48bb1653'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:42.770435 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-a2207775-3dd9-4954-ab71-86fd48bb1653 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4058fbe4af9a4a39ade91385a5d1e662', 'request_id': 'req-a2207775-3dd9-4954-ab71-86fd48bb1653'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:42.785368 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-a2207775-3dd9-4954-ab71-86fd48bb1653 admin admin] The token cache is being invalidate because project 4058fbe4af9a4a39ade91385a5d1e662 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:31:42.785655 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-a2207775-3dd9-4954-ab71-86fd48bb1653 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:42.786323 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-a2207775-3dd9-4954-ab71-86fd48bb1653 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:42.787918 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1111/2206] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:31:42 2022] DELETE /identity/v3/projects/4058fbe4af9a4a39ade91385a5d1e662 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:31:42.793020 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e346efd-62c5-4057-877d-9ba015e695b4 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:42.793497 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e346efd-62c5-4057-877d-9ba015e695b4 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:42.793597 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e346efd-62c5-4057-877d-9ba015e695b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:42.814435 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-1e346efd-62c5-4057-877d-9ba015e695b4 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:31:42.815662 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-1e346efd-62c5-4057-877d-9ba015e695b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:42.878029 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1096/2207] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:31:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:31:42.887334 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be593c0c-cb12-4220-9d83-3eaae8502ffc None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:42.887631 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be593c0c-cb12-4220-9d83-3eaae8502ffc None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:42.887931 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be593c0c-cb12-4220-9d83-3eaae8502ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:42.908564 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-be593c0c-cb12-4220-9d83-3eaae8502ffc None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:31:42.909802 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-be593c0c-cb12-4220-9d83-3eaae8502ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:42.918869 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1112/2208] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:31:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:31:42.923432 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e346efd-62c5-4057-877d-9ba015e695b4 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:42.933837 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e346efd-62c5-4057-877d-9ba015e695b4 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:42.939362 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e31b4f-30ba-4fa6-adf2-7b3793318fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:42.939992 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e31b4f-30ba-4fa6-adf2-7b3793318fbb admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:42.940255 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e31b4f-30ba-4fa6-adf2-7b3793318fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:42.940513 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e31b4f-30ba-4fa6-adf2-7b3793318fbb admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:42.941156 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e31b4f-30ba-4fa6-adf2-7b3793318fbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:31:42.941493 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e31b4f-30ba-4fa6-adf2-7b3793318fbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:42.943121 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e31b4f-30ba-4fa6-adf2-7b3793318fbb admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:42.955625 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1097/2209] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 01:31:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:31:42.960525 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be593c0c-cb12-4220-9d83-3eaae8502ffc None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:42.971064 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be593c0c-cb12-4220-9d83-3eaae8502ffc None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:42.976435 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb17c14-78d7-4bec-b07b-34989eef5dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:42.977050 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb17c14-78d7-4bec-b07b-34989eef5dce admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:42.977328 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb17c14-78d7-4bec-b07b-34989eef5dce admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:42.977598 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb17c14-78d7-4bec-b07b-34989eef5dce admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:42.978265 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb17c14-78d7-4bec-b07b-34989eef5dce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:42.980173 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb17c14-78d7-4bec-b07b-34989eef5dce admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:43.013761 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1113/2210] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:31:42 2022] POST /identity/v3/projects => generated 367 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:31:43.018150 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e31b4f-30ba-4fa6-adf2-7b3793318fbb admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:43.031247 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e31b4f-30ba-4fa6-adf2-7b3793318fbb admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:43.089385 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:43.107203 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5003b8-13e3-4294-96a0-6a7fd55ad61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:43.107825 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5003b8-13e3-4294-96a0-6a7fd55ad61c admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:43.108101 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5003b8-13e3-4294-96a0-6a7fd55ad61c admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:43.108429 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5003b8-13e3-4294-96a0-6a7fd55ad61c admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:43.109057 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5003b8-13e3-4294-96a0-6a7fd55ad61c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:43.111019 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5003b8-13e3-4294-96a0-6a7fd55ad61c admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:43.137341 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1098/2211] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:31:43 2022] POST /identity/v3/users => generated 284 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:31:43.138663 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb17c14-78d7-4bec-b07b-34989eef5dce admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:43.149593 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb17c14-78d7-4bec-b07b-34989eef5dce admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:43.154292 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6631950b-2bbc-4773-bf76-bd6330893a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:43.154889 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631950b-2bbc-4773-bf76-bd6330893a46 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:43.155344 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631950b-2bbc-4773-bf76-bd6330893a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:43.156067 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631950b-2bbc-4773-bf76-bd6330893a46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:43.156399 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6631950b-2bbc-4773-bf76-bd6330893a46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:43.158173 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6631950b-2bbc-4773-bf76-bd6330893a46 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:43.169286 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1114/2212] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:31:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:31:43.173875 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5003b8-13e3-4294-96a0-6a7fd55ad61c admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:43.184183 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5003b8-13e3-4294-96a0-6a7fd55ad61c admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:43.189831 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c701a-8d68-4478-aa5a-44fe3a267936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:43.190817 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c701a-8d68-4478-aa5a-44fe3a267936 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:43.191095 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c701a-8d68-4478-aa5a-44fe3a267936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:43.191507 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c701a-8d68-4478-aa5a-44fe3a267936 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:43.192300 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269c701a-8d68-4478-aa5a-44fe3a267936 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:43.194224 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269c701a-8d68-4478-aa5a-44fe3a267936 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:43.208835 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1099/2213] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:31:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:31:43.210601 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6631950b-2bbc-4773-bf76-bd6330893a46 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:43.220624 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6631950b-2bbc-4773-bf76-bd6330893a46 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:43.225170 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70702ba3-9b9e-4fe4-9de0-82d23c81bffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:43.225815 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70702ba3-9b9e-4fe4-9de0-82d23c81bffd admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:43.226087 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70702ba3-9b9e-4fe4-9de0-82d23c81bffd admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:43.226386 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70702ba3-9b9e-4fe4-9de0-82d23c81bffd admin admin] PATH_INFO: `/v3/projects/5fc4755db4b54f719115a08ead07dc09/users/e2e918ce6d1649f8ae12033e0ba1491c/roles/13af81971c1c428eae0a571a22ea583d` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:43.241633 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70702ba3-9b9e-4fe4-9de0-82d23c81bffd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fc4755db4b54f719115a08ead07dc09, user_id=e2e918ce6d1649f8ae12033e0ba1491c, role_id=13af81971c1c428eae0a571a22ea583d)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:43.244834 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70702ba3-9b9e-4fe4-9de0-82d23c81bffd admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:43.258412 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1115/2214] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:31:43 2022] PUT /identity/v3/projects/5fc4755db4b54f719115a08ead07dc09/users/e2e918ce6d1649f8ae12033e0ba1491c/roles/13af81971c1c428eae0a571a22ea583d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:31:43.269373 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e98ef-0110-4e05-91b1-7dcbc3551eaf None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:43.269698 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e98ef-0110-4e05-91b1-7dcbc3551eaf None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:43.269968 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e98ef-0110-4e05-91b1-7dcbc3551eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:43.299460 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-8d8e98ef-0110-4e05-91b1-7dcbc3551eaf None None] MFA Rules not processed for user `e2e918ce6d1649f8ae12033e0ba1491c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:31:43.300683 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-8d8e98ef-0110-4e05-91b1-7dcbc3551eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:43.368303 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1100/2215] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:31:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:31:43.372937 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70702ba3-9b9e-4fe4-9de0-82d23c81bffd admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:43.435820 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:43.442012 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70702ba3-9b9e-4fe4-9de0-82d23c81bffd admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:43.449979 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263cc98a-de44-4644-bb44-15a04e4087ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:43.450860 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263cc98a-de44-4644-bb44-15a04e4087ee admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:43.451174 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263cc98a-de44-4644-bb44-15a04e4087ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:43.451445 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263cc98a-de44-4644-bb44-15a04e4087ee admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:43.452172 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263cc98a-de44-4644-bb44-15a04e4087ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:43.456072 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263cc98a-de44-4644-bb44-15a04e4087ee admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:43.488328 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1116/2216] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:31:43 2022] POST /identity/v3/projects => generated 367 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:31:43.492930 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8e98ef-0110-4e05-91b1-7dcbc3551eaf None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:43.504413 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8e98ef-0110-4e05-91b1-7dcbc3551eaf None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:43.563286 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fd42e8-d93f-4b94-9882-8416306a38de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:43.563994 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fd42e8-d93f-4b94-9882-8416306a38de admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:43.564315 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fd42e8-d93f-4b94-9882-8416306a38de admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:43.564587 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fd42e8-d93f-4b94-9882-8416306a38de admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:43.565210 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fd42e8-d93f-4b94-9882-8416306a38de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:43.567442 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fd42e8-d93f-4b94-9882-8416306a38de admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:43.594450 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1101/2217] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:31:43 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:31:43.595623 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263cc98a-de44-4644-bb44-15a04e4087ee admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:43.606367 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263cc98a-de44-4644-bb44-15a04e4087ee admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:43.612370 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a015077-c2d1-454f-9d82-e37bbbce0302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:43.613038 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a015077-c2d1-454f-9d82-e37bbbce0302 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:43.613390 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a015077-c2d1-454f-9d82-e37bbbce0302 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:43.613720 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a015077-c2d1-454f-9d82-e37bbbce0302 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:43.614755 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a015077-c2d1-454f-9d82-e37bbbce0302 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:43.616073 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a015077-c2d1-454f-9d82-e37bbbce0302 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:43.632031 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1117/2218] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:31:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:31:43.633681 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fd42e8-d93f-4b94-9882-8416306a38de admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:43.650924 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fd42e8-d93f-4b94-9882-8416306a38de admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:43.655486 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f337f1-0585-48f7-8c76-06883ae60cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:43.656138 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f337f1-0585-48f7-8c76-06883ae60cac admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:43.656414 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f337f1-0585-48f7-8c76-06883ae60cac admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:43.656680 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f337f1-0585-48f7-8c76-06883ae60cac admin admin] PATH_INFO: `/v3/projects/c707b1c4bcea40b990bdd5f70806f027/users/d2433c9f8d35421d8c67a2b7fbf39f83/roles/fb48693810be495fb4b1893a79429b78` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:43.671969 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f337f1-0585-48f7-8c76-06883ae60cac admin admin] RBAC: Authorizing `identity:create_grant(project_id=c707b1c4bcea40b990bdd5f70806f027, user_id=d2433c9f8d35421d8c67a2b7fbf39f83, role_id=fb48693810be495fb4b1893a79429b78)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:43.674692 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f337f1-0585-48f7-8c76-06883ae60cac admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:43.690087 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1102/2219] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:31:43 2022] PUT /identity/v3/projects/c707b1c4bcea40b990bdd5f70806f027/users/d2433c9f8d35421d8c67a2b7fbf39f83/roles/fb48693810be495fb4b1893a79429b78 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:31:43.694165 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a015077-c2d1-454f-9d82-e37bbbce0302 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:43.705306 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a015077-c2d1-454f-9d82-e37bbbce0302 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:43.768423 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25d4793-f7c1-4acf-b768-a9196f238201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:43.769177 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d4793-f7c1-4acf-b768-a9196f238201 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:43.769461 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d4793-f7c1-4acf-b768-a9196f238201 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:43.769724 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d4793-f7c1-4acf-b768-a9196f238201 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:43.770404 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25d4793-f7c1-4acf-b768-a9196f238201 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:43.771985 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25d4793-f7c1-4acf-b768-a9196f238201 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:43.782488 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1118/2220] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:31:43 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 01:31:43.786677 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f337f1-0585-48f7-8c76-06883ae60cac admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:43.798001 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f337f1-0585-48f7-8c76-06883ae60cac admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:43.802723 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcd7351-a154-4ffb-8ee3-417828283f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:43.803379 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcd7351-a154-4ffb-8ee3-417828283f5b admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:43.803655 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcd7351-a154-4ffb-8ee3-417828283f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:43.803924 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcd7351-a154-4ffb-8ee3-417828283f5b admin admin] PATH_INFO: `/v3/projects/c707b1c4bcea40b990bdd5f70806f027/users/d2433c9f8d35421d8c67a2b7fbf39f83/roles/fb48693810be495fb4b1893a79429b78` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:43.805783 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcd7351-a154-4ffb-8ee3-417828283f5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c707b1c4bcea40b990bdd5f70806f027, user_id=d2433c9f8d35421d8c67a2b7fbf39f83, role_id=fb48693810be495fb4b1893a79429b78)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:43.808449 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcd7351-a154-4ffb-8ee3-417828283f5b admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:43.819569 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1103/2221] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:31:43 2022] PUT /identity/v3/projects/c707b1c4bcea40b990bdd5f70806f027/users/d2433c9f8d35421d8c67a2b7fbf39f83/roles/fb48693810be495fb4b1893a79429b78 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:31:43.830017 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4812af1f-e095-47f1-8521-83ec4c022a60 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:43.830339 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4812af1f-e095-47f1-8521-83ec4c022a60 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:43.830611 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4812af1f-e095-47f1-8521-83ec4c022a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:43.861437 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-4812af1f-e095-47f1-8521-83ec4c022a60 None None] MFA Rules not processed for user `d2433c9f8d35421d8c67a2b7fbf39f83`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:31:43.862708 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-4812af1f-e095-47f1-8521-83ec4c022a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:43.930626 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1119/2222] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:31:43 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:31:43.943849 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcd7351-a154-4ffb-8ee3-417828283f5b admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:43.945468 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-0dcd7351-a154-4ffb-8ee3-417828283f5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:43.960316 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:44.012963 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcd7351-a154-4ffb-8ee3-417828283f5b admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:44.017286 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9044819a-de27-48d5-ad29-42c41fb4fa97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7853d40c29af424c8d7913950d89750b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:44.017909 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044819a-de27-48d5-ad29-42c41fb4fa97 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:44.018223 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044819a-de27-48d5-ad29-42c41fb4fa97 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:44.018487 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044819a-de27-48d5-ad29-42c41fb4fa97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:44.028018 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9044819a-de27-48d5-ad29-42c41fb4fa97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:44.029467 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9044819a-de27-48d5-ad29-42c41fb4fa97 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:44.039607 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1104/2223] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:31:43 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:31:44.139465 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4812af1f-e095-47f1-8521-83ec4c022a60 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:44.140992 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-4812af1f-e095-47f1-8521-83ec4c022a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:44.153392 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4812af1f-e095-47f1-8521-83ec4c022a60 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:44.157058 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99049c68-7a8d-4b34-a4f9-5269f655686d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7853d40c29af424c8d7913950d89750b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:44.157809 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99049c68-7a8d-4b34-a4f9-5269f655686d service cinder] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:44.158482 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99049c68-7a8d-4b34-a4f9-5269f655686d service cinder] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:44.158958 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99049c68-7a8d-4b34-a4f9-5269f655686d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:44.212707 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:44.227491 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99049c68-7a8d-4b34-a4f9-5269f655686d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:44.229947 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99049c68-7a8d-4b34-a4f9-5269f655686d service cinder] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:44.241189 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1120/2224] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:31:44 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:31:44.251656 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9044819a-de27-48d5-ad29-42c41fb4fa97 service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:44.253255 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-9044819a-de27-48d5-ad29-42c41fb4fa97 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:44.329252 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9044819a-de27-48d5-ad29-42c41fb4fa97 service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:44.334194 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5de1e7-ba05-4855-be46-ed8ed526b963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:44.335211 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5de1e7-ba05-4855-be46-ed8ed526b963 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:44.335478 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5de1e7-ba05-4855-be46-ed8ed526b963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:44.335754 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5de1e7-ba05-4855-be46-ed8ed526b963 admin admin] PATH_INFO: `/v3/users/a06fb8064b9f448e8f55227f602647f1` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:44.336917 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5de1e7-ba05-4855-be46-ed8ed526b963 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a06fb8064b9f448e8f55227f602647f1)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:44.338916 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5de1e7-ba05-4855-be46-ed8ed526b963 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:44.390435 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-af5de1e7-ba05-4855-be46-ed8ed526b963 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a06fb8064b9f448e8f55227f602647f1'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:44.400146 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-af5de1e7-ba05-4855-be46-ed8ed526b963 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a06fb8064b9f448e8f55227f602647f1'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:44.401072 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-af5de1e7-ba05-4855-be46-ed8ed526b963 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a06fb8064b9f448e8f55227f602647f1'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:44.409120 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-af5de1e7-ba05-4855-be46-ed8ed526b963 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a06fb8064b9f448e8f55227f602647f1'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:44.422798 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-af5de1e7-ba05-4855-be46-ed8ed526b963 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a06fb8064b9f448e8f55227f602647f1'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:44.430281 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1105/2225] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:31:44 2022] DELETE /identity/v3/users/a06fb8064b9f448e8f55227f602647f1 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:31:44.436322 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e948a9-6c71-4eb9-acb2-1e67c1d5cdd7 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:44.437258 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e948a9-6c71-4eb9-acb2-1e67c1d5cdd7 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:44.437754 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e948a9-6c71-4eb9-acb2-1e67c1d5cdd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:44.460267 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-63e948a9-6c71-4eb9-acb2-1e67c1d5cdd7 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:31:44.461965 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-63e948a9-6c71-4eb9-acb2-1e67c1d5cdd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:44.545535 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1121/2226] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:31:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:31:44.556092 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5de1e7-ba05-4855-be46-ed8ed526b963 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:44.557809 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-af5de1e7-ba05-4855-be46-ed8ed526b963 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:44.594037 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:44.619574 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5de1e7-ba05-4855-be46-ed8ed526b963 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:44.623393 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb6c36a-a7cd-4d18-8a2a-1374b5e78cb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:44.624095 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6c36a-a7cd-4d18-8a2a-1374b5e78cb9 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:44.624371 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6c36a-a7cd-4d18-8a2a-1374b5e78cb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:44.624638 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6c36a-a7cd-4d18-8a2a-1374b5e78cb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:44.633663 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb6c36a-a7cd-4d18-8a2a-1374b5e78cb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:44.635136 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb6c36a-a7cd-4d18-8a2a-1374b5e78cb9 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:44.644598 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1106/2227] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:31:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:31:44.993142 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e948a9-6c71-4eb9-acb2-1e67c1d5cdd7 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:44.994896 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-63e948a9-6c71-4eb9-acb2-1e67c1d5cdd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:45.008016 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e948a9-6c71-4eb9-acb2-1e67c1d5cdd7 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:45.013652 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d52a17-db81-4989-9fc2-e1b675879618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:45.014668 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d52a17-db81-4989-9fc2-e1b675879618 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:45.015008 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d52a17-db81-4989-9fc2-e1b675879618 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:45.015369 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d52a17-db81-4989-9fc2-e1b675879618 admin admin] PATH_INFO: `/v3/projects/37aa368333e4471cb05b5e67bf8a22d6` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:45.016672 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d52a17-db81-4989-9fc2-e1b675879618 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37aa368333e4471cb05b5e67bf8a22d6)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:45.018635 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d52a17-db81-4989-9fc2-e1b675879618 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:45.072382 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-08d52a17-db81-4989-9fc2-e1b675879618 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37aa368333e4471cb05b5e67bf8a22d6', 'request_id': 'req-08d52a17-db81-4989-9fc2-e1b675879618'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:45.078863 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-08d52a17-db81-4989-9fc2-e1b675879618 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37aa368333e4471cb05b5e67bf8a22d6', 'request_id': 'req-08d52a17-db81-4989-9fc2-e1b675879618'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:45.085870 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-08d52a17-db81-4989-9fc2-e1b675879618 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37aa368333e4471cb05b5e67bf8a22d6', 'request_id': 'req-08d52a17-db81-4989-9fc2-e1b675879618'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:45.100130 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-08d52a17-db81-4989-9fc2-e1b675879618 admin admin] The token cache is being invalidate because project 37aa368333e4471cb05b5e67bf8a22d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:31:45.100709 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-08d52a17-db81-4989-9fc2-e1b675879618 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:45.101348 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-08d52a17-db81-4989-9fc2-e1b675879618 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:45.102943 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1122/2228] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:31:44 2022] DELETE /identity/v3/projects/37aa368333e4471cb05b5e67bf8a22d6 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:31:45.107893 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fea95b-120d-4754-8501-91986dd40b1f None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:45.108430 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fea95b-120d-4754-8501-91986dd40b1f None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:45.108523 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fea95b-120d-4754-8501-91986dd40b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:45.129448 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-a9fea95b-120d-4754-8501-91986dd40b1f None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:31:45.130322 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-a9fea95b-120d-4754-8501-91986dd40b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:45.203748 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1107/2229] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:31:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:31:45.212259 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253359d2-f0bc-4a2f-a2c1-4257ccff79ff None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:45.212550 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253359d2-f0bc-4a2f-a2c1-4257ccff79ff None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:45.212828 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253359d2-f0bc-4a2f-a2c1-4257ccff79ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:45.233776 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-253359d2-f0bc-4a2f-a2c1-4257ccff79ff None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:31:45.235129 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-253359d2-f0bc-4a2f-a2c1-4257ccff79ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:45.243737 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1123/2230] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:31:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:31:45.248110 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fea95b-120d-4754-8501-91986dd40b1f None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:45.258618 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fea95b-120d-4754-8501-91986dd40b1f None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:45.263978 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6466bae-cda8-404d-8e24-60fe0c566291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:45.264616 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6466bae-cda8-404d-8e24-60fe0c566291 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:45.264901 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6466bae-cda8-404d-8e24-60fe0c566291 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:45.265168 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6466bae-cda8-404d-8e24-60fe0c566291 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:45.265821 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6466bae-cda8-404d-8e24-60fe0c566291 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:31:45.266133 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6466bae-cda8-404d-8e24-60fe0c566291 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:45.267759 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6466bae-cda8-404d-8e24-60fe0c566291 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:45.279402 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1108/2231] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 01:31:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:31:45.284440 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253359d2-f0bc-4a2f-a2c1-4257ccff79ff None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:45.294398 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253359d2-f0bc-4a2f-a2c1-4257ccff79ff None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:45.299389 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cdd798-72f2-4634-bc0c-3feb0aa0902d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:45.299989 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cdd798-72f2-4634-bc0c-3feb0aa0902d admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:45.300275 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cdd798-72f2-4634-bc0c-3feb0aa0902d admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:45.300572 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cdd798-72f2-4634-bc0c-3feb0aa0902d admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:45.301204 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cdd798-72f2-4634-bc0c-3feb0aa0902d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:45.303220 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cdd798-72f2-4634-bc0c-3feb0aa0902d admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:45.335299 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1124/2232] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:31:45 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 01:31:45.341040 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6466bae-cda8-404d-8e24-60fe0c566291 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:45.351882 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6466bae-cda8-404d-8e24-60fe0c566291 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:45.413289 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c09aa33-d267-4cd9-aa17-5750d3f11541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:45.413906 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09aa33-d267-4cd9-aa17-5750d3f11541 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:45.414202 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09aa33-d267-4cd9-aa17-5750d3f11541 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:45.414467 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09aa33-d267-4cd9-aa17-5750d3f11541 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:45.415100 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c09aa33-d267-4cd9-aa17-5750d3f11541 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:45.417025 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c09aa33-d267-4cd9-aa17-5750d3f11541 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:45.445112 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1109/2233] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:31:45 2022] POST /identity/v3/users => generated 287 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 01:31:45.449633 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cdd798-72f2-4634-bc0c-3feb0aa0902d admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:45.461247 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cdd798-72f2-4634-bc0c-3feb0aa0902d admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:45.466693 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d90f07-d372-49bf-a099-cd59614b8db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:45.467401 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d90f07-d372-49bf-a099-cd59614b8db7 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:45.467670 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d90f07-d372-49bf-a099-cd59614b8db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:45.467963 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d90f07-d372-49bf-a099-cd59614b8db7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:45.468555 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d90f07-d372-49bf-a099-cd59614b8db7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:45.470186 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d90f07-d372-49bf-a099-cd59614b8db7 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:45.480479 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1125/2234] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:31:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:31:45.484672 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c09aa33-d267-4cd9-aa17-5750d3f11541 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:45.495715 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c09aa33-d267-4cd9-aa17-5750d3f11541 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:45.502341 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d78ca1-1c6e-466a-8e14-0e9068ae250a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:45.503067 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d78ca1-1c6e-466a-8e14-0e9068ae250a admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:45.503452 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d78ca1-1c6e-466a-8e14-0e9068ae250a admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:45.503734 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d78ca1-1c6e-466a-8e14-0e9068ae250a admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:45.504614 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d78ca1-1c6e-466a-8e14-0e9068ae250a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:45.506277 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d78ca1-1c6e-466a-8e14-0e9068ae250a admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:45.520112 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1110/2235] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:31:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:31:45.525490 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d90f07-d372-49bf-a099-cd59614b8db7 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:45.538521 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d90f07-d372-49bf-a099-cd59614b8db7 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:45.547342 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adf348e-419f-44d1-9deb-2a7c56d82e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:45.548252 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf348e-419f-44d1-9deb-2a7c56d82e18 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:45.548610 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf348e-419f-44d1-9deb-2a7c56d82e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:45.548958 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf348e-419f-44d1-9deb-2a7c56d82e18 admin admin] PATH_INFO: `/v3/projects/0aac8eeb70174f9386bd57fc38644de1/users/fc190e9f188a4d8d99e58e06e5557391/roles/13af81971c1c428eae0a571a22ea583d` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:45.570256 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adf348e-419f-44d1-9deb-2a7c56d82e18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0aac8eeb70174f9386bd57fc38644de1, user_id=fc190e9f188a4d8d99e58e06e5557391, role_id=13af81971c1c428eae0a571a22ea583d)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:45.572968 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adf348e-419f-44d1-9deb-2a7c56d82e18 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:45.590772 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1126/2236] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:31:45 2022] PUT /identity/v3/projects/0aac8eeb70174f9386bd57fc38644de1/users/fc190e9f188a4d8d99e58e06e5557391/roles/13af81971c1c428eae0a571a22ea583d => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:31:45.596958 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e85c5-0d38-4317-b39b-db339f58939a None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:45.597254 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e85c5-0d38-4317-b39b-db339f58939a None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:45.597509 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e85c5-0d38-4317-b39b-db339f58939a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:45.616646 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-087e85c5-0d38-4317-b39b-db339f58939a None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:31:45.617853 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-087e85c5-0d38-4317-b39b-db339f58939a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:45.655813 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:45.685011 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1111/2237] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:31:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:31:45.695510 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adf348e-419f-44d1-9deb-2a7c56d82e18 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:45.699127 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-5adf348e-419f-44d1-9deb-2a7c56d82e18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:45.715533 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:45.775175 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adf348e-419f-44d1-9deb-2a7c56d82e18 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:45.779514 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5182ba-f5df-4a11-aaa9-38e2c83dae2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:45.780346 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5182ba-f5df-4a11-aaa9-38e2c83dae2d service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:45.780772 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5182ba-f5df-4a11-aaa9-38e2c83dae2d service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:45.781045 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5182ba-f5df-4a11-aaa9-38e2c83dae2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:45.790858 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5182ba-f5df-4a11-aaa9-38e2c83dae2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:45.792212 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5182ba-f5df-4a11-aaa9-38e2c83dae2d service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:45.802915 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1127/2238] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:31:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:31:47.723756 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e85c5-0d38-4317-b39b-db339f58939a None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:47.725399 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-087e85c5-0d38-4317-b39b-db339f58939a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:47.739121 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e85c5-0d38-4317-b39b-db339f58939a None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:47.744495 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82ed236-9f1b-483f-9601-5a6405e4d405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:47.745386 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ed236-9f1b-483f-9601-5a6405e4d405 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:47.745796 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ed236-9f1b-483f-9601-5a6405e4d405 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:47.745923 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ed236-9f1b-483f-9601-5a6405e4d405 admin admin] PATH_INFO: `/v3/users/d63bf659b6344f8aa5800139e1d6db23` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:47.747705 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82ed236-9f1b-483f-9601-5a6405e4d405 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d63bf659b6344f8aa5800139e1d6db23)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:47.750294 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82ed236-9f1b-483f-9601-5a6405e4d405 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:47.821100 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d82ed236-9f1b-483f-9601-5a6405e4d405 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd63bf659b6344f8aa5800139e1d6db23'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:47.838179 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d82ed236-9f1b-483f-9601-5a6405e4d405 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd63bf659b6344f8aa5800139e1d6db23'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:47.839481 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d82ed236-9f1b-483f-9601-5a6405e4d405 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd63bf659b6344f8aa5800139e1d6db23'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:47.862454 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d82ed236-9f1b-483f-9601-5a6405e4d405 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd63bf659b6344f8aa5800139e1d6db23'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:47.880922 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d82ed236-9f1b-483f-9601-5a6405e4d405 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd63bf659b6344f8aa5800139e1d6db23'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:47.892431 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1112/2239] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:31:47 2022] DELETE /identity/v3/users/d63bf659b6344f8aa5800139e1d6db23 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:31:47.909339 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c009903-5392-4c30-be9d-d127b84650f7 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:47.910599 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c009903-5392-4c30-be9d-d127b84650f7 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:47.911079 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c009903-5392-4c30-be9d-d127b84650f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:47.940281 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-5c009903-5392-4c30-be9d-d127b84650f7 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:31:47.941726 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-5c009903-5392-4c30-be9d-d127b84650f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:48.049121 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1128/2240] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:31:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:31:48.060041 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82ed236-9f1b-483f-9601-5a6405e4d405 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:48.062345 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d82ed236-9f1b-483f-9601-5a6405e4d405 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:48.224765 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82ed236-9f1b-483f-9601-5a6405e4d405 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:48.246713 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d7b6fd-4765-42d5-a3d7-27c7fd76909a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:48.248492 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d7b6fd-4765-42d5-a3d7-27c7fd76909a service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:48.248881 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d7b6fd-4765-42d5-a3d7-27c7fd76909a service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:48.249420 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d7b6fd-4765-42d5-a3d7-27c7fd76909a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:48.274034 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d7b6fd-4765-42d5-a3d7-27c7fd76909a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:48.285025 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d7b6fd-4765-42d5-a3d7-27c7fd76909a service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:48.312090 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1113/2241] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:31:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:31:48.866968 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c009903-5392-4c30-be9d-d127b84650f7 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:48.868538 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-5c009903-5392-4c30-be9d-d127b84650f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:48.881039 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c009903-5392-4c30-be9d-d127b84650f7 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:48.891049 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c60494-db06-46ad-ac32-fd6abc9400d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:48.892024 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c60494-db06-46ad-ac32-fd6abc9400d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:48.892559 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c60494-db06-46ad-ac32-fd6abc9400d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:48.893048 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c60494-db06-46ad-ac32-fd6abc9400d0 admin admin] PATH_INFO: `/v3/projects/fddf7ff1599b4253889dd5cb57f59cfe` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:48.894884 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c60494-db06-46ad-ac32-fd6abc9400d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fddf7ff1599b4253889dd5cb57f59cfe)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:48.897466 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c60494-db06-46ad-ac32-fd6abc9400d0 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:49.010192 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-f8c60494-db06-46ad-ac32-fd6abc9400d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fddf7ff1599b4253889dd5cb57f59cfe', 'request_id': 'req-f8c60494-db06-46ad-ac32-fd6abc9400d0'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:49.019370 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-f8c60494-db06-46ad-ac32-fd6abc9400d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fddf7ff1599b4253889dd5cb57f59cfe', 'request_id': 'req-f8c60494-db06-46ad-ac32-fd6abc9400d0'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:49.029657 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-f8c60494-db06-46ad-ac32-fd6abc9400d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fddf7ff1599b4253889dd5cb57f59cfe', 'request_id': 'req-f8c60494-db06-46ad-ac32-fd6abc9400d0'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:49.051845 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-f8c60494-db06-46ad-ac32-fd6abc9400d0 admin admin] The token cache is being invalidate because project fddf7ff1599b4253889dd5cb57f59cfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:31:49.052150 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-f8c60494-db06-46ad-ac32-fd6abc9400d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:49.052904 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-f8c60494-db06-46ad-ac32-fd6abc9400d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:49.055164 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1129/2242] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:31:48 2022] DELETE /identity/v3/projects/fddf7ff1599b4253889dd5cb57f59cfe => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:31:49.059882 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a38816-c54e-41f5-9bee-a958fab9cc80 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:49.060395 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a38816-c54e-41f5-9bee-a958fab9cc80 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:49.060486 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a38816-c54e-41f5-9bee-a958fab9cc80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:49.101058 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-33a38816-c54e-41f5-9bee-a958fab9cc80 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:31:49.102910 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-33a38816-c54e-41f5-9bee-a958fab9cc80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:49.162046 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:49.177050 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1114/2243] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:31:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:31:49.186171 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8799cb8a-c0e9-485d-968b-972beb9d4de3 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:49.186607 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8799cb8a-c0e9-485d-968b-972beb9d4de3 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:49.186977 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8799cb8a-c0e9-485d-968b-972beb9d4de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:49.216149 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-8799cb8a-c0e9-485d-968b-972beb9d4de3 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:31:49.218154 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-8799cb8a-c0e9-485d-968b-972beb9d4de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:49.228100 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1130/2244] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:31:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 01:31:49.231085 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a38816-c54e-41f5-9bee-a958fab9cc80 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:49.242819 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a38816-c54e-41f5-9bee-a958fab9cc80 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:49.248582 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f78086-9c1b-4007-ba49-26321ddf7442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:49.249202 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f78086-9c1b-4007-ba49-26321ddf7442 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:49.250708 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f78086-9c1b-4007-ba49-26321ddf7442 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:49.250987 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f78086-9c1b-4007-ba49-26321ddf7442 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:49.251652 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f78086-9c1b-4007-ba49-26321ddf7442 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:31:49.251952 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f78086-9c1b-4007-ba49-26321ddf7442 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:49.253552 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f78086-9c1b-4007-ba49-26321ddf7442 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:49.273137 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1115/2245] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 01:31:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:31:49.274532 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8799cb8a-c0e9-485d-968b-972beb9d4de3 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:49.285177 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8799cb8a-c0e9-485d-968b-972beb9d4de3 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:49.292176 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c29cd16-fe4c-47b8-b9df-ad0bf79a7336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:49.292790 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c29cd16-fe4c-47b8-b9df-ad0bf79a7336 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:49.293079 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c29cd16-fe4c-47b8-b9df-ad0bf79a7336 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:49.293587 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c29cd16-fe4c-47b8-b9df-ad0bf79a7336 admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:49.293950 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c29cd16-fe4c-47b8-b9df-ad0bf79a7336 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:49.296607 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c29cd16-fe4c-47b8-b9df-ad0bf79a7336 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:49.340504 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1131/2246] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:31:49 2022] POST /identity/v3/projects => generated 385 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:31:49.342047 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f78086-9c1b-4007-ba49-26321ddf7442 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:49.355401 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f78086-9c1b-4007-ba49-26321ddf7442 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:49.434445 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee3b14a-6a36-410c-b3fd-a1045d48de1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:49.435383 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee3b14a-6a36-410c-b3fd-a1045d48de1b admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:49.435841 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee3b14a-6a36-410c-b3fd-a1045d48de1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:49.436433 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee3b14a-6a36-410c-b3fd-a1045d48de1b admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:49.437087 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee3b14a-6a36-410c-b3fd-a1045d48de1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:49.440232 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee3b14a-6a36-410c-b3fd-a1045d48de1b admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:49.467082 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1116/2247] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:31:49 2022] POST /identity/v3/users => generated 293 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 01:31:49.468090 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c29cd16-fe4c-47b8-b9df-ad0bf79a7336 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:49.502890 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c29cd16-fe4c-47b8-b9df-ad0bf79a7336 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:49.508408 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80357da6-1a99-4c0a-b0e5-cf648bdd6835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:49.509557 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80357da6-1a99-4c0a-b0e5-cf648bdd6835 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:49.510001 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80357da6-1a99-4c0a-b0e5-cf648bdd6835 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:49.510449 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80357da6-1a99-4c0a-b0e5-cf648bdd6835 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:49.511319 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80357da6-1a99-4c0a-b0e5-cf648bdd6835 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:49.513683 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80357da6-1a99-4c0a-b0e5-cf648bdd6835 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:49.517213 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:49.530225 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1132/2248] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:31:49 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:31:49.534273 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee3b14a-6a36-410c-b3fd-a1045d48de1b admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:49.557481 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee3b14a-6a36-410c-b3fd-a1045d48de1b admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:49.563835 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf32344-000a-4e35-a5fa-6ec9df79d782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:49.564670 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf32344-000a-4e35-a5fa-6ec9df79d782 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:49.567030 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf32344-000a-4e35-a5fa-6ec9df79d782 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:49.567542 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf32344-000a-4e35-a5fa-6ec9df79d782 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:49.568526 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf32344-000a-4e35-a5fa-6ec9df79d782 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:49.571456 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf32344-000a-4e35-a5fa-6ec9df79d782 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:49.591496 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1117/2249] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:31:49 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 01:31:49.597642 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80357da6-1a99-4c0a-b0e5-cf648bdd6835 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:49.616107 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80357da6-1a99-4c0a-b0e5-cf648bdd6835 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:49.634181 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d7f285-3150-43e2-b7f0-9bf06d933a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:49.635094 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d7f285-3150-43e2-b7f0-9bf06d933a75 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:49.635375 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d7f285-3150-43e2-b7f0-9bf06d933a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:49.635654 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d7f285-3150-43e2-b7f0-9bf06d933a75 admin admin] PATH_INFO: `/v3/projects/7b2f44bfb228425c90d0f0ddd68e711b/users/503851b4d1f1466e8b71b6cceab8d148/roles/13af81971c1c428eae0a571a22ea583d` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:49.656875 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d7f285-3150-43e2-b7f0-9bf06d933a75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b2f44bfb228425c90d0f0ddd68e711b, user_id=503851b4d1f1466e8b71b6cceab8d148, role_id=13af81971c1c428eae0a571a22ea583d)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:49.661879 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d7f285-3150-43e2-b7f0-9bf06d933a75 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:49.688946 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1133/2250] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:31:49 2022] PUT /identity/v3/projects/7b2f44bfb228425c90d0f0ddd68e711b/users/503851b4d1f1466e8b71b6cceab8d148/roles/13af81971c1c428eae0a571a22ea583d => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:31:49.697127 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3815ecad-4768-4eb8-ba3c-6a989d1a7ea0 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:49.698347 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3815ecad-4768-4eb8-ba3c-6a989d1a7ea0 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:49.698838 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3815ecad-4768-4eb8-ba3c-6a989d1a7ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:49.739172 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d7f285-3150-43e2-b7f0-9bf06d933a75 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:49.740445 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-3815ecad-4768-4eb8-ba3c-6a989d1a7ea0 None None] MFA Rules not processed for user `503851b4d1f1466e8b71b6cceab8d148`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:31:49.741313 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-09d7f285-3150-43e2-b7f0-9bf06d933a75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:49.744505 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-3815ecad-4768-4eb8-ba3c-6a989d1a7ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:49.837255 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d7f285-3150-43e2-b7f0-9bf06d933a75 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:49.843281 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f6e0b7-e264-456c-a96c-44f2578076e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:49.844340 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6e0b7-e264-456c-a96c-44f2578076e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:49.845103 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6e0b7-e264-456c-a96c-44f2578076e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:49.845582 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6e0b7-e264-456c-a96c-44f2578076e6 admin admin] PATH_INFO: `/v3/users/e2e918ce6d1649f8ae12033e0ba1491c` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:49.847380 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f6e0b7-e264-456c-a96c-44f2578076e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2e918ce6d1649f8ae12033e0ba1491c)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:49.850266 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f6e0b7-e264-456c-a96c-44f2578076e6 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:49.871682 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1118/2251] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:31:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:31:49.873108 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3815ecad-4768-4eb8-ba3c-6a989d1a7ea0 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:49.875511 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-3815ecad-4768-4eb8-ba3c-6a989d1a7ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:49.999415 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-c0f6e0b7-e264-456c-a96c-44f2578076e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2e918ce6d1649f8ae12033e0ba1491c'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:50.016705 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-c0f6e0b7-e264-456c-a96c-44f2578076e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2e918ce6d1649f8ae12033e0ba1491c'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:50.017702 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-c0f6e0b7-e264-456c-a96c-44f2578076e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2e918ce6d1649f8ae12033e0ba1491c'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:50.029885 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-c0f6e0b7-e264-456c-a96c-44f2578076e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2e918ce6d1649f8ae12033e0ba1491c'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:50.061945 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-c0f6e0b7-e264-456c-a96c-44f2578076e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2e918ce6d1649f8ae12033e0ba1491c'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:50.085861 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1134/2252] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:31:49 2022] DELETE /identity/v3/users/e2e918ce6d1649f8ae12033e0ba1491c => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:31:50.089141 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3815ecad-4768-4eb8-ba3c-6a989d1a7ea0 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:50.091930 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1719dae-da36-403a-84f7-cee7b1e18442 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:50.092310 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1719dae-da36-403a-84f7-cee7b1e18442 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:50.092709 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1719dae-da36-403a-84f7-cee7b1e18442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:50.104040 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:50.138560 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-f1719dae-da36-403a-84f7-cee7b1e18442 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:31:50.140020 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-f1719dae-da36-403a-84f7-cee7b1e18442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:50.172859 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8ea106-4521-4312-bef3-fc2916431f57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7853d40c29af424c8d7913950d89750b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:50.173819 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ea106-4521-4312-bef3-fc2916431f57 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:50.174272 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ea106-4521-4312-bef3-fc2916431f57 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:50.174788 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ea106-4521-4312-bef3-fc2916431f57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:50.176959 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-0e8ea106-4521-4312-bef3-fc2916431f57 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:50.209799 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:50.248062 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1135/2253] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:31:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:31:50.270467 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1719dae-da36-403a-84f7-cee7b1e18442 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:50.274007 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-f1719dae-da36-403a-84f7-cee7b1e18442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:50.309275 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8ea106-4521-4312-bef3-fc2916431f57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:50.310896 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8ea106-4521-4312-bef3-fc2916431f57 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:50.351376 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1119/2254] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:31:49 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:31:50.405496 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1719dae-da36-403a-84f7-cee7b1e18442 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:50.415457 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b10e96-edfa-415f-8996-9f1e17f18c07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:50.416120 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b10e96-edfa-415f-8996-9f1e17f18c07 service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:50.416120 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b10e96-edfa-415f-8996-9f1e17f18c07 service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:50.416415 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b10e96-edfa-415f-8996-9f1e17f18c07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:50.436428 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b10e96-edfa-415f-8996-9f1e17f18c07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:50.438445 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b10e96-edfa-415f-8996-9f1e17f18c07 service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:50.454838 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1136/2255] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:31:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:31:50.887498 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8ea106-4521-4312-bef3-fc2916431f57 service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:50.889224 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-0e8ea106-4521-4312-bef3-fc2916431f57 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:50.922074 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8ea106-4521-4312-bef3-fc2916431f57 service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:50.940470 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2382c2ee-6195-45f2-8beb-99b26170bb66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:50.943319 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2382c2ee-6195-45f2-8beb-99b26170bb66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:50.943552 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2382c2ee-6195-45f2-8beb-99b26170bb66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:50.943830 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2382c2ee-6195-45f2-8beb-99b26170bb66 admin admin] PATH_INFO: `/v3/projects/5fc4755db4b54f719115a08ead07dc09` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:50.945254 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2382c2ee-6195-45f2-8beb-99b26170bb66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fc4755db4b54f719115a08ead07dc09)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:50.950386 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2382c2ee-6195-45f2-8beb-99b26170bb66 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:51.067434 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-2382c2ee-6195-45f2-8beb-99b26170bb66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fc4755db4b54f719115a08ead07dc09', 'request_id': 'req-2382c2ee-6195-45f2-8beb-99b26170bb66'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:51.079769 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-2382c2ee-6195-45f2-8beb-99b26170bb66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fc4755db4b54f719115a08ead07dc09', 'request_id': 'req-2382c2ee-6195-45f2-8beb-99b26170bb66'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:51.089530 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-2382c2ee-6195-45f2-8beb-99b26170bb66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fc4755db4b54f719115a08ead07dc09', 'request_id': 'req-2382c2ee-6195-45f2-8beb-99b26170bb66'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:51.102995 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-2382c2ee-6195-45f2-8beb-99b26170bb66 admin admin] The token cache is being invalidate because project 5fc4755db4b54f719115a08ead07dc09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:31:51.103196 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-2382c2ee-6195-45f2-8beb-99b26170bb66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:51.104044 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-2382c2ee-6195-45f2-8beb-99b26170bb66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:51.105545 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1120/2256] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:31:50 2022] DELETE /identity/v3/projects/5fc4755db4b54f719115a08ead07dc09 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:31:51.110314 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b10e96-edfa-415f-8996-9f1e17f18c07 service neutron] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:51.129936 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b10e96-edfa-415f-8996-9f1e17f18c07 service neutron] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:51.251511 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c922b43c-dff4-4b33-9ea5-4245889234dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:51.254956 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c922b43c-dff4-4b33-9ea5-4245889234dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:51.255411 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c922b43c-dff4-4b33-9ea5-4245889234dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:51.255860 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c922b43c-dff4-4b33-9ea5-4245889234dd admin admin] PATH_INFO: `/v3/users/d2433c9f8d35421d8c67a2b7fbf39f83` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:51.267339 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c922b43c-dff4-4b33-9ea5-4245889234dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2433c9f8d35421d8c67a2b7fbf39f83)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:51.271929 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c922b43c-dff4-4b33-9ea5-4245889234dd admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:51.347847 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-c922b43c-dff4-4b33-9ea5-4245889234dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2433c9f8d35421d8c67a2b7fbf39f83'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:51.364617 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-c922b43c-dff4-4b33-9ea5-4245889234dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2433c9f8d35421d8c67a2b7fbf39f83'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:51.365495 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-c922b43c-dff4-4b33-9ea5-4245889234dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2433c9f8d35421d8c67a2b7fbf39f83'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:51.376838 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-c922b43c-dff4-4b33-9ea5-4245889234dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2433c9f8d35421d8c67a2b7fbf39f83'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:51.402866 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-c922b43c-dff4-4b33-9ea5-4245889234dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2433c9f8d35421d8c67a2b7fbf39f83'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:51.413740 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1137/2257] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:31:51 2022] DELETE /identity/v3/users/d2433c9f8d35421d8c67a2b7fbf39f83 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:31:51.925006 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2382c2ee-6195-45f2-8beb-99b26170bb66 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:51.926945 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2382c2ee-6195-45f2-8beb-99b26170bb66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:51.946200 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2382c2ee-6195-45f2-8beb-99b26170bb66 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:52.000203 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:52.027865 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee9a022-56dd-410e-9e5c-9a669b523c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:52.028691 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee9a022-56dd-410e-9e5c-9a669b523c74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:52.029235 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee9a022-56dd-410e-9e5c-9a669b523c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:52.029865 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee9a022-56dd-410e-9e5c-9a669b523c74 admin admin] PATH_INFO: `/v3/projects/c707b1c4bcea40b990bdd5f70806f027` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:52.031135 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee9a022-56dd-410e-9e5c-9a669b523c74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c707b1c4bcea40b990bdd5f70806f027)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:52.040496 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee9a022-56dd-410e-9e5c-9a669b523c74 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:52.108555 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-2ee9a022-56dd-410e-9e5c-9a669b523c74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c707b1c4bcea40b990bdd5f70806f027', 'request_id': 'req-2ee9a022-56dd-410e-9e5c-9a669b523c74'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:52.118246 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-2ee9a022-56dd-410e-9e5c-9a669b523c74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c707b1c4bcea40b990bdd5f70806f027', 'request_id': 'req-2ee9a022-56dd-410e-9e5c-9a669b523c74'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:52.128124 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-2ee9a022-56dd-410e-9e5c-9a669b523c74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c707b1c4bcea40b990bdd5f70806f027', 'request_id': 'req-2ee9a022-56dd-410e-9e5c-9a669b523c74'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:52.139804 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976265fc-75d7-488c-9c3f-6d34282cac36 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:52.140679 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976265fc-75d7-488c-9c3f-6d34282cac36 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:52.141113 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976265fc-75d7-488c-9c3f-6d34282cac36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:52.166963 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-2ee9a022-56dd-410e-9e5c-9a669b523c74 admin admin] The token cache is being invalidate because project c707b1c4bcea40b990bdd5f70806f027 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:31:52.167497 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-2ee9a022-56dd-410e-9e5c-9a669b523c74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:52.168300 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-2ee9a022-56dd-410e-9e5c-9a669b523c74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:52.170727 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1121/2258] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:31:51 2022] DELETE /identity/v3/projects/c707b1c4bcea40b990bdd5f70806f027 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:31:52.175968 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a2b4f2-5ce0-4e16-8f13-ececae93daae None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:52.177041 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a2b4f2-5ce0-4e16-8f13-ececae93daae None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:52.177500 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a2b4f2-5ce0-4e16-8f13-ececae93daae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:52.186679 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-976265fc-75d7-488c-9c3f-6d34282cac36 None None] MFA Rules not processed for user `fc190e9f188a4d8d99e58e06e5557391`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:31:52.188864 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-976265fc-75d7-488c-9c3f-6d34282cac36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:52.193761 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:52.210411 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-12a2b4f2-5ce0-4e16-8f13-ececae93daae None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:31:52.211748 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-12a2b4f2-5ce0-4e16-8f13-ececae93daae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:52.327520 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1122/2259] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:31:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:31:52.329597 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1138/2260] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:31:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 01:31:52.335491 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a2b4f2-5ce0-4e16-8f13-ececae93daae None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:52.338745 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-12a2b4f2-5ce0-4e16-8f13-ececae93daae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:52.339260 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb2d79-c93f-4425-a400-a3de43cf649d None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:52.340165 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb2d79-c93f-4425-a400-a3de43cf649d None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:52.341285 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb2d79-c93f-4425-a400-a3de43cf649d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:52.368345 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a2b4f2-5ce0-4e16-8f13-ececae93daae None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:52.373858 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6d6ed8-fb15-4710-ac4e-2f827790525d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:52.374503 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d6ed8-fb15-4710-ac4e-2f827790525d admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:52.374775 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d6ed8-fb15-4710-ac4e-2f827790525d admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:52.380271 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d6ed8-fb15-4710-ac4e-2f827790525d admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:52.381070 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6d6ed8-fb15-4710-ac4e-2f827790525d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:52.383057 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6d6ed8-fb15-4710-ac4e-2f827790525d admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:52.389761 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-9bfb2d79-c93f-4425-a400-a3de43cf649d None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:31:52.391421 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-9bfb2d79-c93f-4425-a400-a3de43cf649d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:52.405406 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1139/2261] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:31:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:31:52.411577 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfb2d79-c93f-4425-a400-a3de43cf649d None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:52.414178 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1123/2262] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:31:52 2022] POST /identity/v3/projects => generated 373 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:31:52.417138 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6d6ed8-fb15-4710-ac4e-2f827790525d admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:52.423368 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfb2d79-c93f-4425-a400-a3de43cf649d None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:52.490545 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:52.497296 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df274b85-725c-4907-a4eb-c7d7ed817230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:52.498867 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df274b85-725c-4907-a4eb-c7d7ed817230 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:52.499092 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df274b85-725c-4907-a4eb-c7d7ed817230 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:52.499458 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df274b85-725c-4907-a4eb-c7d7ed817230 admin admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:52.500115 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df274b85-725c-4907-a4eb-c7d7ed817230 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:31:52.500422 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df274b85-725c-4907-a4eb-c7d7ed817230 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:52.502090 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df274b85-725c-4907-a4eb-c7d7ed817230 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:52.505328 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6d6ed8-fb15-4710-ac4e-2f827790525d admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:52.512143 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be687fb3-2398-4ed5-a8d0-935291bc86c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:52.512753 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be687fb3-2398-4ed5-a8d0-935291bc86c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:52.513106 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be687fb3-2398-4ed5-a8d0-935291bc86c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:52.513416 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be687fb3-2398-4ed5-a8d0-935291bc86c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:52.514021 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be687fb3-2398-4ed5-a8d0-935291bc86c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:52.518446 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1140/2263] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 01:31:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:31:52.518584 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be687fb3-2398-4ed5-a8d0-935291bc86c8 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:52.519449 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df274b85-725c-4907-a4eb-c7d7ed817230 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:52.529431 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df274b85-725c-4907-a4eb-c7d7ed817230 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:52.534672 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471ff4ae-0db2-4be3-9f7b-30ba360a6a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:52.535242 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ff4ae-0db2-4be3-9f7b-30ba360a6a3a admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:52.535553 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ff4ae-0db2-4be3-9f7b-30ba360a6a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:52.535782 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ff4ae-0db2-4be3-9f7b-30ba360a6a3a admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:52.536452 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471ff4ae-0db2-4be3-9f7b-30ba360a6a3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:52.541037 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1124/2264] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:31:52 2022] POST /identity/v3/users => generated 293 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:31:52.541172 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471ff4ae-0db2-4be3-9f7b-30ba360a6a3a admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:52.542077 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be687fb3-2398-4ed5-a8d0-935291bc86c8 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:52.559563 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be687fb3-2398-4ed5-a8d0-935291bc86c8 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:52.565152 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31704de-88b7-4b79-940c-d3d58b5c6c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:52.565911 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31704de-88b7-4b79-940c-d3d58b5c6c58 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:52.566222 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31704de-88b7-4b79-940c-d3d58b5c6c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:52.566541 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31704de-88b7-4b79-940c-d3d58b5c6c58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:52.567210 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31704de-88b7-4b79-940c-d3d58b5c6c58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:52.568799 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31704de-88b7-4b79-940c-d3d58b5c6c58 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:52.574785 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1141/2265] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:31:52 2022] POST /identity/v3/projects => generated 369 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 01:31:52.578834 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471ff4ae-0db2-4be3-9f7b-30ba360a6a3a admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:52.580648 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1125/2266] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:31:52 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 01:31:52.584943 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31704de-88b7-4b79-940c-d3d58b5c6c58 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:52.596431 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31704de-88b7-4b79-940c-d3d58b5c6c58 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:52.661860 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471ff4ae-0db2-4be3-9f7b-30ba360a6a3a admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:52.666923 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401f3eef-137a-44b9-84a8-d5f296134871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:52.667523 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f3eef-137a-44b9-84a8-d5f296134871 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:52.667799 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f3eef-137a-44b9-84a8-d5f296134871 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:52.668068 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f3eef-137a-44b9-84a8-d5f296134871 admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:52.668695 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401f3eef-137a-44b9-84a8-d5f296134871 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:52.670781 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401f3eef-137a-44b9-84a8-d5f296134871 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:52.676482 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8c180e-0168-47f7-841c-246184495b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:52.677195 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c180e-0168-47f7-841c-246184495b98 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:52.677543 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c180e-0168-47f7-841c-246184495b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:52.677815 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c180e-0168-47f7-841c-246184495b98 admin admin] PATH_INFO: `/v3/projects/157cb42c62154049b2409a9d9a19d437/users/fac008855aa74358b2f1a78601446257/roles/fb48693810be495fb4b1893a79429b78` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:52.691816 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:52.699830 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1142/2267] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:31:52 2022] POST /identity/v3/users => generated 285 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:31:52.703365 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401f3eef-137a-44b9-84a8-d5f296134871 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:52.709267 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8c180e-0168-47f7-841c-246184495b98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=157cb42c62154049b2409a9d9a19d437, user_id=fac008855aa74358b2f1a78601446257, role_id=fb48693810be495fb4b1893a79429b78)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:52.715573 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8c180e-0168-47f7-841c-246184495b98 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:52.719829 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401f3eef-137a-44b9-84a8-d5f296134871 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:52.723051 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def47b5d-4eb9-4ae1-9a2b-c6a7478499fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:52.723688 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def47b5d-4eb9-4ae1-9a2b-c6a7478499fc admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:52.724006 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def47b5d-4eb9-4ae1-9a2b-c6a7478499fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:52.724249 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def47b5d-4eb9-4ae1-9a2b-c6a7478499fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:52.724898 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def47b5d-4eb9-4ae1-9a2b-c6a7478499fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:52.726565 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def47b5d-4eb9-4ae1-9a2b-c6a7478499fc admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:52.734423 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1126/2268] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:31:52 2022] PUT /identity/v3/projects/157cb42c62154049b2409a9d9a19d437/users/fac008855aa74358b2f1a78601446257/roles/fb48693810be495fb4b1893a79429b78 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 01:31:52.738383 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8c180e-0168-47f7-841c-246184495b98 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:52.742445 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1143/2269] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:31:52 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 01:31:52.746375 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def47b5d-4eb9-4ae1-9a2b-c6a7478499fc admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:52.765048 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def47b5d-4eb9-4ae1-9a2b-c6a7478499fc admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:52.839477 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8c180e-0168-47f7-841c-246184495b98 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:52.840714 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed21ea28-53d1-4425-9a20-3fda9163e8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:52.841423 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21ea28-53d1-4425-9a20-3fda9163e8a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:52.841783 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21ea28-53d1-4425-9a20-3fda9163e8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:52.842057 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21ea28-53d1-4425-9a20-3fda9163e8a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:52.842856 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed21ea28-53d1-4425-9a20-3fda9163e8a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:52.844653 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed21ea28-53d1-4425-9a20-3fda9163e8a2 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:52.844785 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7875ab02-59d9-49bd-968f-8a45d3128ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:52.845297 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875ab02-59d9-49bd-968f-8a45d3128ee8 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:52.845599 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875ab02-59d9-49bd-968f-8a45d3128ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:52.846052 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875ab02-59d9-49bd-968f-8a45d3128ee8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:52.847105 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7875ab02-59d9-49bd-968f-8a45d3128ee8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:52.848703 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7875ab02-59d9-49bd-968f-8a45d3128ee8 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:52.854811 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1144/2270] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:31:52 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 01:31:52.862337 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed21ea28-53d1-4425-9a20-3fda9163e8a2 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:52.862656 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1127/2271] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:31:52 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 01:31:52.863453 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7875ab02-59d9-49bd-968f-8a45d3128ee8 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:52.869958 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed21ea28-53d1-4425-9a20-3fda9163e8a2 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:52.875108 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7875ab02-59d9-49bd-968f-8a45d3128ee8 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:52.875727 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5406c0a7-d51c-481a-8f1c-8d0a9b3d888c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:52.876446 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5406c0a7-d51c-481a-8f1c-8d0a9b3d888c admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:52.876669 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5406c0a7-d51c-481a-8f1c-8d0a9b3d888c admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:52.878270 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5406c0a7-d51c-481a-8f1c-8d0a9b3d888c admin admin] PATH_INFO: `/v3/projects/674e42dc24f540c89d710e12912ff43d/users/e08eddb8387c44a29ebe57f7bb6e4915/roles/13af81971c1c428eae0a571a22ea583d` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:52.880772 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bbfd6a-f803-41e5-bc4b-b91194891053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:52.881495 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bbfd6a-f803-41e5-bc4b-b91194891053 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:52.881755 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bbfd6a-f803-41e5-bc4b-b91194891053 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:52.882026 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bbfd6a-f803-41e5-bc4b-b91194891053 admin admin] PATH_INFO: `/v3/projects/157cb42c62154049b2409a9d9a19d437/users/fac008855aa74358b2f1a78601446257/roles/fb48693810be495fb4b1893a79429b78` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:52.884039 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bbfd6a-f803-41e5-bc4b-b91194891053 admin admin] RBAC: Authorizing `identity:create_grant(project_id=157cb42c62154049b2409a9d9a19d437, user_id=fac008855aa74358b2f1a78601446257, role_id=fb48693810be495fb4b1893a79429b78)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:52.886720 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bbfd6a-f803-41e5-bc4b-b91194891053 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:52.897299 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5406c0a7-d51c-481a-8f1c-8d0a9b3d888c admin admin] RBAC: Authorizing `identity:create_grant(project_id=674e42dc24f540c89d710e12912ff43d, user_id=e08eddb8387c44a29ebe57f7bb6e4915, role_id=13af81971c1c428eae0a571a22ea583d)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:52.899080 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1128/2272] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:31:52 2022] PUT /identity/v3/projects/157cb42c62154049b2409a9d9a19d437/users/fac008855aa74358b2f1a78601446257/roles/fb48693810be495fb4b1893a79429b78 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 01:31:52.900940 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5406c0a7-d51c-481a-8f1c-8d0a9b3d888c admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:52.927645 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1145/2273] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:31:52 2022] PUT /identity/v3/projects/674e42dc24f540c89d710e12912ff43d/users/e08eddb8387c44a29ebe57f7bb6e4915/roles/13af81971c1c428eae0a571a22ea583d => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:31:52.941282 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365feef-50ae-4f07-93ba-df896a89c16b None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:52.941568 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365feef-50ae-4f07-93ba-df896a89c16b None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:52.941841 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365feef-50ae-4f07-93ba-df896a89c16b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:52.993816 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-1365feef-50ae-4f07-93ba-df896a89c16b None None] MFA Rules not processed for user `e08eddb8387c44a29ebe57f7bb6e4915`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:31:52.995105 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-1365feef-50ae-4f07-93ba-df896a89c16b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:53.028497 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:53.086042 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1129/2274] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:31:52 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:31:53.099588 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5406c0a7-d51c-481a-8f1c-8d0a9b3d888c admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:53.103844 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-5406c0a7-d51c-481a-8f1c-8d0a9b3d888c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:53.183954 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5406c0a7-d51c-481a-8f1c-8d0a9b3d888c admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:53.188492 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47d6383-212d-413b-9024-ecbded7a8b38 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd73d9b9b63a499d909fec034bf9a259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:53.189203 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d6383-212d-413b-9024-ecbded7a8b38 service glance] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:53.189693 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d6383-212d-413b-9024-ecbded7a8b38 service glance] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:53.190000 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d6383-212d-413b-9024-ecbded7a8b38 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:53.199212 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47d6383-212d-413b-9024-ecbded7a8b38 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:53.200672 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47d6383-212d-413b-9024-ecbded7a8b38 service glance] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:53.210938 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1146/2275] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:31:53 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:31:56.900364 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1365feef-50ae-4f07-93ba-df896a89c16b None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:56.902327 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-1365feef-50ae-4f07-93ba-df896a89c16b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:57.058325 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1365feef-50ae-4f07-93ba-df896a89c16b None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:57.064539 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00afaaa-bf56-492c-9440-d0cd854a8ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:57.065456 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00afaaa-bf56-492c-9440-d0cd854a8ff7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:57.065905 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00afaaa-bf56-492c-9440-d0cd854a8ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:57.066553 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00afaaa-bf56-492c-9440-d0cd854a8ff7 admin admin] PATH_INFO: `/v3/users/503851b4d1f1466e8b71b6cceab8d148` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:57.067851 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00afaaa-bf56-492c-9440-d0cd854a8ff7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=503851b4d1f1466e8b71b6cceab8d148)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:57.069934 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00afaaa-bf56-492c-9440-d0cd854a8ff7 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:57.175790 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-a00afaaa-bf56-492c-9440-d0cd854a8ff7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '503851b4d1f1466e8b71b6cceab8d148'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:57.189149 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-a00afaaa-bf56-492c-9440-d0cd854a8ff7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '503851b4d1f1466e8b71b6cceab8d148'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:57.190413 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-a00afaaa-bf56-492c-9440-d0cd854a8ff7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '503851b4d1f1466e8b71b6cceab8d148'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:57.206956 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-a00afaaa-bf56-492c-9440-d0cd854a8ff7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '503851b4d1f1466e8b71b6cceab8d148'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:57.234985 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-a00afaaa-bf56-492c-9440-d0cd854a8ff7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '503851b4d1f1466e8b71b6cceab8d148'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:57.248435 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1130/2276] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:31:56 2022] DELETE /identity/v3/users/503851b4d1f1466e8b71b6cceab8d148 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:31:57.252849 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7bd63f-ec6b-43d5-906d-f9d219dbde0a None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:57.252849 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7bd63f-ec6b-43d5-906d-f9d219dbde0a None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:57.252849 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7bd63f-ec6b-43d5-906d-f9d219dbde0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:57.294500 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-1d7bd63f-ec6b-43d5-906d-f9d219dbde0a None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:31:57.296090 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-1d7bd63f-ec6b-43d5-906d-f9d219dbde0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:57.390641 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1147/2277] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:31:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:31:57.400905 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00afaaa-bf56-492c-9440-d0cd854a8ff7 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:57.402420 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-a00afaaa-bf56-492c-9440-d0cd854a8ff7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:57.505855 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:57.513108 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00afaaa-bf56-492c-9440-d0cd854a8ff7 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:57.524281 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6273f73-7c3b-4353-a770-f5c2e4a6481b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:57.527407 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6273f73-7c3b-4353-a770-f5c2e4a6481b service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:57.530688 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6273f73-7c3b-4353-a770-f5c2e4a6481b service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:57.531276 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6273f73-7c3b-4353-a770-f5c2e4a6481b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:57.558418 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6273f73-7c3b-4353-a770-f5c2e4a6481b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:57.561814 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6273f73-7c3b-4353-a770-f5c2e4a6481b service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:57.598544 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1131/2278] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:31:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:31:58.134797 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7bd63f-ec6b-43d5-906d-f9d219dbde0a None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:58.136832 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-1d7bd63f-ec6b-43d5-906d-f9d219dbde0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:58.148102 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:58.152803 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7bd63f-ec6b-43d5-906d-f9d219dbde0a None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:58.159596 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd055c5d-2caa-4a17-8682-568c2c58cdc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:58.160303 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd055c5d-2caa-4a17-8682-568c2c58cdc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:58.160641 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd055c5d-2caa-4a17-8682-568c2c58cdc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:58.160997 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd055c5d-2caa-4a17-8682-568c2c58cdc9 admin admin] PATH_INFO: `/v3/projects/7b2f44bfb228425c90d0f0ddd68e711b` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:58.162515 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd055c5d-2caa-4a17-8682-568c2c58cdc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b2f44bfb228425c90d0f0ddd68e711b)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:58.164474 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd055c5d-2caa-4a17-8682-568c2c58cdc9 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:58.222465 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-cd055c5d-2caa-4a17-8682-568c2c58cdc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b2f44bfb228425c90d0f0ddd68e711b', 'request_id': 'req-cd055c5d-2caa-4a17-8682-568c2c58cdc9'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:58.233450 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-cd055c5d-2caa-4a17-8682-568c2c58cdc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b2f44bfb228425c90d0f0ddd68e711b', 'request_id': 'req-cd055c5d-2caa-4a17-8682-568c2c58cdc9'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:58.245481 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-cd055c5d-2caa-4a17-8682-568c2c58cdc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b2f44bfb228425c90d0f0ddd68e711b', 'request_id': 'req-cd055c5d-2caa-4a17-8682-568c2c58cdc9'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:58.267714 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-cd055c5d-2caa-4a17-8682-568c2c58cdc9 admin admin] The token cache is being invalidate because project 7b2f44bfb228425c90d0f0ddd68e711b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:31:58.268959 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-cd055c5d-2caa-4a17-8682-568c2c58cdc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:58.270363 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-cd055c5d-2caa-4a17-8682-568c2c58cdc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:31:58.272940 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1148/2279] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:31:58 2022] DELETE /identity/v3/projects/7b2f44bfb228425c90d0f0ddd68e711b => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:31:58.277769 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b87ea9-964d-4930-a460-bcdb3f9b3986 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:58.279379 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b87ea9-964d-4930-a460-bcdb3f9b3986 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:58.279865 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b87ea9-964d-4930-a460-bcdb3f9b3986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:58.303082 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-e7b87ea9-964d-4930-a460-bcdb3f9b3986 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:31:58.304997 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-e7b87ea9-964d-4930-a460-bcdb3f9b3986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:58.395870 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1132/2280] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:31:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 01:31:58.405193 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86217145-055b-4fe2-8ca1-cc3d40675c4a None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:58.405884 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86217145-055b-4fe2-8ca1-cc3d40675c4a None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:58.406554 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86217145-055b-4fe2-8ca1-cc3d40675c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:58.432626 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-86217145-055b-4fe2-8ca1-cc3d40675c4a None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:31:58.434030 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-86217145-055b-4fe2-8ca1-cc3d40675c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:58.460403 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1149/2281] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:31:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:31:58.464244 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b87ea9-964d-4930-a460-bcdb3f9b3986 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:58.477050 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b87ea9-964d-4930-a460-bcdb3f9b3986 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:58.485647 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b3b7d1-e528-46fa-af75-b2673190884e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:58.486320 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3b7d1-e528-46fa-af75-b2673190884e admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:58.486600 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3b7d1-e528-46fa-af75-b2673190884e admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:58.486870 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3b7d1-e528-46fa-af75-b2673190884e admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:58.487701 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b3b7d1-e528-46fa-af75-b2673190884e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:31:58.488009 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b3b7d1-e528-46fa-af75-b2673190884e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:58.489805 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b3b7d1-e528-46fa-af75-b2673190884e admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:58.505073 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1133/2282] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 01:31:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:31:58.509398 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86217145-055b-4fe2-8ca1-cc3d40675c4a None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:58.520114 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86217145-055b-4fe2-8ca1-cc3d40675c4a None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:58.525853 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec765190-6c70-4517-ad3b-c667483398db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:58.526789 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec765190-6c70-4517-ad3b-c667483398db admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:58.527559 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec765190-6c70-4517-ad3b-c667483398db admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:58.528029 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec765190-6c70-4517-ad3b-c667483398db admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:58.529013 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec765190-6c70-4517-ad3b-c667483398db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:58.531927 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec765190-6c70-4517-ad3b-c667483398db admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:58.575325 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1150/2283] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:31:58 2022] POST /identity/v3/projects => generated 383 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:31:58.580682 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b3b7d1-e528-46fa-af75-b2673190884e admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:58.596198 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b3b7d1-e528-46fa-af75-b2673190884e admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:58.743096 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e21e0-048d-4fa7-8f26-59ce8e726aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:58.743718 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e21e0-048d-4fa7-8f26-59ce8e726aa0 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:58.743993 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e21e0-048d-4fa7-8f26-59ce8e726aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:58.744270 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e21e0-048d-4fa7-8f26-59ce8e726aa0 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:58.744901 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304e21e0-048d-4fa7-8f26-59ce8e726aa0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:58.753576 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304e21e0-048d-4fa7-8f26-59ce8e726aa0 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:58.807048 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1134/2284] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:31:58 2022] POST /identity/v3/users => generated 292 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 01:31:58.811140 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec765190-6c70-4517-ad3b-c667483398db admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:58.853379 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec765190-6c70-4517-ad3b-c667483398db admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:58.863583 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee57c307-8328-4c76-9747-ec90ed8bf24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:58.864578 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57c307-8328-4c76-9747-ec90ed8bf24d admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:58.864961 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57c307-8328-4c76-9747-ec90ed8bf24d admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:58.865239 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57c307-8328-4c76-9747-ec90ed8bf24d admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:58.866148 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee57c307-8328-4c76-9747-ec90ed8bf24d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:58.870602 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee57c307-8328-4c76-9747-ec90ed8bf24d admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:58.880359 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b77f1a-334b-4882-9bca-7f678fec6345 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:58.880688 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b77f1a-334b-4882-9bca-7f678fec6345 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:58.881004 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b77f1a-334b-4882-9bca-7f678fec6345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:58.900926 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1151/2285] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:31:58 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 01:31:58.902080 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee57c307-8328-4c76-9747-ec90ed8bf24d admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:58.915995 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee57c307-8328-4c76-9747-ec90ed8bf24d admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:58.921276 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-91b77f1a-334b-4882-9bca-7f678fec6345 None None] MFA Rules not processed for user `fac008855aa74358b2f1a78601446257`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:31:58.922322 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b544ebe-fd26-451f-877d-f2b4ac220894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:58.922484 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b544ebe-fd26-451f-877d-f2b4ac220894 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:58.922566 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-91b77f1a-334b-4882-9bca-7f678fec6345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:58.922767 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b544ebe-fd26-451f-877d-f2b4ac220894 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:58.923044 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b544ebe-fd26-451f-877d-f2b4ac220894 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:58.923703 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b544ebe-fd26-451f-877d-f2b4ac220894 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:58.925486 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b544ebe-fd26-451f-877d-f2b4ac220894 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:58.944126 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1152/2286] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:31:58 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 01:31:58.949944 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b544ebe-fd26-451f-877d-f2b4ac220894 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:59.015505 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:59.024954 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b544ebe-fd26-451f-877d-f2b4ac220894 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:59.048816 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1135/2287] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:31:58 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 01:31:59.049035 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd30bf06-57a1-47e2-9eaa-8e4aa7cfbbd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:59.049693 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd30bf06-57a1-47e2-9eaa-8e4aa7cfbbd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:59.050000 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd30bf06-57a1-47e2-9eaa-8e4aa7cfbbd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:59.051452 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd30bf06-57a1-47e2-9eaa-8e4aa7cfbbd5 admin admin] PATH_INFO: `/v3/projects/81965a1bbc1643d3a39a8253d8fef400/users/190aaee0de77475b9041918f14a0d7c6/roles/13af81971c1c428eae0a571a22ea583d` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:59.092275 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd30bf06-57a1-47e2-9eaa-8e4aa7cfbbd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81965a1bbc1643d3a39a8253d8fef400, user_id=190aaee0de77475b9041918f14a0d7c6, role_id=13af81971c1c428eae0a571a22ea583d)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:59.095179 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd30bf06-57a1-47e2-9eaa-8e4aa7cfbbd5 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:59.119852 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1153/2288] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:31:58 2022] PUT /identity/v3/projects/81965a1bbc1643d3a39a8253d8fef400/users/190aaee0de77475b9041918f14a0d7c6/roles/13af81971c1c428eae0a571a22ea583d => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 01:31:59.134322 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2985962a-e79e-47ff-92ee-3ecf97ef94ff None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:59.134740 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2985962a-e79e-47ff-92ee-3ecf97ef94ff None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:59.135230 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2985962a-e79e-47ff-92ee-3ecf97ef94ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:59.174324 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-2985962a-e79e-47ff-92ee-3ecf97ef94ff None None] MFA Rules not processed for user `190aaee0de77475b9041918f14a0d7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:31:59.175581 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2985962a-e79e-47ff-92ee-3ecf97ef94ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:59.200894 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd30bf06-57a1-47e2-9eaa-8e4aa7cfbbd5 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:59.207186 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-dd30bf06-57a1-47e2-9eaa-8e4aa7cfbbd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:59.257876 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1136/2289] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:31:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:31:59.261928 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2985962a-e79e-47ff-92ee-3ecf97ef94ff None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:59.333818 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd30bf06-57a1-47e2-9eaa-8e4aa7cfbbd5 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:59.339460 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccdc3e2-95fa-4059-a43a-b65cee7cd72f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd5e95467b44175be2478c2c7c89926', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:59.340285 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccdc3e2-95fa-4059-a43a-b65cee7cd72f service nova] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:59.340629 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccdc3e2-95fa-4059-a43a-b65cee7cd72f service nova] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:59.340873 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccdc3e2-95fa-4059-a43a-b65cee7cd72f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:59.342865 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-5ccdc3e2-95fa-4059-a43a-b65cee7cd72f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:59.344373 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2985962a-e79e-47ff-92ee-3ecf97ef94ff None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:59.349225 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b055141-cbdd-4b05-ab60-41327781bb95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:59.349968 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b055141-cbdd-4b05-ab60-41327781bb95 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:59.350274 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b055141-cbdd-4b05-ab60-41327781bb95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:59.350551 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b055141-cbdd-4b05-ab60-41327781bb95 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:59.351191 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b055141-cbdd-4b05-ab60-41327781bb95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:59.353144 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b055141-cbdd-4b05-ab60-41327781bb95 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:59.353677 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:59.408562 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1137/2290] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:31:59 2022] POST /identity/v3/projects => generated 385 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:31:59.421112 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b055141-cbdd-4b05-ab60-41327781bb95 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:59.474039 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccdc3e2-95fa-4059-a43a-b65cee7cd72f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:59.495495 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccdc3e2-95fa-4059-a43a-b65cee7cd72f service nova] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:59.507166 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1154/2291] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:31:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:31:59.539956 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b055141-cbdd-4b05-ab60-41327781bb95 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:59.546282 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4907b296-0614-47a1-9df3-60f4e3e673db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:59.547517 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907b296-0614-47a1-9df3-60f4e3e673db admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:59.547858 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907b296-0614-47a1-9df3-60f4e3e673db admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:59.548443 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907b296-0614-47a1-9df3-60f4e3e673db admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:59.549154 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4907b296-0614-47a1-9df3-60f4e3e673db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:59.551372 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4907b296-0614-47a1-9df3-60f4e3e673db admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:59.564806 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:31:59.579699 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1138/2292] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:31:59 2022] POST /identity/v3/users => generated 293 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:31:59.584108 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccdc3e2-95fa-4059-a43a-b65cee7cd72f service nova] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:59.595642 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccdc3e2-95fa-4059-a43a-b65cee7cd72f service nova] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:59.600963 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a124e3-fd28-4c75-9eda-abb066dfef6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:59.601582 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a124e3-fd28-4c75-9eda-abb066dfef6a admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:59.601853 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a124e3-fd28-4c75-9eda-abb066dfef6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:59.602203 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a124e3-fd28-4c75-9eda-abb066dfef6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:59.602828 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a124e3-fd28-4c75-9eda-abb066dfef6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:59.604504 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a124e3-fd28-4c75-9eda-abb066dfef6a admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:59.623686 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1155/2293] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:31:59 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:31:59.628417 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4907b296-0614-47a1-9df3-60f4e3e673db admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:59.639441 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4907b296-0614-47a1-9df3-60f4e3e673db admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:59.647590 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87a7560-219b-474b-b6eb-a4a721198899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:59.648344 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a7560-219b-474b-b6eb-a4a721198899 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:59.648529 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a7560-219b-474b-b6eb-a4a721198899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:59.648795 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a7560-219b-474b-b6eb-a4a721198899 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:59.649560 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87a7560-219b-474b-b6eb-a4a721198899 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:59.651195 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87a7560-219b-474b-b6eb-a4a721198899 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:59.662881 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1139/2294] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:31:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:31:59.667111 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a124e3-fd28-4c75-9eda-abb066dfef6a admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:59.680394 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a124e3-fd28-4c75-9eda-abb066dfef6a admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:31:59.686243 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea22aef-f3bc-4c13-8964-9f061a5fc732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:31:59.687645 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea22aef-f3bc-4c13-8964-9f061a5fc732 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:59.688300 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea22aef-f3bc-4c13-8964-9f061a5fc732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:59.688649 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea22aef-f3bc-4c13-8964-9f061a5fc732 admin admin] PATH_INFO: `/v3/projects/f409ef4219aa45029ba601122d08174e/users/e28b4167a5c4464eae244f9a78a27f8c/roles/13af81971c1c428eae0a571a22ea583d` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:59.712069 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea22aef-f3bc-4c13-8964-9f061a5fc732 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f409ef4219aa45029ba601122d08174e, user_id=e28b4167a5c4464eae244f9a78a27f8c, role_id=13af81971c1c428eae0a571a22ea583d)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:31:59.715821 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea22aef-f3bc-4c13-8964-9f061a5fc732 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:31:59.734153 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1156/2295] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:31:59 2022] PUT /identity/v3/projects/f409ef4219aa45029ba601122d08174e/users/e28b4167a5c4464eae244f9a78a27f8c/roles/13af81971c1c428eae0a571a22ea583d => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 01:31:59.744843 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f3b8ac-d6b3-42a7-905c-b3c85f8e020a None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:31:59.744843 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f3b8ac-d6b3-42a7-905c-b3c85f8e020a None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:31:59.745114 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f3b8ac-d6b3-42a7-905c-b3c85f8e020a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:31:59.795873 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-49f3b8ac-d6b3-42a7-905c-b3c85f8e020a None None] MFA Rules not processed for user `e28b4167a5c4464eae244f9a78a27f8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:31:59.797706 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-49f3b8ac-d6b3-42a7-905c-b3c85f8e020a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:31:59.882372 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1140/2296] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:31:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:31:59.888177 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea22aef-f3bc-4c13-8964-9f061a5fc732 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:31:59.994446 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea22aef-f3bc-4c13-8964-9f061a5fc732 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:32:00.000399 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d5005-2f93-49ab-9ef6-d66cefd5576c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:32:00.001285 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d5005-2f93-49ab-9ef6-d66cefd5576c admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:00.001646 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d5005-2f93-49ab-9ef6-d66cefd5576c admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:00.002004 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d5005-2f93-49ab-9ef6-d66cefd5576c admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:00.003419 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5d5005-2f93-49ab-9ef6-d66cefd5576c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:32:00.007195 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5d5005-2f93-49ab-9ef6-d66cefd5576c admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:32:00.074405 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1157/2297] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:31:59 2022] POST /identity/v3/projects => generated 385 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:32:00.078771 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f3b8ac-d6b3-42a7-905c-b3c85f8e020a None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:32:00.095335 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f3b8ac-d6b3-42a7-905c-b3c85f8e020a None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:32:00.200571 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebcb778-70b2-4197-ba57-4cba8b65dfe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:32:00.201685 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebcb778-70b2-4197-ba57-4cba8b65dfe7 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:00.202200 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebcb778-70b2-4197-ba57-4cba8b65dfe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:00.202855 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebcb778-70b2-4197-ba57-4cba8b65dfe7 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:00.203652 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebcb778-70b2-4197-ba57-4cba8b65dfe7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:32:00.224447 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebcb778-70b2-4197-ba57-4cba8b65dfe7 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:32:00.300288 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1141/2298] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:32:00 2022] POST /identity/v3/users => generated 299 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:32:00.302990 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d5005-2f93-49ab-9ef6-d66cefd5576c admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:32:00.328814 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d5005-2f93-49ab-9ef6-d66cefd5576c admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:32:00.349111 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9219a4-383b-42e1-8a87-023056be24e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:32:00.350657 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9219a4-383b-42e1-8a87-023056be24e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:00.350942 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9219a4-383b-42e1-8a87-023056be24e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:00.351218 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9219a4-383b-42e1-8a87-023056be24e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:00.353857 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9219a4-383b-42e1-8a87-023056be24e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:32:00.361586 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9219a4-383b-42e1-8a87-023056be24e9 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:32:00.414532 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1158/2299] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:32:00 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:32:00.416630 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebcb778-70b2-4197-ba57-4cba8b65dfe7 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:32:00.433551 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebcb778-70b2-4197-ba57-4cba8b65dfe7 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:32:00.470602 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a3b152-8526-43fb-a7a8-1f6b3984652e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:32:00.471273 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a3b152-8526-43fb-a7a8-1f6b3984652e admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:00.471552 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a3b152-8526-43fb-a7a8-1f6b3984652e admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:00.471826 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a3b152-8526-43fb-a7a8-1f6b3984652e admin admin] PATH_INFO: `/v3/projects/9e0c16ece187498f9991b670728e55cd/users/30c770f67c9f41c6bf9608e0dad62c0f/roles/fb48693810be495fb4b1893a79429b78` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:00.515664 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a3b152-8526-43fb-a7a8-1f6b3984652e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e0c16ece187498f9991b670728e55cd, user_id=30c770f67c9f41c6bf9608e0dad62c0f, role_id=fb48693810be495fb4b1893a79429b78)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:32:00.519456 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a3b152-8526-43fb-a7a8-1f6b3984652e admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:32:00.538919 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1142/2300] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:32:00 2022] PUT /identity/v3/projects/9e0c16ece187498f9991b670728e55cd/users/30c770f67c9f41c6bf9608e0dad62c0f/roles/fb48693810be495fb4b1893a79429b78 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:32:00.551893 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9219a4-383b-42e1-8a87-023056be24e9 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:32:00.564387 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9219a4-383b-42e1-8a87-023056be24e9 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:32:00.632295 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:32:00.659994 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0584510-b47e-4ddd-9249-e2282ab78c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:32:00.661082 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0584510-b47e-4ddd-9249-e2282ab78c2f admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:00.661457 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0584510-b47e-4ddd-9249-e2282ab78c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:00.661824 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0584510-b47e-4ddd-9249-e2282ab78c2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:00.662773 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0584510-b47e-4ddd-9249-e2282ab78c2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:32:00.664541 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0584510-b47e-4ddd-9249-e2282ab78c2f admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:32:00.678238 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1159/2301] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:32:00 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:32:00.680586 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a3b152-8526-43fb-a7a8-1f6b3984652e admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:32:00.695444 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a3b152-8526-43fb-a7a8-1f6b3984652e admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:32:00.700929 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c689225c-e636-4228-93e5-6d1794af6530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:32:00.701905 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c689225c-e636-4228-93e5-6d1794af6530 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:00.702319 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c689225c-e636-4228-93e5-6d1794af6530 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:00.702732 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c689225c-e636-4228-93e5-6d1794af6530 admin admin] PATH_INFO: `/v3/projects/9e0c16ece187498f9991b670728e55cd/users/30c770f67c9f41c6bf9608e0dad62c0f/roles/fb48693810be495fb4b1893a79429b78` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:00.704988 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c689225c-e636-4228-93e5-6d1794af6530 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e0c16ece187498f9991b670728e55cd, user_id=30c770f67c9f41c6bf9608e0dad62c0f, role_id=fb48693810be495fb4b1893a79429b78)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:32:00.708311 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c689225c-e636-4228-93e5-6d1794af6530 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:32:00.719632 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1143/2302] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:32:00 2022] PUT /identity/v3/projects/9e0c16ece187498f9991b670728e55cd/users/30c770f67c9f41c6bf9608e0dad62c0f/roles/fb48693810be495fb4b1893a79429b78 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:32:00.731296 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb318aa-5c11-4da7-9002-1f5dc8e637b9 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:00.731670 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb318aa-5c11-4da7-9002-1f5dc8e637b9 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:00.731945 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb318aa-5c11-4da7-9002-1f5dc8e637b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:00.768410 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-3eb318aa-5c11-4da7-9002-1f5dc8e637b9 None None] MFA Rules not processed for user `30c770f67c9f41c6bf9608e0dad62c0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:32:00.770008 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-3eb318aa-5c11-4da7-9002-1f5dc8e637b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:32:00.854820 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1160/2303] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:32:00 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:32:00.867967 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c689225c-e636-4228-93e5-6d1794af6530 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:32:00.869892 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c689225c-e636-4228-93e5-6d1794af6530 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:32:00.910266 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:32:00.940627 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c689225c-e636-4228-93e5-6d1794af6530 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:32:00.957635 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3681bbc4-83cf-497b-8e2b-b09c470b3376 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7853d40c29af424c8d7913950d89750b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:32:00.958640 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3681bbc4-83cf-497b-8e2b-b09c470b3376 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:00.958911 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3681bbc4-83cf-497b-8e2b-b09c470b3376 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:00.959178 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3681bbc4-83cf-497b-8e2b-b09c470b3376 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:01.034831 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3681bbc4-83cf-497b-8e2b-b09c470b3376 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:32:01.038206 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3681bbc4-83cf-497b-8e2b-b09c470b3376 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:32:01.054020 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1144/2304] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:32:00 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:32:01.068348 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd2e07-ba3f-4942-8318-5bed96b72e5f None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:01.068704 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd2e07-ba3f-4942-8318-5bed96b72e5f None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:01.069062 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd2e07-ba3f-4942-8318-5bed96b72e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:01.090597 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-ffdd2e07-ba3f-4942-8318-5bed96b72e5f None None] MFA Rules not processed for user `fc190e9f188a4d8d99e58e06e5557391`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:32:01.092222 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-ffdd2e07-ba3f-4942-8318-5bed96b72e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:32:01.166820 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1161/2305] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:32:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 01:32:02.623075 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3681bbc4-83cf-497b-8e2b-b09c470b3376 service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:32:02.627065 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-3681bbc4-83cf-497b-8e2b-b09c470b3376 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:32:02.638752 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3681bbc4-83cf-497b-8e2b-b09c470b3376 service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:32:02.642385 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f49dbe-478b-4e38-9334-51a2bb313ea2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7853d40c29af424c8d7913950d89750b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:32:02.642995 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f49dbe-478b-4e38-9334-51a2bb313ea2 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:02.643266 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f49dbe-478b-4e38-9334-51a2bb313ea2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:02.643532 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f49dbe-478b-4e38-9334-51a2bb313ea2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:02.713682 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f49dbe-478b-4e38-9334-51a2bb313ea2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:32:02.715595 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f49dbe-478b-4e38-9334-51a2bb313ea2 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:32:02.726198 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1145/2306] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:32:02 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:32:03.231974 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb1db6-f074-42f0-81e8-9e5a9d44e273 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:03.232480 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb1db6-f074-42f0-81e8-9e5a9d44e273 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:03.232576 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb1db6-f074-42f0-81e8-9e5a9d44e273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:03.265715 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-1cdb1db6-f074-42f0-81e8-9e5a9d44e273 None None] MFA Rules not processed for user `c8e85b77280f4a779c1d2ab66891f948`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:32:03.266979 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-1cdb1db6-f074-42f0-81e8-9e5a9d44e273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:32:03.390907 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1162/2307] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:32:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:32:03.581269 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f49dbe-478b-4e38-9334-51a2bb313ea2 service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:32:03.590721 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f49dbe-478b-4e38-9334-51a2bb313ea2 service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:32:03.594731 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a744c504-3f16-4142-8415-795464a7dc0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7853d40c29af424c8d7913950d89750b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:32:03.595344 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a744c504-3f16-4142-8415-795464a7dc0a service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:03.595621 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a744c504-3f16-4142-8415-795464a7dc0a service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:03.595897 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a744c504-3f16-4142-8415-795464a7dc0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:03.605529 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a744c504-3f16-4142-8415-795464a7dc0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:32:03.607246 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a744c504-3f16-4142-8415-795464a7dc0a service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:32:03.617106 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1146/2308] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:32:03 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:32:07.684708 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdb1db6-f074-42f0-81e8-9e5a9d44e273 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:32:07.714335 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:32:07.761309 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdb1db6-f074-42f0-81e8-9e5a9d44e273 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:32:07.766517 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb7c58-1643-44a5-8b2d-fd6ee83766cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:32:07.767173 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb7c58-1643-44a5-8b2d-fd6ee83766cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:07.767446 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb7c58-1643-44a5-8b2d-fd6ee83766cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:07.767716 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb7c58-1643-44a5-8b2d-fd6ee83766cc admin admin] PATH_INFO: `/v3/users/190aaee0de77475b9041918f14a0d7c6` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:07.768884 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeb7c58-1643-44a5-8b2d-fd6ee83766cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=190aaee0de77475b9041918f14a0d7c6)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:32:07.770829 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeb7c58-1643-44a5-8b2d-fd6ee83766cc admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:32:07.826623 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-bfeb7c58-1643-44a5-8b2d-fd6ee83766cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '190aaee0de77475b9041918f14a0d7c6'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:32:07.836058 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-bfeb7c58-1643-44a5-8b2d-fd6ee83766cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '190aaee0de77475b9041918f14a0d7c6'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:32:07.836817 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-bfeb7c58-1643-44a5-8b2d-fd6ee83766cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '190aaee0de77475b9041918f14a0d7c6'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:32:07.844898 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-bfeb7c58-1643-44a5-8b2d-fd6ee83766cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '190aaee0de77475b9041918f14a0d7c6'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:32:07.858518 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-bfeb7c58-1643-44a5-8b2d-fd6ee83766cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '190aaee0de77475b9041918f14a0d7c6'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:32:07.864749 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1163/2309] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:32:07 2022] DELETE /identity/v3/users/190aaee0de77475b9041918f14a0d7c6 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:32:07.869527 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66360213-5769-431d-9773-9ff3b2557c11 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:07.870058 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66360213-5769-431d-9773-9ff3b2557c11 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:07.870058 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66360213-5769-431d-9773-9ff3b2557c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:07.890409 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-66360213-5769-431d-9773-9ff3b2557c11 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:32:07.891674 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-66360213-5769-431d-9773-9ff3b2557c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:32:07.961930 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1147/2310] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:32:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:32:07.970044 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb7c58-1643-44a5-8b2d-fd6ee83766cc admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:32:07.971669 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-bfeb7c58-1643-44a5-8b2d-fd6ee83766cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:32:08.040101 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb7c58-1643-44a5-8b2d-fd6ee83766cc admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:32:08.043945 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc586d8-b437-46bf-a868-d07acac8f87c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:32:08.044550 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc586d8-b437-46bf-a868-d07acac8f87c service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:08.044831 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc586d8-b437-46bf-a868-d07acac8f87c service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:08.045093 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc586d8-b437-46bf-a868-d07acac8f87c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:08.060192 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc586d8-b437-46bf-a868-d07acac8f87c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:32:08.061699 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc586d8-b437-46bf-a868-d07acac8f87c service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:32:08.075396 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1164/2311] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:32:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 01:32:08.482846 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66360213-5769-431d-9773-9ff3b2557c11 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:32:08.482846 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-66360213-5769-431d-9773-9ff3b2557c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:32:08.498496 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66360213-5769-431d-9773-9ff3b2557c11 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:32:08.505046 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c432107-4d6d-46c4-b888-c399f82fcd32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:32:08.505713 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c432107-4d6d-46c4-b888-c399f82fcd32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:08.505944 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c432107-4d6d-46c4-b888-c399f82fcd32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:08.506268 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c432107-4d6d-46c4-b888-c399f82fcd32 admin admin] PATH_INFO: `/v3/projects/81965a1bbc1643d3a39a8253d8fef400` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:08.507713 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c432107-4d6d-46c4-b888-c399f82fcd32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81965a1bbc1643d3a39a8253d8fef400)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:32:08.509831 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c432107-4d6d-46c4-b888-c399f82fcd32 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:32:08.511736 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:32:08.572025 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-2c432107-4d6d-46c4-b888-c399f82fcd32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81965a1bbc1643d3a39a8253d8fef400', 'request_id': 'req-2c432107-4d6d-46c4-b888-c399f82fcd32'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:32:08.588359 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-2c432107-4d6d-46c4-b888-c399f82fcd32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81965a1bbc1643d3a39a8253d8fef400', 'request_id': 'req-2c432107-4d6d-46c4-b888-c399f82fcd32'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:32:08.595378 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-2c432107-4d6d-46c4-b888-c399f82fcd32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81965a1bbc1643d3a39a8253d8fef400', 'request_id': 'req-2c432107-4d6d-46c4-b888-c399f82fcd32'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:32:08.608203 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-2c432107-4d6d-46c4-b888-c399f82fcd32 admin admin] The token cache is being invalidate because project 81965a1bbc1643d3a39a8253d8fef400 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:32:08.608646 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-2c432107-4d6d-46c4-b888-c399f82fcd32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:32:08.609454 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-2c432107-4d6d-46c4-b888-c399f82fcd32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:32:08.611121 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1148/2312] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:32:08 2022] DELETE /identity/v3/projects/81965a1bbc1643d3a39a8253d8fef400 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:32:08.616113 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc586d8-b437-46bf-a868-d07acac8f87c service neutron] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:32:08.627406 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc586d8-b437-46bf-a868-d07acac8f87c service neutron] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:32:08.677756 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:32:08.701157 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e84408-3731-49d7-b24d-96e08b455652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:32:08.702014 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e84408-3731-49d7-b24d-96e08b455652 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:08.702138 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e84408-3731-49d7-b24d-96e08b455652 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:08.702368 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e84408-3731-49d7-b24d-96e08b455652 admin admin] PATH_INFO: `/v3/users/e28b4167a5c4464eae244f9a78a27f8c` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:08.703633 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e84408-3731-49d7-b24d-96e08b455652 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e28b4167a5c4464eae244f9a78a27f8c)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:32:08.705550 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e84408-3731-49d7-b24d-96e08b455652 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:32:08.772574 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-e8e84408-3731-49d7-b24d-96e08b455652 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e28b4167a5c4464eae244f9a78a27f8c'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:32:08.784651 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-e8e84408-3731-49d7-b24d-96e08b455652 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e28b4167a5c4464eae244f9a78a27f8c'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:32:08.787936 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-e8e84408-3731-49d7-b24d-96e08b455652 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e28b4167a5c4464eae244f9a78a27f8c'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:32:08.796332 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-e8e84408-3731-49d7-b24d-96e08b455652 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e28b4167a5c4464eae244f9a78a27f8c'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:32:08.813703 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-e8e84408-3731-49d7-b24d-96e08b455652 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e28b4167a5c4464eae244f9a78a27f8c'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:32:08.826599 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1165/2313] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:32:08 2022] DELETE /identity/v3/users/e28b4167a5c4464eae244f9a78a27f8c => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:32:09.208805 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c432107-4d6d-46c4-b888-c399f82fcd32 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:32:09.211072 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2c432107-4d6d-46c4-b888-c399f82fcd32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:32:09.227511 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c432107-4d6d-46c4-b888-c399f82fcd32 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:32:09.290093 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b512747-5ada-4d65-9d73-35b979dd2724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:32:09.290767 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b512747-5ada-4d65-9d73-35b979dd2724 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:09.291042 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b512747-5ada-4d65-9d73-35b979dd2724 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:09.291339 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b512747-5ada-4d65-9d73-35b979dd2724 admin admin] PATH_INFO: `/v3/projects/f409ef4219aa45029ba601122d08174e` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:09.292845 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b512747-5ada-4d65-9d73-35b979dd2724 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f409ef4219aa45029ba601122d08174e)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:32:09.294813 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b512747-5ada-4d65-9d73-35b979dd2724 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:32:09.348253 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-4b512747-5ada-4d65-9d73-35b979dd2724 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f409ef4219aa45029ba601122d08174e', 'request_id': 'req-4b512747-5ada-4d65-9d73-35b979dd2724'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:32:09.356929 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-4b512747-5ada-4d65-9d73-35b979dd2724 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f409ef4219aa45029ba601122d08174e', 'request_id': 'req-4b512747-5ada-4d65-9d73-35b979dd2724'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:32:09.366954 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-4b512747-5ada-4d65-9d73-35b979dd2724 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f409ef4219aa45029ba601122d08174e', 'request_id': 'req-4b512747-5ada-4d65-9d73-35b979dd2724'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:32:09.378770 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-4b512747-5ada-4d65-9d73-35b979dd2724 admin admin] The token cache is being invalidate because project f409ef4219aa45029ba601122d08174e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:32:09.379185 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-4b512747-5ada-4d65-9d73-35b979dd2724 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:32:09.379929 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-4b512747-5ada-4d65-9d73-35b979dd2724 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:32:09.381571 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1149/2314] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:32:09 2022] DELETE /identity/v3/projects/f409ef4219aa45029ba601122d08174e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:32:09.385816 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e84408-3731-49d7-b24d-96e08b455652 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:32:09.385950 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b512747-5ada-4d65-9d73-35b979dd2724 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:32:09.387384 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-4b512747-5ada-4d65-9d73-35b979dd2724 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:32:09.387822 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-e8e84408-3731-49d7-b24d-96e08b455652 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:32:09.401910 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e84408-3731-49d7-b24d-96e08b455652 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:32:09.410901 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:32:09.469301 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b512747-5ada-4d65-9d73-35b979dd2724 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:32:09.474064 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b73f188-20d6-40f7-ab50-357d982e9d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:32:09.474791 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73f188-20d6-40f7-ab50-357d982e9d04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:09.475064 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73f188-20d6-40f7-ab50-357d982e9d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:09.475334 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73f188-20d6-40f7-ab50-357d982e9d04 admin admin] PATH_INFO: `/v3/users/42e5b065b0224f80a07450747be3bdca` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:09.476713 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b73f188-20d6-40f7-ab50-357d982e9d04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42e5b065b0224f80a07450747be3bdca)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:32:09.479315 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b73f188-20d6-40f7-ab50-357d982e9d04 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:32:09.481585 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ad77d6-e0db-4774-a2ef-198dafa4659b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:32:09.482433 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad77d6-e0db-4774-a2ef-198dafa4659b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:09.482707 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad77d6-e0db-4774-a2ef-198dafa4659b admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:09.482971 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad77d6-e0db-4774-a2ef-198dafa4659b admin admin] PATH_INFO: `/v3/users/30c770f67c9f41c6bf9608e0dad62c0f` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:09.484251 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ad77d6-e0db-4774-a2ef-198dafa4659b admin admin] RBAC: Authorizing `identity:delete_user(user_id=30c770f67c9f41c6bf9608e0dad62c0f)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:32:09.486762 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ad77d6-e0db-4774-a2ef-198dafa4659b admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:32:09.549033 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-3b73f188-20d6-40f7-ab50-357d982e9d04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42e5b065b0224f80a07450747be3bdca'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:32:09.552140 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-a6ad77d6-e0db-4774-a2ef-198dafa4659b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30c770f67c9f41c6bf9608e0dad62c0f'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:32:09.557892 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-3b73f188-20d6-40f7-ab50-357d982e9d04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42e5b065b0224f80a07450747be3bdca'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:32:09.558850 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-3b73f188-20d6-40f7-ab50-357d982e9d04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42e5b065b0224f80a07450747be3bdca'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:32:09.560779 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-a6ad77d6-e0db-4774-a2ef-198dafa4659b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30c770f67c9f41c6bf9608e0dad62c0f'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:32:09.561940 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-a6ad77d6-e0db-4774-a2ef-198dafa4659b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30c770f67c9f41c6bf9608e0dad62c0f'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:32:09.569784 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-a6ad77d6-e0db-4774-a2ef-198dafa4659b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30c770f67c9f41c6bf9608e0dad62c0f'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:32:09.570971 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:32:09.571393 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-3b73f188-20d6-40f7-ab50-357d982e9d04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42e5b065b0224f80a07450747be3bdca'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:32:09.585406 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-a6ad77d6-e0db-4774-a2ef-198dafa4659b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30c770f67c9f41c6bf9608e0dad62c0f'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:32:09.587241 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-3b73f188-20d6-40f7-ab50-357d982e9d04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42e5b065b0224f80a07450747be3bdca'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:32:09.595357 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1166/2315] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:32:09 2022] DELETE /identity/v3/users/30c770f67c9f41c6bf9608e0dad62c0f => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 01:32:09.595570 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1150/2316] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:32:09 2022] DELETE /identity/v3/users/42e5b065b0224f80a07450747be3bdca => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 01:32:09.599026 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe882c6e-f387-41e8-9f4f-8f70a1ccdc02 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:09.599257 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe882c6e-f387-41e8-9f4f-8f70a1ccdc02 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:09.599529 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe882c6e-f387-41e8-9f4f-8f70a1ccdc02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:09.622589 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-fe882c6e-f387-41e8-9f4f-8f70a1ccdc02 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:32:09.623800 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-fe882c6e-f387-41e8-9f4f-8f70a1ccdc02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:32:09.689541 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1167/2317] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:32:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 01:32:09.699857 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b73f188-20d6-40f7-ab50-357d982e9d04 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:32:09.701483 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-3b73f188-20d6-40f7-ab50-357d982e9d04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:32:09.779856 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b73f188-20d6-40f7-ab50-357d982e9d04 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:32:09.784125 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8650fddc-020c-4023-97cd-d72d798469c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:32:09.784790 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8650fddc-020c-4023-97cd-d72d798469c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:09.785067 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8650fddc-020c-4023-97cd-d72d798469c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:09.785336 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8650fddc-020c-4023-97cd-d72d798469c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:09.795525 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8650fddc-020c-4023-97cd-d72d798469c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:32:09.796970 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8650fddc-020c-4023-97cd-d72d798469c6 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:32:09.807669 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1151/2318] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:32:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:32:10.202856 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe882c6e-f387-41e8-9f4f-8f70a1ccdc02 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:32:10.204355 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-fe882c6e-f387-41e8-9f4f-8f70a1ccdc02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:32:10.221996 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe882c6e-f387-41e8-9f4f-8f70a1ccdc02 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:32:10.229341 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eae537e-c30d-47e7-ad67-5dfef28162f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:32:10.230396 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae537e-c30d-47e7-ad67-5dfef28162f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:10.231018 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae537e-c30d-47e7-ad67-5dfef28162f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:10.231767 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae537e-c30d-47e7-ad67-5dfef28162f4 admin admin] PATH_INFO: `/v3/projects/a230575e19a545e0a39cc99557f5acae` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:10.237454 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eae537e-c30d-47e7-ad67-5dfef28162f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a230575e19a545e0a39cc99557f5acae)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:32:10.262270 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eae537e-c30d-47e7-ad67-5dfef28162f4 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:32:10.336441 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-9eae537e-c30d-47e7-ad67-5dfef28162f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a230575e19a545e0a39cc99557f5acae', 'request_id': 'req-9eae537e-c30d-47e7-ad67-5dfef28162f4'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:32:10.345616 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-9eae537e-c30d-47e7-ad67-5dfef28162f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a230575e19a545e0a39cc99557f5acae', 'request_id': 'req-9eae537e-c30d-47e7-ad67-5dfef28162f4'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:32:10.357700 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-9eae537e-c30d-47e7-ad67-5dfef28162f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a230575e19a545e0a39cc99557f5acae', 'request_id': 'req-9eae537e-c30d-47e7-ad67-5dfef28162f4'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:32:10.377486 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-9eae537e-c30d-47e7-ad67-5dfef28162f4 admin admin] The token cache is being invalidate because project a230575e19a545e0a39cc99557f5acae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:32:10.377884 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-9eae537e-c30d-47e7-ad67-5dfef28162f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:32:10.378792 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-9eae537e-c30d-47e7-ad67-5dfef28162f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:32:10.382312 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1168/2319] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:32:10 2022] DELETE /identity/v3/projects/a230575e19a545e0a39cc99557f5acae => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:32:10.385980 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90192145-fc94-41a8-849c-f177d9e5b3e7 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:10.387392 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90192145-fc94-41a8-849c-f177d9e5b3e7 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:10.387868 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90192145-fc94-41a8-849c-f177d9e5b3e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:10.404091 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eae537e-c30d-47e7-ad67-5dfef28162f4 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:32:10.406451 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-9eae537e-c30d-47e7-ad67-5dfef28162f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:32:10.420219 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-90192145-fc94-41a8-849c-f177d9e5b3e7 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:32:10.421881 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-90192145-fc94-41a8-849c-f177d9e5b3e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:32:10.470274 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:32:10.500857 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1152/2320] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:32:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:32:10.510025 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b39fab-34f1-4264-ae3b-cd480795ed7f None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:10.510395 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b39fab-34f1-4264-ae3b-cd480795ed7f None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:10.510660 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b39fab-34f1-4264-ae3b-cd480795ed7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:10.527238 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eae537e-c30d-47e7-ad67-5dfef28162f4 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:32:10.532440 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b76284b-07c5-4c96-a6a7-f6be500ac26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:32:10.533191 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b76284b-07c5-4c96-a6a7-f6be500ac26a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:10.533437 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b76284b-07c5-4c96-a6a7-f6be500ac26a admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:10.533710 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b76284b-07c5-4c96-a6a7-f6be500ac26a admin admin] PATH_INFO: `/v3/projects/9e0c16ece187498f9991b670728e55cd` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:10.534903 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-d7b39fab-34f1-4264-ae3b-cd480795ed7f None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:32:10.536364 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b76284b-07c5-4c96-a6a7-f6be500ac26a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e0c16ece187498f9991b670728e55cd)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:32:10.536477 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d7b39fab-34f1-4264-ae3b-cd480795ed7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:32:10.537419 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b76284b-07c5-4c96-a6a7-f6be500ac26a admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:32:10.545217 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1153/2321] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:32:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:32:10.545749 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:32:10.549550 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b39fab-34f1-4264-ae3b-cd480795ed7f None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:32:10.558961 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b39fab-34f1-4264-ae3b-cd480795ed7f None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:32:10.564403 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deeb6dc-82c8-4a70-b2e8-1d22fcefc66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:32:10.565013 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deeb6dc-82c8-4a70-b2e8-1d22fcefc66e admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:10.565287 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deeb6dc-82c8-4a70-b2e8-1d22fcefc66e admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:10.565556 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deeb6dc-82c8-4a70-b2e8-1d22fcefc66e admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:10.566235 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deeb6dc-82c8-4a70-b2e8-1d22fcefc66e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:32:10.566623 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deeb6dc-82c8-4a70-b2e8-1d22fcefc66e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:32:10.568249 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deeb6dc-82c8-4a70-b2e8-1d22fcefc66e admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:32:10.587908 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1154/2322] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 01:32:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:32:10.589000 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deeb6dc-82c8-4a70-b2e8-1d22fcefc66e admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:32:10.599590 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deeb6dc-82c8-4a70-b2e8-1d22fcefc66e admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:32:10.607255 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-3b76284b-07c5-4c96-a6a7-f6be500ac26a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e0c16ece187498f9991b670728e55cd', 'request_id': 'req-3b76284b-07c5-4c96-a6a7-f6be500ac26a'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:32:10.616054 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-3b76284b-07c5-4c96-a6a7-f6be500ac26a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e0c16ece187498f9991b670728e55cd', 'request_id': 'req-3b76284b-07c5-4c96-a6a7-f6be500ac26a'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:32:10.629385 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-3b76284b-07c5-4c96-a6a7-f6be500ac26a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e0c16ece187498f9991b670728e55cd', 'request_id': 'req-3b76284b-07c5-4c96-a6a7-f6be500ac26a'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:32:10.648421 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-3b76284b-07c5-4c96-a6a7-f6be500ac26a admin admin] The token cache is being invalidate because project 9e0c16ece187498f9991b670728e55cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:32:10.648797 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-3b76284b-07c5-4c96-a6a7-f6be500ac26a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:32:10.649999 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-3b76284b-07c5-4c96-a6a7-f6be500ac26a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:32:10.652691 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1169/2323] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:32:10 2022] DELETE /identity/v3/projects/9e0c16ece187498f9991b670728e55cd => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 01:32:10.657362 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caccd0d2-4c90-49ea-96f4-7b14e2a550c7 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:10.657647 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caccd0d2-4c90-49ea-96f4-7b14e2a550c7 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:10.657919 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caccd0d2-4c90-49ea-96f4-7b14e2a550c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:10.679041 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44df47dc-d319-4e80-9d74-b47abec879fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:32:10.679307 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-caccd0d2-4c90-49ea-96f4-7b14e2a550c7 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:32:10.680470 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df47dc-d319-4e80-9d74-b47abec879fd admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:10.680585 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-caccd0d2-4c90-49ea-96f4-7b14e2a550c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:32:10.681401 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df47dc-d319-4e80-9d74-b47abec879fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:10.682032 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df47dc-d319-4e80-9d74-b47abec879fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:10.684109 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44df47dc-d319-4e80-9d74-b47abec879fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:32:10.687396 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44df47dc-d319-4e80-9d74-b47abec879fd admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:32:10.691169 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1170/2324] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:32:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:32:10.699280 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598213b4-bb6f-4bac-b6ed-41ebb61c6ac3 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:10.699580 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598213b4-bb6f-4bac-b6ed-41ebb61c6ac3 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:10.699822 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598213b4-bb6f-4bac-b6ed-41ebb61c6ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:10.737370 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-598213b4-bb6f-4bac-b6ed-41ebb61c6ac3 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:32:10.738649 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-598213b4-bb6f-4bac-b6ed-41ebb61c6ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:32:10.754171 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1155/2325] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:32:10 2022] POST /identity/v3/projects => generated 391 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 01:32:10.755175 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1171/2326] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:32:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:32:10.759293 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598213b4-bb6f-4bac-b6ed-41ebb61c6ac3 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:32:10.761622 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44df47dc-d319-4e80-9d74-b47abec879fd admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:32:10.763922 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-44df47dc-d319-4e80-9d74-b47abec879fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:32:10.769659 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598213b4-bb6f-4bac-b6ed-41ebb61c6ac3 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:32:10.842148 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186d4a7e-2487-4e1c-8264-5a4eba5cdb60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:32:10.842974 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d4a7e-2487-4e1c-8264-5a4eba5cdb60 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:10.843319 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d4a7e-2487-4e1c-8264-5a4eba5cdb60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:10.844100 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d4a7e-2487-4e1c-8264-5a4eba5cdb60 admin admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:10.844236 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186d4a7e-2487-4e1c-8264-5a4eba5cdb60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:32:10.844535 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186d4a7e-2487-4e1c-8264-5a4eba5cdb60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:32:10.846157 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186d4a7e-2487-4e1c-8264-5a4eba5cdb60 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:32:10.855093 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44df47dc-d319-4e80-9d74-b47abec879fd admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:32:10.859908 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1172/2327] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 01:32:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:32:10.860542 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eabec9f-074e-4c1b-81ed-ce559b7eea25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:32:10.861343 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eabec9f-074e-4c1b-81ed-ce559b7eea25 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:10.861563 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eabec9f-074e-4c1b-81ed-ce559b7eea25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:10.861829 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eabec9f-074e-4c1b-81ed-ce559b7eea25 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:10.862490 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eabec9f-074e-4c1b-81ed-ce559b7eea25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:32:10.864163 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186d4a7e-2487-4e1c-8264-5a4eba5cdb60 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:32:10.864570 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eabec9f-074e-4c1b-81ed-ce559b7eea25 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:32:10.874518 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186d4a7e-2487-4e1c-8264-5a4eba5cdb60 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:32:10.879653 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971c9382-3925-457d-ae91-488528f3b2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:32:10.880118 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c9382-3925-457d-ae91-488528f3b2cb admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:10.880434 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c9382-3925-457d-ae91-488528f3b2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:10.880705 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c9382-3925-457d-ae91-488528f3b2cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:10.881880 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971c9382-3925-457d-ae91-488528f3b2cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:32:10.884260 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971c9382-3925-457d-ae91-488528f3b2cb admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:32:10.889547 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1156/2328] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:32:10 2022] POST /identity/v3/users => generated 296 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:32:10.893475 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eabec9f-074e-4c1b-81ed-ce559b7eea25 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:32:10.903874 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eabec9f-074e-4c1b-81ed-ce559b7eea25 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:32:10.909215 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9c1263-1859-44f0-aa85-29557edfd71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:32:10.909848 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c1263-1859-44f0-aa85-29557edfd71a admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:10.910264 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c1263-1859-44f0-aa85-29557edfd71a admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:10.910570 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c1263-1859-44f0-aa85-29557edfd71a admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:10.911260 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9c1263-1859-44f0-aa85-29557edfd71a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:32:10.914320 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9c1263-1859-44f0-aa85-29557edfd71a admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:32:10.917820 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1173/2329] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:32:10 2022] POST /identity/v3/projects => generated 371 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:32:10.921970 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971c9382-3925-457d-ae91-488528f3b2cb admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:32:10.928083 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1157/2330] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:32:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 01:32:10.930625 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9c1263-1859-44f0-aa85-29557edfd71a admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:32:10.941550 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9c1263-1859-44f0-aa85-29557edfd71a admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:32:10.982509 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:32:10.997140 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:32:11.015300 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971c9382-3925-457d-ae91-488528f3b2cb admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:32:11.021345 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b13fe8-b9a3-4c28-9588-643f715479bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:32:11.022336 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b13fe8-b9a3-4c28-9588-643f715479bf admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:11.022713 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b13fe8-b9a3-4c28-9588-643f715479bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:11.023026 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b13fe8-b9a3-4c28-9588-643f715479bf admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:11.023825 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b13fe8-b9a3-4c28-9588-643f715479bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:32:11.026755 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b13fe8-b9a3-4c28-9588-643f715479bf admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:32:11.032597 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cd7e26-8bf3-4837-9865-c012f65eeb9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:32:11.033287 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd7e26-8bf3-4837-9865-c012f65eeb9b admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:11.033630 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd7e26-8bf3-4837-9865-c012f65eeb9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:11.033962 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd7e26-8bf3-4837-9865-c012f65eeb9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:11.034700 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cd7e26-8bf3-4837-9865-c012f65eeb9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:32:11.036396 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cd7e26-8bf3-4837-9865-c012f65eeb9b admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:32:11.050163 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1158/2331] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:32:10 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 01:32:11.052157 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cd7e26-8bf3-4837-9865-c012f65eeb9b admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:32:11.056758 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1174/2332] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:32:10 2022] POST /identity/v3/users => generated 286 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:32:11.058262 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b13fe8-b9a3-4c28-9588-643f715479bf admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:32:11.064846 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cd7e26-8bf3-4837-9865-c012f65eeb9b admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:32:11.070269 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b13fe8-b9a3-4c28-9588-643f715479bf admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:32:11.070680 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fb3ddc-4917-4c5f-a2c8-71dc31284d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:32:11.071343 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb3ddc-4917-4c5f-a2c8-71dc31284d30 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:11.071675 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb3ddc-4917-4c5f-a2c8-71dc31284d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:11.071931 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb3ddc-4917-4c5f-a2c8-71dc31284d30 admin admin] PATH_INFO: `/v3/projects/ac349beccac744628bca91008e7afbc5/users/83e8cbaf1c004e85988af4e1c61dc962/roles/13af81971c1c428eae0a571a22ea583d` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:11.075735 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8220518-f914-4e5a-adee-5d1f6304421c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:32:11.077240 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8220518-f914-4e5a-adee-5d1f6304421c admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:11.077587 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8220518-f914-4e5a-adee-5d1f6304421c admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:11.077925 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8220518-f914-4e5a-adee-5d1f6304421c admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:11.078664 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8220518-f914-4e5a-adee-5d1f6304421c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:32:11.080380 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8220518-f914-4e5a-adee-5d1f6304421c admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:32:11.091928 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fb3ddc-4917-4c5f-a2c8-71dc31284d30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac349beccac744628bca91008e7afbc5, user_id=83e8cbaf1c004e85988af4e1c61dc962, role_id=13af81971c1c428eae0a571a22ea583d)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:32:11.092330 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1175/2333] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:32:11.095357 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fb3ddc-4917-4c5f-a2c8-71dc31284d30 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:32:11.096290 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8220518-f914-4e5a-adee-5d1f6304421c admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:32:11.110157 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8220518-f914-4e5a-adee-5d1f6304421c admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:32:11.113890 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1159/2334] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:32:11 2022] PUT /identity/v3/projects/ac349beccac744628bca91008e7afbc5/users/83e8cbaf1c004e85988af4e1c61dc962/roles/13af81971c1c428eae0a571a22ea583d => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 01:32:11.124425 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c143e84-3b81-4a33-bdc3-1f93be54f6af None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:11.124815 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c143e84-3b81-4a33-bdc3-1f93be54f6af None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:11.124976 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c143e84-3b81-4a33-bdc3-1f93be54f6af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:11.155651 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-3c143e84-3b81-4a33-bdc3-1f93be54f6af None None] MFA Rules not processed for user `83e8cbaf1c004e85988af4e1c61dc962`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:32:11.157015 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-3c143e84-3b81-4a33-bdc3-1f93be54f6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:32:11.186136 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1649a0-a857-430f-8ed8-6b3a99da520c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:32:11.186903 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1649a0-a857-430f-8ed8-6b3a99da520c admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:11.187214 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1649a0-a857-430f-8ed8-6b3a99da520c admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:11.187486 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1649a0-a857-430f-8ed8-6b3a99da520c admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:11.188137 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1649a0-a857-430f-8ed8-6b3a99da520c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:32:11.189725 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1649a0-a857-430f-8ed8-6b3a99da520c admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:32:11.204131 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1176/2335] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 01:32:11.205928 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1649a0-a857-430f-8ed8-6b3a99da520c admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:32:11.218689 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1649a0-a857-430f-8ed8-6b3a99da520c admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:32:11.224641 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e1394a-1e3a-4b44-bddb-7ee811c811a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:32:11.225425 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e1394a-1e3a-4b44-bddb-7ee811c811a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:11.225993 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e1394a-1e3a-4b44-bddb-7ee811c811a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:11.225993 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e1394a-1e3a-4b44-bddb-7ee811c811a2 admin admin] PATH_INFO: `/v3/projects/a285da96fb8949af9c1ba57dd57da378/users/b64aef2e91cd452ea241a025155972a6/roles/13af81971c1c428eae0a571a22ea583d` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:11.246084 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e1394a-1e3a-4b44-bddb-7ee811c811a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a285da96fb8949af9c1ba57dd57da378, user_id=b64aef2e91cd452ea241a025155972a6, role_id=13af81971c1c428eae0a571a22ea583d)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:32:11.249838 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e1394a-1e3a-4b44-bddb-7ee811c811a2 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:32:11.254303 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1160/2336] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:32:11 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 01:32:11.264821 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c143e84-3b81-4a33-bdc3-1f93be54f6af None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:32:11.267880 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-3c143e84-3b81-4a33-bdc3-1f93be54f6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:32:11.280474 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1177/2337] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:32:11 2022] PUT /identity/v3/projects/a285da96fb8949af9c1ba57dd57da378/users/b64aef2e91cd452ea241a025155972a6/roles/13af81971c1c428eae0a571a22ea583d => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 01:32:11.282187 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd73744a-a32c-496f-93f3-b1a62431748e None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:11.282535 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd73744a-a32c-496f-93f3-b1a62431748e None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:11.282817 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd73744a-a32c-496f-93f3-b1a62431748e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:11.318052 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-cd73744a-a32c-496f-93f3-b1a62431748e None None] MFA Rules not processed for user `b64aef2e91cd452ea241a025155972a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:32:11.318924 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-cd73744a-a32c-496f-93f3-b1a62431748e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:32:11.356537 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c143e84-3b81-4a33-bdc3-1f93be54f6af None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:32:11.395235 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1178/2338] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:32:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 01:32:11.413544 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:32:11.425379 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76c5856-ef25-441c-b92f-40e72bfcf066 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7853d40c29af424c8d7913950d89750b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:32:11.426168 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c5856-ef25-441c-b92f-40e72bfcf066 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:11.426645 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c5856-ef25-441c-b92f-40e72bfcf066 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:11.427035 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c5856-ef25-441c-b92f-40e72bfcf066 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:11.430931 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd73744a-a32c-496f-93f3-b1a62431748e None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:32:11.432845 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-cd73744a-a32c-496f-93f3-b1a62431748e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:32:11.445258 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd73744a-a32c-496f-93f3-b1a62431748e None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:32:11.449328 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3557fc0-945b-46fd-ab6f-1619c93a7c04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7853d40c29af424c8d7913950d89750b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:32:11.450412 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3557fc0-945b-46fd-ab6f-1619c93a7c04 service cinder] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:11.450686 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3557fc0-945b-46fd-ab6f-1619c93a7c04 service cinder] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:11.450994 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3557fc0-945b-46fd-ab6f-1619c93a7c04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:11.461607 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3557fc0-945b-46fd-ab6f-1619c93a7c04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:32:11.463144 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3557fc0-945b-46fd-ab6f-1619c93a7c04 service cinder] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:32:11.475328 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1179/2339] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:32:11 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 01:32:11.508517 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3557fc0-945b-46fd-ab6f-1619c93a7c04 service cinder] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:32:11.522992 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76c5856-ef25-441c-b92f-40e72bfcf066 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:32:11.524496 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76c5856-ef25-441c-b92f-40e72bfcf066 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:32:11.533753 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:32:11.535636 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1161/2340] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:32:11 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:32:11.606776 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3557fc0-945b-46fd-ab6f-1619c93a7c04 service cinder] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:32:11.616503 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44298b9-2dee-44b0-b057-3dc570eb6707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:32:11.617305 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44298b9-2dee-44b0-b057-3dc570eb6707 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:11.617575 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44298b9-2dee-44b0-b057-3dc570eb6707 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:11.618426 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44298b9-2dee-44b0-b057-3dc570eb6707 admin admin] PATH_INFO: `/v3/users/b64aef2e91cd452ea241a025155972a6` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:11.619249 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44298b9-2dee-44b0-b057-3dc570eb6707 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b64aef2e91cd452ea241a025155972a6)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:32:11.621468 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44298b9-2dee-44b0-b057-3dc570eb6707 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:32:11.692716 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-d44298b9-2dee-44b0-b057-3dc570eb6707 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b64aef2e91cd452ea241a025155972a6'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:32:11.702451 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-d44298b9-2dee-44b0-b057-3dc570eb6707 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b64aef2e91cd452ea241a025155972a6'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:32:11.703055 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-d44298b9-2dee-44b0-b057-3dc570eb6707 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b64aef2e91cd452ea241a025155972a6'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:32:11.715201 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-d44298b9-2dee-44b0-b057-3dc570eb6707 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b64aef2e91cd452ea241a025155972a6'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:32:11.749482 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-d44298b9-2dee-44b0-b057-3dc570eb6707 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b64aef2e91cd452ea241a025155972a6'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:32:11.762146 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1180/2341] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:32:11 2022] DELETE /identity/v3/users/b64aef2e91cd452ea241a025155972a6 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 01:32:11.766516 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6258d0-8e0f-4248-90ad-7825c0acc97d None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:11.766914 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6258d0-8e0f-4248-90ad-7825c0acc97d None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:11.767281 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6258d0-8e0f-4248-90ad-7825c0acc97d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:11.796769 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-2b6258d0-8e0f-4248-90ad-7825c0acc97d None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:32:11.798166 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2b6258d0-8e0f-4248-90ad-7825c0acc97d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:32:11.876573 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94368d-e01e-4428-b47b-58609279b23f None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:11.876939 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94368d-e01e-4428-b47b-58609279b23f None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:11.877105 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94368d-e01e-4428-b47b-58609279b23f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:11.900638 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1162/2342] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:32:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 01:32:11.915311 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6258d0-8e0f-4248-90ad-7825c0acc97d None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:32:11.918243 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2b6258d0-8e0f-4248-90ad-7825c0acc97d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:32:11.928396 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-7a94368d-e01e-4428-b47b-58609279b23f None None] MFA Rules not processed for user `619b8ee9e99c4d0b9ec1e2f91c19569d`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:32:11.928794 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-7a94368d-e01e-4428-b47b-58609279b23f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:32:11.999134 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6258d0-8e0f-4248-90ad-7825c0acc97d None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:32:12.004793 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e5ec2-f924-46b8-9a9f-f76bbe9a415c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:32:12.005707 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e5ec2-f924-46b8-9a9f-f76bbe9a415c service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:12.006413 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e5ec2-f924-46b8-9a9f-f76bbe9a415c service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:12.006880 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e5ec2-f924-46b8-9a9f-f76bbe9a415c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:12.021972 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99e5ec2-f924-46b8-9a9f-f76bbe9a415c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:32:12.024442 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99e5ec2-f924-46b8-9a9f-f76bbe9a415c service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:32:12.043193 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1181/2343] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:32:11 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:32:12.044928 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1163/2344] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:32:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:32:12.340740 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a94368d-e01e-4428-b47b-58609279b23f None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:32:12.342633 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-7a94368d-e01e-4428-b47b-58609279b23f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:32:12.360659 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a94368d-e01e-4428-b47b-58609279b23f None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:32:12.367920 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a71f5-3e8d-44d2-96f3-a8737d6e2ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:32:12.368575 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a71f5-3e8d-44d2-96f3-a8737d6e2ea2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:12.368849 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a71f5-3e8d-44d2-96f3-a8737d6e2ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:12.369120 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a71f5-3e8d-44d2-96f3-a8737d6e2ea2 admin admin] PATH_INFO: `/v3/projects/a285da96fb8949af9c1ba57dd57da378` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:12.370506 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857a71f5-3e8d-44d2-96f3-a8737d6e2ea2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a285da96fb8949af9c1ba57dd57da378)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:32:12.372946 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857a71f5-3e8d-44d2-96f3-a8737d6e2ea2 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:32:12.416205 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:32:12.423868 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-857a71f5-3e8d-44d2-96f3-a8737d6e2ea2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a285da96fb8949af9c1ba57dd57da378', 'request_id': 'req-857a71f5-3e8d-44d2-96f3-a8737d6e2ea2'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:32:12.430209 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-857a71f5-3e8d-44d2-96f3-a8737d6e2ea2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a285da96fb8949af9c1ba57dd57da378', 'request_id': 'req-857a71f5-3e8d-44d2-96f3-a8737d6e2ea2'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:32:12.437537 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-857a71f5-3e8d-44d2-96f3-a8737d6e2ea2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a285da96fb8949af9c1ba57dd57da378', 'request_id': 'req-857a71f5-3e8d-44d2-96f3-a8737d6e2ea2'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:32:12.453514 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-857a71f5-3e8d-44d2-96f3-a8737d6e2ea2 admin admin] The token cache is being invalidate because project a285da96fb8949af9c1ba57dd57da378 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:32:12.453807 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-857a71f5-3e8d-44d2-96f3-a8737d6e2ea2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:32:12.454448 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-857a71f5-3e8d-44d2-96f3-a8737d6e2ea2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:32:12.455931 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1182/2345] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:32:12 2022] DELETE /identity/v3/projects/a285da96fb8949af9c1ba57dd57da378 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:32:14.780484 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94689ff-2b19-4175-bc35-89398a1f17a9 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:14.780484 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94689ff-2b19-4175-bc35-89398a1f17a9 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:14.780484 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94689ff-2b19-4175-bc35-89398a1f17a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:14.799622 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-c94689ff-2b19-4175-bc35-89398a1f17a9 None None] MFA Rules not processed for user `f3643631cf2d4a9592d465bdeba99669`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:32:14.800860 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c94689ff-2b19-4175-bc35-89398a1f17a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:32:14.849690 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:32:14.873935 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1164/2346] 10.222.0.26 () {58 vars in 1009 bytes} [Fri Aug 12 01:32:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:32:14.887106 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a71f5-3e8d-44d2-96f3-a8737d6e2ea2 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:32:14.888663 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-857a71f5-3e8d-44d2-96f3-a8737d6e2ea2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:32:14.975789 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a71f5-3e8d-44d2-96f3-a8737d6e2ea2 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:32:14.981814 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd5f4dc-b046-441f-b36b-85823c23872b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32c1ba237f864b5d9699cb817e42e647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:32:14.982522 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd5f4dc-b046-441f-b36b-85823c23872b service swift] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:14.983034 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd5f4dc-b046-441f-b36b-85823c23872b service swift] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:14.983475 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd5f4dc-b046-441f-b36b-85823c23872b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:14.994432 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd5f4dc-b046-441f-b36b-85823c23872b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:32:14.996128 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd5f4dc-b046-441f-b36b-85823c23872b service swift] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:32:15.005247 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1183/2347] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Aug 12 01:32:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 12 01:32:22.857796 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94689ff-2b19-4175-bc35-89398a1f17a9 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:32:22.861470 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c94689ff-2b19-4175-bc35-89398a1f17a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:32:22.945314 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94689ff-2b19-4175-bc35-89398a1f17a9 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:32:22.950913 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d475994-7e0c-4f75-a8d9-45cc5fc166f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:32:22.951558 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d475994-7e0c-4f75-a8d9-45cc5fc166f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:22.957627 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d475994-7e0c-4f75-a8d9-45cc5fc166f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:22.957627 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d475994-7e0c-4f75-a8d9-45cc5fc166f9 admin admin] PATH_INFO: `/v3/users/83e8cbaf1c004e85988af4e1c61dc962` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:22.957627 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d475994-7e0c-4f75-a8d9-45cc5fc166f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83e8cbaf1c004e85988af4e1c61dc962)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:32:22.957627 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d475994-7e0c-4f75-a8d9-45cc5fc166f9 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:32:23.140724 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-3d475994-7e0c-4f75-a8d9-45cc5fc166f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83e8cbaf1c004e85988af4e1c61dc962'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:32:23.148292 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-3d475994-7e0c-4f75-a8d9-45cc5fc166f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83e8cbaf1c004e85988af4e1c61dc962'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:32:23.148968 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-3d475994-7e0c-4f75-a8d9-45cc5fc166f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83e8cbaf1c004e85988af4e1c61dc962'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:32:23.161920 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-3d475994-7e0c-4f75-a8d9-45cc5fc166f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83e8cbaf1c004e85988af4e1c61dc962'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:32:23.199984 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-3d475994-7e0c-4f75-a8d9-45cc5fc166f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83e8cbaf1c004e85988af4e1c61dc962'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:32:23.211504 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1165/2348] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:32:22 2022] DELETE /identity/v3/users/83e8cbaf1c004e85988af4e1c61dc962 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:32:23.221749 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78515e03-8e19-48b4-86a3-875883f84014 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:23.222275 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78515e03-8e19-48b4-86a3-875883f84014 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:23.222372 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78515e03-8e19-48b4-86a3-875883f84014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:23.245796 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-78515e03-8e19-48b4-86a3-875883f84014 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:32:23.247287 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-78515e03-8e19-48b4-86a3-875883f84014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:32:23.322911 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1184/2349] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:32:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:32:23.333460 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d475994-7e0c-4f75-a8d9-45cc5fc166f9 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:32:23.335170 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-3d475994-7e0c-4f75-a8d9-45cc5fc166f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:32:23.407387 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d475994-7e0c-4f75-a8d9-45cc5fc166f9 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:32:23.411165 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd38fc-5118-4320-85a2-50619235c0dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:32:23.411789 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd38fc-5118-4320-85a2-50619235c0dc service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:23.412062 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd38fc-5118-4320-85a2-50619235c0dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:23.412586 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd38fc-5118-4320-85a2-50619235c0dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:23.423957 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dd38fc-5118-4320-85a2-50619235c0dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:32:23.425400 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dd38fc-5118-4320-85a2-50619235c0dc service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:32:23.435995 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1166/2350] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:32:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:32:23.763097 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78515e03-8e19-48b4-86a3-875883f84014 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:32:23.764614 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-78515e03-8e19-48b4-86a3-875883f84014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:32:23.785536 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78515e03-8e19-48b4-86a3-875883f84014 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:32:23.791934 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3015fd18-6ab2-4cad-bdcd-b68dea8b3fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:32:23.791934 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3015fd18-6ab2-4cad-bdcd-b68dea8b3fbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:23.791934 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3015fd18-6ab2-4cad-bdcd-b68dea8b3fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:23.791934 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3015fd18-6ab2-4cad-bdcd-b68dea8b3fbe admin admin] PATH_INFO: `/v3/projects/ac349beccac744628bca91008e7afbc5` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:23.792835 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3015fd18-6ab2-4cad-bdcd-b68dea8b3fbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac349beccac744628bca91008e7afbc5)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:32:23.794822 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3015fd18-6ab2-4cad-bdcd-b68dea8b3fbe admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:32:23.872380 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-3015fd18-6ab2-4cad-bdcd-b68dea8b3fbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac349beccac744628bca91008e7afbc5', 'request_id': 'req-3015fd18-6ab2-4cad-bdcd-b68dea8b3fbe'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:32:23.875155 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:32:23.881970 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-3015fd18-6ab2-4cad-bdcd-b68dea8b3fbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac349beccac744628bca91008e7afbc5', 'request_id': 'req-3015fd18-6ab2-4cad-bdcd-b68dea8b3fbe'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:32:23.892529 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-3015fd18-6ab2-4cad-bdcd-b68dea8b3fbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac349beccac744628bca91008e7afbc5', 'request_id': 'req-3015fd18-6ab2-4cad-bdcd-b68dea8b3fbe'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:32:23.917461 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-3015fd18-6ab2-4cad-bdcd-b68dea8b3fbe admin admin] The token cache is being invalidate because project ac349beccac744628bca91008e7afbc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:32:23.917791 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-3015fd18-6ab2-4cad-bdcd-b68dea8b3fbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:32:23.918853 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-3015fd18-6ab2-4cad-bdcd-b68dea8b3fbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:32:23.921938 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1185/2351] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:32:23 2022] DELETE /identity/v3/projects/ac349beccac744628bca91008e7afbc5 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:32:33.431519 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:32:33.912931 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=6,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:32:35.794793 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd38fc-5118-4320-85a2-50619235c0dc service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:32:35.796258 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-69dd38fc-5118-4320-85a2-50619235c0dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:32:35.810425 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd38fc-5118-4320-85a2-50619235c0dc service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:32:35.871944 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e813cc45-8a75-4360-8a31-4d39ba3d87ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:32:35.872584 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e813cc45-8a75-4360-8a31-4d39ba3d87ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:35.872891 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e813cc45-8a75-4360-8a31-4d39ba3d87ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:35.873157 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e813cc45-8a75-4360-8a31-4d39ba3d87ed admin admin] PATH_INFO: `/v3/users/e08eddb8387c44a29ebe57f7bb6e4915` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:35.874314 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e813cc45-8a75-4360-8a31-4d39ba3d87ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=e08eddb8387c44a29ebe57f7bb6e4915)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:32:35.876247 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e813cc45-8a75-4360-8a31-4d39ba3d87ed admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:32:35.931364 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-e813cc45-8a75-4360-8a31-4d39ba3d87ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e08eddb8387c44a29ebe57f7bb6e4915'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:32:35.940109 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-e813cc45-8a75-4360-8a31-4d39ba3d87ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e08eddb8387c44a29ebe57f7bb6e4915'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:32:35.940717 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-e813cc45-8a75-4360-8a31-4d39ba3d87ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e08eddb8387c44a29ebe57f7bb6e4915'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:32:35.947849 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-e813cc45-8a75-4360-8a31-4d39ba3d87ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e08eddb8387c44a29ebe57f7bb6e4915'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:32:35.960538 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-e813cc45-8a75-4360-8a31-4d39ba3d87ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e08eddb8387c44a29ebe57f7bb6e4915'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:32:35.966911 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1167/2352] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:32:35 2022] DELETE /identity/v3/users/e08eddb8387c44a29ebe57f7bb6e4915 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:32:35.971815 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e758967d-adb8-4929-9d6f-7239ee951e84 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:35.972269 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e758967d-adb8-4929-9d6f-7239ee951e84 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:35.972373 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e758967d-adb8-4929-9d6f-7239ee951e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:35.993113 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-e758967d-adb8-4929-9d6f-7239ee951e84 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:32:35.994349 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-e758967d-adb8-4929-9d6f-7239ee951e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:32:36.059923 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1186/2353] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:32:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:32:36.070422 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e813cc45-8a75-4360-8a31-4d39ba3d87ed admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:32:36.071882 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-e813cc45-8a75-4360-8a31-4d39ba3d87ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:32:36.135895 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e813cc45-8a75-4360-8a31-4d39ba3d87ed admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:32:36.140003 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ffeabc-c37f-4690-a1c1-2b52707eace7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:32:36.140715 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ffeabc-c37f-4690-a1c1-2b52707eace7 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:36.141052 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ffeabc-c37f-4690-a1c1-2b52707eace7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:36.141381 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ffeabc-c37f-4690-a1c1-2b52707eace7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:36.151854 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ffeabc-c37f-4690-a1c1-2b52707eace7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:32:36.153297 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ffeabc-c37f-4690-a1c1-2b52707eace7 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:32:36.163744 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1168/2354] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:32:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:32:36.166898 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9529e48-23c5-415b-837c-bb7466c51478 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:36.167288 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9529e48-23c5-415b-837c-bb7466c51478 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:36.167658 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9529e48-23c5-415b-837c-bb7466c51478 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:36.169706 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1187/2355] 10.222.0.26 () {54 vars in 921 bytes} [Fri Aug 12 01:32:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:32:36.176629 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb41b02-69ae-461e-86ef-bdfd80e481e3 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:36.177317 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb41b02-69ae-461e-86ef-bdfd80e481e3 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:36.177681 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb41b02-69ae-461e-86ef-bdfd80e481e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:36.199003 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-2bb41b02-69ae-461e-86ef-bdfd80e481e3 None None] MFA Rules not processed for user `fcd5e95467b44175be2478c2c7c89926`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:32:36.200221 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2bb41b02-69ae-461e-86ef-bdfd80e481e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:32:36.218565 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:32:36.273153 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1169/2356] 10.222.0.26 () {58 vars in 1018 bytes} [Fri Aug 12 01:32:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 01:32:36.285755 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9529e48-23c5-415b-837c-bb7466c51478 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:32:36.287842 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-a9529e48-23c5-415b-837c-bb7466c51478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:32:36.355913 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9529e48-23c5-415b-837c-bb7466c51478 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:32:36.359978 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b16786b-56cf-4fb2-bfc7-f661ce04de6c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd73d9b9b63a499d909fec034bf9a259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:32:36.360667 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b16786b-56cf-4fb2-bfc7-f661ce04de6c service glance] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:36.361011 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b16786b-56cf-4fb2-bfc7-f661ce04de6c service glance] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:36.361425 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b16786b-56cf-4fb2-bfc7-f661ce04de6c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:36.373017 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b16786b-56cf-4fb2-bfc7-f661ce04de6c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:32:36.374522 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b16786b-56cf-4fb2-bfc7-f661ce04de6c service glance] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:32:36.385375 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1188/2357] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:32:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:32:36.462938 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db0d8e6-794d-4647-87b9-6b8dc39c4e1a None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:36.463224 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db0d8e6-794d-4647-87b9-6b8dc39c4e1a None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:36.463496 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db0d8e6-794d-4647-87b9-6b8dc39c4e1a None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:36.464861 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1170/2358] 10.222.0.26 () {54 vars in 921 bytes} [Fri Aug 12 01:32:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:32:36.470136 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4348eb-9253-4da4-9515-ac317fd36566 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:36.470429 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4348eb-9253-4da4-9515-ac317fd36566 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:36.470708 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4348eb-9253-4da4-9515-ac317fd36566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:36.491600 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-7f4348eb-9253-4da4-9515-ac317fd36566 None None] MFA Rules not processed for user `a80678458dc9405285b70da707a399c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:32:36.493548 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-7f4348eb-9253-4da4-9515-ac317fd36566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:32:36.503103 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1189/2359] 10.222.0.26 () {58 vars in 1018 bytes} [Fri Aug 12 01:32:36 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 01:32:36.518592 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db0d8e6-794d-4647-87b9-6b8dc39c4e1a None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:32:36.520652 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-9db0d8e6-794d-4647-87b9-6b8dc39c4e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:32:36.534452 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4348eb-9253-4da4-9515-ac317fd36566 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:32:36.536356 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-7f4348eb-9253-4da4-9515-ac317fd36566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:32:36.538042 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db0d8e6-794d-4647-87b9-6b8dc39c4e1a None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:32:36.541702 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f173b1-7687-4169-9043-bb6dbad03e4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:32:36.542349 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f173b1-7687-4169-9043-bb6dbad03e4e service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:36.542686 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f173b1-7687-4169-9043-bb6dbad03e4e service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:36.542953 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f173b1-7687-4169-9043-bb6dbad03e4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:36.550729 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f173b1-7687-4169-9043-bb6dbad03e4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:32:36.552159 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f173b1-7687-4169-9043-bb6dbad03e4e service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:32:36.557809 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4348eb-9253-4da4-9515-ac317fd36566 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:32:36.560729 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1171/2360] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:32:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:32:36.564879 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bc3059-8b97-49db-b741-8e1eeb50f4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:32:36.565495 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc3059-8b97-49db-b741-8e1eeb50f4ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:36.565767 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc3059-8b97-49db-b741-8e1eeb50f4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:36.566047 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc3059-8b97-49db-b741-8e1eeb50f4ce admin admin] PATH_INFO: `/v3/projects/674e42dc24f540c89d710e12912ff43d` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:36.567145 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bc3059-8b97-49db-b741-8e1eeb50f4ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=674e42dc24f540c89d710e12912ff43d)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:32:36.569018 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bc3059-8b97-49db-b741-8e1eeb50f4ce admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:32:36.618214 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-00bc3059-8b97-49db-b741-8e1eeb50f4ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '674e42dc24f540c89d710e12912ff43d', 'request_id': 'req-00bc3059-8b97-49db-b741-8e1eeb50f4ce'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:32:36.623987 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-00bc3059-8b97-49db-b741-8e1eeb50f4ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '674e42dc24f540c89d710e12912ff43d', 'request_id': 'req-00bc3059-8b97-49db-b741-8e1eeb50f4ce'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:32:36.630175 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-00bc3059-8b97-49db-b741-8e1eeb50f4ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '674e42dc24f540c89d710e12912ff43d', 'request_id': 'req-00bc3059-8b97-49db-b741-8e1eeb50f4ce'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:32:36.644363 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-00bc3059-8b97-49db-b741-8e1eeb50f4ce admin admin] The token cache is being invalidate because project 674e42dc24f540c89d710e12912ff43d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:32:36.644884 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-00bc3059-8b97-49db-b741-8e1eeb50f4ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:32:36.645729 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-00bc3059-8b97-49db-b741-8e1eeb50f4ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:32:36.646954 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c5ea82-dbaa-47dc-b76c-bb00208f1804 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:36.647501 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c5ea82-dbaa-47dc-b76c-bb00208f1804 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:36.647613 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1190/2361] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:32:36 2022] DELETE /identity/v3/projects/674e42dc24f540c89d710e12912ff43d => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:32:36.647734 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c5ea82-dbaa-47dc-b76c-bb00208f1804 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:36.648989 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1172/2362] 10.222.0.26 () {54 vars in 921 bytes} [Fri Aug 12 01:32:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:32:36.652956 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df31b0-5aed-4470-bd0a-605e1b56f662 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:36.653253 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df31b0-5aed-4470-bd0a-605e1b56f662 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:36.653523 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df31b0-5aed-4470-bd0a-605e1b56f662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:36.654194 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b1c9e-49b9-4b1d-88b6-ba788a562b1e None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:36.654499 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b1c9e-49b9-4b1d-88b6-ba788a562b1e None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:36.654789 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b1c9e-49b9-4b1d-88b6-ba788a562b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:36.673998 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-0d6b1c9e-49b9-4b1d-88b6-ba788a562b1e None None] MFA Rules not processed for user `fcd5e95467b44175be2478c2c7c89926`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:32:36.675217 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-0d6b1c9e-49b9-4b1d-88b6-ba788a562b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:32:36.675362 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-e4df31b0-5aed-4470-bd0a-605e1b56f662 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:32:36.676489 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-e4df31b0-5aed-4470-bd0a-605e1b56f662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:32:36.689868 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:32:36.740049 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1173/2363] 10.222.0.26 () {58 vars in 1018 bytes} [Fri Aug 12 01:32:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 01:32:36.740520 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1191/2364] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:32:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:32:36.750055 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7b4ed-4544-4397-b0ad-acac32f7c4e6 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:36.750363 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7b4ed-4544-4397-b0ad-acac32f7c4e6 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:36.750634 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7b4ed-4544-4397-b0ad-acac32f7c4e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:36.750951 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df31b0-5aed-4470-bd0a-605e1b56f662 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:32:36.752355 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-e4df31b0-5aed-4470-bd0a-605e1b56f662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:32:36.770527 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-80c7b4ed-4544-4397-b0ad-acac32f7c4e6 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:32:36.772036 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-80c7b4ed-4544-4397-b0ad-acac32f7c4e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:32:36.780817 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1174/2365] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:32:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:32:36.785092 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c7b4ed-4544-4397-b0ad-acac32f7c4e6 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:32:36.794812 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c7b4ed-4544-4397-b0ad-acac32f7c4e6 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:32:36.799855 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2024ac50-54d6-43de-847d-4602e374c4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:32:36.800450 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2024ac50-54d6-43de-847d-4602e374c4db admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:36.800729 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2024ac50-54d6-43de-847d-4602e374c4db admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:36.800999 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2024ac50-54d6-43de-847d-4602e374c4db admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:36.801654 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2024ac50-54d6-43de-847d-4602e374c4db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:32:36.801955 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2024ac50-54d6-43de-847d-4602e374c4db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:32:36.803659 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2024ac50-54d6-43de-847d-4602e374c4db admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:32:36.814913 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df31b0-5aed-4470-bd0a-605e1b56f662 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:32:36.815933 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1175/2366] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 01:32:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:32:36.818863 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228e6cce-6dcd-46b2-88a6-37e31f727dd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:32:36.819674 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228e6cce-6dcd-46b2-88a6-37e31f727dd0 service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:36.819948 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228e6cce-6dcd-46b2-88a6-37e31f727dd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:36.820305 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228e6cce-6dcd-46b2-88a6-37e31f727dd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:36.820416 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2024ac50-54d6-43de-847d-4602e374c4db admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:32:36.831138 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2024ac50-54d6-43de-847d-4602e374c4db admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:32:36.831543 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228e6cce-6dcd-46b2-88a6-37e31f727dd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:32:36.832964 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228e6cce-6dcd-46b2-88a6-37e31f727dd0 service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:32:36.835643 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abcda0d-f6a7-4433-ab25-3b1f1960322c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:32:36.836542 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abcda0d-f6a7-4433-ab25-3b1f1960322c admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:36.836542 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abcda0d-f6a7-4433-ab25-3b1f1960322c admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:36.836820 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abcda0d-f6a7-4433-ab25-3b1f1960322c admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:36.837567 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abcda0d-f6a7-4433-ab25-3b1f1960322c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:32:36.839354 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abcda0d-f6a7-4433-ab25-3b1f1960322c admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:32:36.843708 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1192/2367] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:32:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 01:32:36.878261 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1176/2368] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:32:36 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 01:32:36.880888 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228e6cce-6dcd-46b2-88a6-37e31f727dd0 service neutron] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:32:36.891851 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228e6cce-6dcd-46b2-88a6-37e31f727dd0 service neutron] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:32:36.961092 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2322ff6-4404-4a3a-8cb7-f7aa366405f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:32:36.961870 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2322ff6-4404-4a3a-8cb7-f7aa366405f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:36.962269 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2322ff6-4404-4a3a-8cb7-f7aa366405f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:36.962629 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2322ff6-4404-4a3a-8cb7-f7aa366405f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:36.963367 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2322ff6-4404-4a3a-8cb7-f7aa366405f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:32:36.965412 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2322ff6-4404-4a3a-8cb7-f7aa366405f6 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:32:36.995499 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1193/2369] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:32:36 2022] POST /identity/v3/users => generated 292 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 01:32:36.996808 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abcda0d-f6a7-4433-ab25-3b1f1960322c admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:32:37.008859 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abcda0d-f6a7-4433-ab25-3b1f1960322c admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:32:37.014060 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb7b36e-ff44-43d1-9f40-0bf9ffedba0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:32:37.014696 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7b36e-ff44-43d1-9f40-0bf9ffedba0f admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:37.014966 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7b36e-ff44-43d1-9f40-0bf9ffedba0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:37.015229 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7b36e-ff44-43d1-9f40-0bf9ffedba0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:37.015866 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb7b36e-ff44-43d1-9f40-0bf9ffedba0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:32:37.017521 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb7b36e-ff44-43d1-9f40-0bf9ffedba0f admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:32:37.029368 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1177/2370] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:32:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 01:32:37.034158 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2322ff6-4404-4a3a-8cb7-f7aa366405f6 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:32:37.050488 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2322ff6-4404-4a3a-8cb7-f7aa366405f6 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:32:37.055975 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c753a3d-973c-4d75-a673-a30470e5e3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:32:37.056583 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c753a3d-973c-4d75-a673-a30470e5e3f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:37.056852 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c753a3d-973c-4d75-a673-a30470e5e3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:37.057140 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c753a3d-973c-4d75-a673-a30470e5e3f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:37.057820 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c753a3d-973c-4d75-a673-a30470e5e3f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:32:37.059429 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c753a3d-973c-4d75-a673-a30470e5e3f5 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:32:37.073056 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1194/2371] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:32:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:32:37.074554 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb7b36e-ff44-43d1-9f40-0bf9ffedba0f admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:32:37.084745 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb7b36e-ff44-43d1-9f40-0bf9ffedba0f admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:32:37.089960 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5ce3a5-847d-4887-b495-010ce182706b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:32:37.090845 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ce3a5-847d-4887-b495-010ce182706b admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:37.091177 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ce3a5-847d-4887-b495-010ce182706b admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:37.091505 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ce3a5-847d-4887-b495-010ce182706b admin admin] PATH_INFO: `/v3/projects/aabbe4c387214381b8db89364ff42272/users/094e4987cf5343c0bae9c306f3c31469/roles/13af81971c1c428eae0a571a22ea583d` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:37.106530 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5ce3a5-847d-4887-b495-010ce182706b admin admin] RBAC: Authorizing `identity:create_grant(project_id=aabbe4c387214381b8db89364ff42272, user_id=094e4987cf5343c0bae9c306f3c31469, role_id=13af81971c1c428eae0a571a22ea583d)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:32:37.109534 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5ce3a5-847d-4887-b495-010ce182706b admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:32:37.127718 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1178/2372] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:32:37 2022] PUT /identity/v3/projects/aabbe4c387214381b8db89364ff42272/users/094e4987cf5343c0bae9c306f3c31469/roles/13af81971c1c428eae0a571a22ea583d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:32:37.138360 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab0d2a-41cf-4cb5-9f49-2dd20a6a5e64 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:37.138648 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab0d2a-41cf-4cb5-9f49-2dd20a6a5e64 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:37.138920 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab0d2a-41cf-4cb5-9f49-2dd20a6a5e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:37.166276 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-05ab0d2a-41cf-4cb5-9f49-2dd20a6a5e64 None None] MFA Rules not processed for user `094e4987cf5343c0bae9c306f3c31469`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:32:37.167513 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-05ab0d2a-41cf-4cb5-9f49-2dd20a6a5e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:32:37.197351 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:32:37.236389 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1195/2373] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:32:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:32:37.248388 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5ce3a5-847d-4887-b495-010ce182706b admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:32:37.250454 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-7f5ce3a5-847d-4887-b495-010ce182706b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:32:37.270292 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:32:37.312861 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5ce3a5-847d-4887-b495-010ce182706b admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:32:37.317016 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfcbfe2-fe6e-40c8-b46d-d1c0874bf4cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7853d40c29af424c8d7913950d89750b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:32:37.317657 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfcbfe2-fe6e-40c8-b46d-d1c0874bf4cf service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:37.317911 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfcbfe2-fe6e-40c8-b46d-d1c0874bf4cf service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:37.318199 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfcbfe2-fe6e-40c8-b46d-d1c0874bf4cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:37.327199 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfcbfe2-fe6e-40c8-b46d-d1c0874bf4cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:32:37.328630 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfcbfe2-fe6e-40c8-b46d-d1c0874bf4cf service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:32:37.338287 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1179/2374] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:32:37 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:32:39.518247 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d224f166-9ae5-4459-ab3f-75ad834258dc None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:39.518740 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d224f166-9ae5-4459-ab3f-75ad834258dc None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:39.518822 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d224f166-9ae5-4459-ab3f-75ad834258dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:39.539220 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-d224f166-9ae5-4459-ab3f-75ad834258dc None None] MFA Rules not processed for user `f3643631cf2d4a9592d465bdeba99669`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:32:39.540485 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-d224f166-9ae5-4459-ab3f-75ad834258dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:32:39.600682 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1196/2375] 10.222.0.26 () {58 vars in 1009 bytes} [Fri Aug 12 01:32:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:32:39.622752 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfcbfe2-fe6e-40c8-b46d-d1c0874bf4cf service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:32:39.624278 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-acfcbfe2-fe6e-40c8-b46d-d1c0874bf4cf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:32:39.695387 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfcbfe2-fe6e-40c8-b46d-d1c0874bf4cf service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:32:39.700936 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c758dd77-00df-458b-873c-bc937b6c7f83 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32c1ba237f864b5d9699cb817e42e647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:32:39.702197 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758dd77-00df-458b-873c-bc937b6c7f83 service swift] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:39.702479 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758dd77-00df-458b-873c-bc937b6c7f83 service swift] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:39.702742 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758dd77-00df-458b-873c-bc937b6c7f83 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:39.711654 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c758dd77-00df-458b-873c-bc937b6c7f83 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:32:39.713248 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c758dd77-00df-458b-873c-bc937b6c7f83 service swift] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:32:39.721494 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1180/2376] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Aug 12 01:32:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 12 01:32:39.996180 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d224f166-9ae5-4459-ab3f-75ad834258dc None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:32:40.106146 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d224f166-9ae5-4459-ab3f-75ad834258dc None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:32:40.113480 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ab8f2-f877-4870-9a6e-7d1a7641a18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:32:40.115162 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ab8f2-f877-4870-9a6e-7d1a7641a18f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:40.115705 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ab8f2-f877-4870-9a6e-7d1a7641a18f admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:40.116183 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ab8f2-f877-4870-9a6e-7d1a7641a18f admin admin] PATH_INFO: `/v3/users/094e4987cf5343c0bae9c306f3c31469` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:40.118205 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3ab8f2-f877-4870-9a6e-7d1a7641a18f admin admin] RBAC: Authorizing `identity:delete_user(user_id=094e4987cf5343c0bae9c306f3c31469)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:32:40.121199 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3ab8f2-f877-4870-9a6e-7d1a7641a18f admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:32:40.207513 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-1e3ab8f2-f877-4870-9a6e-7d1a7641a18f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '094e4987cf5343c0bae9c306f3c31469'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:32:40.219770 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-1e3ab8f2-f877-4870-9a6e-7d1a7641a18f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '094e4987cf5343c0bae9c306f3c31469'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:32:40.220891 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-1e3ab8f2-f877-4870-9a6e-7d1a7641a18f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '094e4987cf5343c0bae9c306f3c31469'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:32:40.232301 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-1e3ab8f2-f877-4870-9a6e-7d1a7641a18f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '094e4987cf5343c0bae9c306f3c31469'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:32:40.249882 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:32:40.252060 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-1e3ab8f2-f877-4870-9a6e-7d1a7641a18f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '094e4987cf5343c0bae9c306f3c31469'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:32:40.263452 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1197/2377] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:32:39 2022] DELETE /identity/v3/users/094e4987cf5343c0bae9c306f3c31469 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:32:40.265522 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a36dc-0eba-4ef7-8000-d8ba1b3276b8 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:40.265803 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a36dc-0eba-4ef7-8000-d8ba1b3276b8 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:40.266341 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a36dc-0eba-4ef7-8000-d8ba1b3276b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:40.290403 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-e67a36dc-0eba-4ef7-8000-d8ba1b3276b8 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:32:40.290850 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-e67a36dc-0eba-4ef7-8000-d8ba1b3276b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:32:40.389480 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1181/2378] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:32:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:32:40.405927 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ab8f2-f877-4870-9a6e-7d1a7641a18f admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:32:40.410451 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-1e3ab8f2-f877-4870-9a6e-7d1a7641a18f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:32:40.513574 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ab8f2-f877-4870-9a6e-7d1a7641a18f admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:32:40.521136 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7eadd7-0678-4d1a-b140-1b06a16abe49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:32:40.522481 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7eadd7-0678-4d1a-b140-1b06a16abe49 service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:40.523160 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7eadd7-0678-4d1a-b140-1b06a16abe49 service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:40.523620 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7eadd7-0678-4d1a-b140-1b06a16abe49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:40.535436 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7eadd7-0678-4d1a-b140-1b06a16abe49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:32:40.537924 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7eadd7-0678-4d1a-b140-1b06a16abe49 service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:32:40.554056 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1198/2379] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:32:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 01:32:40.965344 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67a36dc-0eba-4ef7-8000-d8ba1b3276b8 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:32:40.966987 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-e67a36dc-0eba-4ef7-8000-d8ba1b3276b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:32:40.997626 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67a36dc-0eba-4ef7-8000-d8ba1b3276b8 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:32:41.003032 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd238b6a-68f9-47c2-8680-b598d2c9a407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:32:41.003680 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd238b6a-68f9-47c2-8680-b598d2c9a407 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:41.004159 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd238b6a-68f9-47c2-8680-b598d2c9a407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:41.004527 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd238b6a-68f9-47c2-8680-b598d2c9a407 admin admin] PATH_INFO: `/v3/projects/aabbe4c387214381b8db89364ff42272` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:41.005867 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd238b6a-68f9-47c2-8680-b598d2c9a407 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aabbe4c387214381b8db89364ff42272)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:32:41.008281 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd238b6a-68f9-47c2-8680-b598d2c9a407 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:32:41.063696 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:32:41.068210 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-cd238b6a-68f9-47c2-8680-b598d2c9a407 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aabbe4c387214381b8db89364ff42272', 'request_id': 'req-cd238b6a-68f9-47c2-8680-b598d2c9a407'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:32:41.080224 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-cd238b6a-68f9-47c2-8680-b598d2c9a407 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aabbe4c387214381b8db89364ff42272', 'request_id': 'req-cd238b6a-68f9-47c2-8680-b598d2c9a407'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:32:41.086908 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-cd238b6a-68f9-47c2-8680-b598d2c9a407 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aabbe4c387214381b8db89364ff42272', 'request_id': 'req-cd238b6a-68f9-47c2-8680-b598d2c9a407'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:32:41.111302 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-cd238b6a-68f9-47c2-8680-b598d2c9a407 admin admin] The token cache is being invalidate because project aabbe4c387214381b8db89364ff42272 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:32:41.111591 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-cd238b6a-68f9-47c2-8680-b598d2c9a407 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:32:41.112365 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-cd238b6a-68f9-47c2-8680-b598d2c9a407 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:32:41.117277 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1182/2380] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:32:40 2022] DELETE /identity/v3/projects/aabbe4c387214381b8db89364ff42272 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:32:41.119198 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c609f-1656-4d4b-b76f-161977b308d9 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:41.119489 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c609f-1656-4d4b-b76f-161977b308d9 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:41.119768 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c609f-1656-4d4b-b76f-161977b308d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:41.154925 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-005c609f-1656-4d4b-b76f-161977b308d9 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:32:41.156128 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-005c609f-1656-4d4b-b76f-161977b308d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:32:41.229155 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1199/2381] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:32:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:32:41.244712 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342dd04-49e2-4416-97c6-5e189bc4698b None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:41.245258 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342dd04-49e2-4416-97c6-5e189bc4698b None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:41.245529 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342dd04-49e2-4416-97c6-5e189bc4698b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:41.267997 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-5342dd04-49e2-4416-97c6-5e189bc4698b None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:32:41.269226 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-5342dd04-49e2-4416-97c6-5e189bc4698b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:32:41.279346 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1183/2382] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:32:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:32:41.285007 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c609f-1656-4d4b-b76f-161977b308d9 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:32:41.295721 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c609f-1656-4d4b-b76f-161977b308d9 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:32:41.300975 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b462c95-c3ef-4723-a6f1-6b34c0148068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:32:41.301767 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b462c95-c3ef-4723-a6f1-6b34c0148068 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:41.302049 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b462c95-c3ef-4723-a6f1-6b34c0148068 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:41.302364 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b462c95-c3ef-4723-a6f1-6b34c0148068 admin admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:41.306516 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b462c95-c3ef-4723-a6f1-6b34c0148068 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:32:41.306801 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b462c95-c3ef-4723-a6f1-6b34c0148068 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:32:41.308512 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b462c95-c3ef-4723-a6f1-6b34c0148068 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:32:41.336345 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1200/2383] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 01:32:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:32:41.337246 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5342dd04-49e2-4416-97c6-5e189bc4698b None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:32:41.346654 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5342dd04-49e2-4416-97c6-5e189bc4698b None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:32:41.352351 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d23293-46a6-433c-90ae-4e3a6751f17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:32:41.352971 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d23293-46a6-433c-90ae-4e3a6751f17b admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:41.353389 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d23293-46a6-433c-90ae-4e3a6751f17b admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:41.353661 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d23293-46a6-433c-90ae-4e3a6751f17b admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:41.354487 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d23293-46a6-433c-90ae-4e3a6751f17b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:32:41.356442 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d23293-46a6-433c-90ae-4e3a6751f17b admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:32:41.389649 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1184/2384] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:32:41 2022] POST /identity/v3/projects => generated 381 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:32:41.394037 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b462c95-c3ef-4723-a6f1-6b34c0148068 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:32:41.404186 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b462c95-c3ef-4723-a6f1-6b34c0148068 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:32:41.474758 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8d2f6d-5b23-4f31-98bf-e0e77ef8e559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:32:41.475377 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d2f6d-5b23-4f31-98bf-e0e77ef8e559 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:41.475649 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d2f6d-5b23-4f31-98bf-e0e77ef8e559 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:41.475921 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d2f6d-5b23-4f31-98bf-e0e77ef8e559 admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:41.482765 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8d2f6d-5b23-4f31-98bf-e0e77ef8e559 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:32:41.484895 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8d2f6d-5b23-4f31-98bf-e0e77ef8e559 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:32:41.510097 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1201/2385] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:32:41 2022] POST /identity/v3/users => generated 291 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:32:41.514377 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d23293-46a6-433c-90ae-4e3a6751f17b admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:32:41.529704 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d23293-46a6-433c-90ae-4e3a6751f17b admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:32:41.535814 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0ee9a-82f4-4e72-828f-0688f90174cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:32:41.536858 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0ee9a-82f4-4e72-828f-0688f90174cb admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:41.537545 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0ee9a-82f4-4e72-828f-0688f90174cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:41.538008 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0ee9a-82f4-4e72-828f-0688f90174cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:41.539004 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d0ee9a-82f4-4e72-828f-0688f90174cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:32:41.540729 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d0ee9a-82f4-4e72-828f-0688f90174cb admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:32:41.555003 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1185/2386] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:32:41.558859 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8d2f6d-5b23-4f31-98bf-e0e77ef8e559 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:32:41.569386 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8d2f6d-5b23-4f31-98bf-e0e77ef8e559 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:32:41.574285 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb25e11b-1478-41cf-9d89-8e9e3381f45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:32:41.574920 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb25e11b-1478-41cf-9d89-8e9e3381f45d admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:41.575198 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb25e11b-1478-41cf-9d89-8e9e3381f45d admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:41.575464 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb25e11b-1478-41cf-9d89-8e9e3381f45d admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:41.576140 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb25e11b-1478-41cf-9d89-8e9e3381f45d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:32:41.577802 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb25e11b-1478-41cf-9d89-8e9e3381f45d admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:32:41.592519 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1202/2387] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:32:41.597022 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0ee9a-82f4-4e72-828f-0688f90174cb admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:32:41.608731 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0ee9a-82f4-4e72-828f-0688f90174cb admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:32:41.614142 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68773abf-9e43-49f9-867f-d73289005a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:32:41.614142 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68773abf-9e43-49f9-867f-d73289005a33 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:41.614600 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68773abf-9e43-49f9-867f-d73289005a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:41.614600 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68773abf-9e43-49f9-867f-d73289005a33 admin admin] PATH_INFO: `/v3/projects/043a9d84ea584ed5aeb76a4190cceb80/users/0644015c01124adbb76b78311b17bb62/roles/13af81971c1c428eae0a571a22ea583d` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:41.631472 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68773abf-9e43-49f9-867f-d73289005a33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=043a9d84ea584ed5aeb76a4190cceb80, user_id=0644015c01124adbb76b78311b17bb62, role_id=13af81971c1c428eae0a571a22ea583d)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:32:41.635203 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68773abf-9e43-49f9-867f-d73289005a33 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:32:41.651979 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1186/2388] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:32:41 2022] PUT /identity/v3/projects/043a9d84ea584ed5aeb76a4190cceb80/users/0644015c01124adbb76b78311b17bb62/roles/13af81971c1c428eae0a571a22ea583d => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:32:41.657110 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2a2a6-e6b7-427d-a604-ec4cc2fcbe3b None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:41.657417 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2a2a6-e6b7-427d-a604-ec4cc2fcbe3b None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:41.657690 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2a2a6-e6b7-427d-a604-ec4cc2fcbe3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:41.666425 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:32:41.680174 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-f2a2a2a6-e6b7-427d-a604-ec4cc2fcbe3b None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:32:41.681532 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-f2a2a2a6-e6b7-427d-a604-ec4cc2fcbe3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:32:41.786515 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1203/2389] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:32:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:32:41.799078 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68773abf-9e43-49f9-867f-d73289005a33 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:32:41.800807 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-68773abf-9e43-49f9-867f-d73289005a33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:32:41.889456 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68773abf-9e43-49f9-867f-d73289005a33 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:32:41.894428 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e8e7bc-3ad2-4244-a8ce-641b610fbc9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:32:41.895390 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e8e7bc-3ad2-4244-a8ce-641b610fbc9e service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:41.895884 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e8e7bc-3ad2-4244-a8ce-641b610fbc9e service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:41.896329 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e8e7bc-3ad2-4244-a8ce-641b610fbc9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:41.907876 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e8e7bc-3ad2-4244-a8ce-641b610fbc9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:32:41.909334 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e8e7bc-3ad2-4244-a8ce-641b610fbc9e service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:32:41.920458 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1187/2390] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:32:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:32:42.744595 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d837c72-fc9c-414f-85ee-ac513809ce41 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:42.745097 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d837c72-fc9c-414f-85ee-ac513809ce41 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:42.745502 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d837c72-fc9c-414f-85ee-ac513809ce41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:42.783106 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-3d837c72-fc9c-414f-85ee-ac513809ce41 None None] MFA Rules not processed for user `0644015c01124adbb76b78311b17bb62`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:32:42.785009 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-3d837c72-fc9c-414f-85ee-ac513809ce41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:32:42.864498 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1204/2391] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:32:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:32:42.875731 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e8e7bc-3ad2-4244-a8ce-641b610fbc9e service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:32:42.877244 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c4e8e7bc-3ad2-4244-a8ce-641b610fbc9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:32:42.963196 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e8e7bc-3ad2-4244-a8ce-641b610fbc9e service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:32:42.966865 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b81ed2-9ff0-4900-9980-caff3f77da02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7853d40c29af424c8d7913950d89750b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:32:42.967480 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b81ed2-9ff0-4900-9980-caff3f77da02 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:42.967753 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b81ed2-9ff0-4900-9980-caff3f77da02 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:42.968017 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b81ed2-9ff0-4900-9980-caff3f77da02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:42.977022 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b81ed2-9ff0-4900-9980-caff3f77da02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:32:42.978504 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b81ed2-9ff0-4900-9980-caff3f77da02 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:32:43.000249 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1188/2392] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:32:42 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:32:44.476131 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3404bf1-a186-4b7b-85d8-b0f8a60fa5c1 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:44.476894 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3404bf1-a186-4b7b-85d8-b0f8a60fa5c1 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:44.476894 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3404bf1-a186-4b7b-85d8-b0f8a60fa5c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:44.500539 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-e3404bf1-a186-4b7b-85d8-b0f8a60fa5c1 None None] MFA Rules not processed for user `0644015c01124adbb76b78311b17bb62`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:32:44.501809 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-e3404bf1-a186-4b7b-85d8-b0f8a60fa5c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:32:44.509933 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1205/2393] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:32:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:32:52.984010 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=87,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:32:54.183375 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b81ed2-9ff0-4900-9980-caff3f77da02 service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:32:54.194567 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b81ed2-9ff0-4900-9980-caff3f77da02 service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:32:54.200948 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3831a4-4252-4709-9687-30eb261807cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:32:54.201698 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3831a4-4252-4709-9687-30eb261807cf service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:54.203161 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3831a4-4252-4709-9687-30eb261807cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:54.203502 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3831a4-4252-4709-9687-30eb261807cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:54.205841 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-7b3831a4-4252-4709-9687-30eb261807cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:32:54.294493 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3831a4-4252-4709-9687-30eb261807cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:32:54.295940 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3831a4-4252-4709-9687-30eb261807cf service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:32:54.306167 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1189/2394] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:32:54 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:32:54.494722 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=60 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:32:58.210047 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f872e0-694f-4448-88bd-54cc4cf4d67a None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:58.210714 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f872e0-694f-4448-88bd-54cc4cf4d67a None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:58.210714 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f872e0-694f-4448-88bd-54cc4cf4d67a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:58.231511 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-e9f872e0-694f-4448-88bd-54cc4cf4d67a None None] MFA Rules not processed for user `f3643631cf2d4a9592d465bdeba99669`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:32:58.232845 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-e9f872e0-694f-4448-88bd-54cc4cf4d67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:32:58.295748 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1206/2395] 10.222.0.26 () {58 vars in 967 bytes} [Fri Aug 12 01:32:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:32:58.312117 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3831a4-4252-4709-9687-30eb261807cf service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:32:58.313571 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-7b3831a4-4252-4709-9687-30eb261807cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:32:58.397662 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3831a4-4252-4709-9687-30eb261807cf service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:32:58.404358 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537edc25-3769-4e66-8d17-2bed381a4d6e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32c1ba237f864b5d9699cb817e42e647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:32:58.405061 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537edc25-3769-4e66-8d17-2bed381a4d6e service swift] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:32:58.405404 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537edc25-3769-4e66-8d17-2bed381a4d6e service swift] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:32:58.405738 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537edc25-3769-4e66-8d17-2bed381a4d6e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:32:58.415107 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537edc25-3769-4e66-8d17-2bed381a4d6e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:32:58.416795 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537edc25-3769-4e66-8d17-2bed381a4d6e service swift] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:32:58.425808 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1190/2396] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Aug 12 01:32:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 12 01:33:08.286526 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=25 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:33:08.422076 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=62 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:33:24.217714 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f872e0-694f-4448-88bd-54cc4cf4d67a None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:33:24.219385 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-e9f872e0-694f-4448-88bd-54cc4cf4d67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:33:24.347823 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f872e0-694f-4448-88bd-54cc4cf4d67a None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:33:24.356369 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe7fbe0-0ab7-44ac-a656-ffe3ad2e0c8b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06dccf61c686414d904bdf1ecf19d53d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:33:24.357946 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe7fbe0-0ab7-44ac-a656-ffe3ad2e0c8b service placement] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:33:24.358372 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe7fbe0-0ab7-44ac-a656-ffe3ad2e0c8b service placement] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:33:24.358763 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe7fbe0-0ab7-44ac-a656-ffe3ad2e0c8b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:33:24.361082 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-bfe7fbe0-0ab7-44ac-a656-ffe3ad2e0c8b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:33:24.380114 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe7fbe0-0ab7-44ac-a656-ffe3ad2e0c8b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:33:24.382650 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe7fbe0-0ab7-44ac-a656-ffe3ad2e0c8b service placement] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:33:24.394073 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1207/2397] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:33:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:33:25.179186 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7020d388-bac0-49da-954d-c63888da1de1 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:33:25.179781 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7020d388-bac0-49da-954d-c63888da1de1 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:33:25.180074 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7020d388-bac0-49da-954d-c63888da1de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:33:25.203618 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-7020d388-bac0-49da-954d-c63888da1de1 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:33:25.204845 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-7020d388-bac0-49da-954d-c63888da1de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:33:25.214502 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1191/2398] 10.222.0.17 () {58 vars in 1016 bytes} [Fri Aug 12 01:33:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:33:25.274261 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe7fbe0-0ab7-44ac-a656-ffe3ad2e0c8b service placement] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:33:25.276323 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-bfe7fbe0-0ab7-44ac-a656-ffe3ad2e0c8b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:33:25.376422 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe7fbe0-0ab7-44ac-a656-ffe3ad2e0c8b service placement] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:33:25.383430 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90bb1ea-1693-4dcb-8685-5c502001a051 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd5e95467b44175be2478c2c7c89926', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:33:25.384396 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90bb1ea-1693-4dcb-8685-5c502001a051 service nova] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:33:25.384875 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90bb1ea-1693-4dcb-8685-5c502001a051 service nova] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:33:25.385501 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90bb1ea-1693-4dcb-8685-5c502001a051 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:33:25.397603 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90bb1ea-1693-4dcb-8685-5c502001a051 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:33:25.399639 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90bb1ea-1693-4dcb-8685-5c502001a051 service nova] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:33:25.422435 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1208/2399] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:33:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:33:28.276979 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452814bb-6814-4eba-a097-e9933d62a906 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:33:28.277477 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452814bb-6814-4eba-a097-e9933d62a906 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:33:28.277477 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452814bb-6814-4eba-a097-e9933d62a906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:33:28.297784 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-452814bb-6814-4eba-a097-e9933d62a906 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:33:28.299453 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-452814bb-6814-4eba-a097-e9933d62a906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:33:28.308196 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1192/2400] 10.222.0.17 () {58 vars in 1016 bytes} [Fri Aug 12 01:33:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 01:33:28.336550 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90bb1ea-1693-4dcb-8685-5c502001a051 service nova] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:33:28.338067 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-f90bb1ea-1693-4dcb-8685-5c502001a051 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:33:28.353467 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90bb1ea-1693-4dcb-8685-5c502001a051 service nova] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:33:28.360246 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad642577-737d-40db-b580-6bf46487abdf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd5e95467b44175be2478c2c7c89926', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:33:28.360932 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad642577-737d-40db-b580-6bf46487abdf service nova] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:33:28.361302 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad642577-737d-40db-b580-6bf46487abdf service nova] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:33:28.361581 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad642577-737d-40db-b580-6bf46487abdf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:33:28.371151 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad642577-737d-40db-b580-6bf46487abdf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:33:28.372744 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad642577-737d-40db-b580-6bf46487abdf service nova] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:33:28.383036 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1209/2401] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:33:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:33:33.702981 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895f5fb-b02b-4204-94ff-6200af1be179 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:33:33.703860 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895f5fb-b02b-4204-94ff-6200af1be179 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:33:33.704132 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895f5fb-b02b-4204-94ff-6200af1be179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:33:33.733184 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-1895f5fb-b02b-4204-94ff-6200af1be179 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:33:33.734481 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-1895f5fb-b02b-4204-94ff-6200af1be179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:33:33.744643 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1193/2402] 10.222.0.17 () {58 vars in 1016 bytes} [Fri Aug 12 01:33:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:33:33.768150 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad642577-737d-40db-b580-6bf46487abdf service nova] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:33:33.781242 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad642577-737d-40db-b580-6bf46487abdf service nova] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:33:33.788598 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c392ad-9b9c-4be2-8266-3814735f67d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd5e95467b44175be2478c2c7c89926', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:33:33.789221 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c392ad-9b9c-4be2-8266-3814735f67d6 service nova] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:33:33.789494 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c392ad-9b9c-4be2-8266-3814735f67d6 service nova] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:33:33.789757 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c392ad-9b9c-4be2-8266-3814735f67d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:33:33.799808 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c392ad-9b9c-4be2-8266-3814735f67d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:33:33.801464 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c392ad-9b9c-4be2-8266-3814735f67d6 service nova] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:33:33.813572 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1210/2403] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:33:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:33:36.785730 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b731786-e629-45a6-9759-24bd907d6559 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:33:36.786299 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b731786-e629-45a6-9759-24bd907d6559 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:33:36.787285 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b731786-e629-45a6-9759-24bd907d6559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:33:36.791594 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b5c135-6871-4000-887b-1e7116f7dd91 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:33:36.792475 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b5c135-6871-4000-887b-1e7116f7dd91 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:33:36.792964 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b5c135-6871-4000-887b-1e7116f7dd91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:33:36.808377 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-2b731786-e629-45a6-9759-24bd907d6559 None None] MFA Rules not processed for user `c8e85b77280f4a779c1d2ab66891f948`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:33:36.809805 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2b731786-e629-45a6-9759-24bd907d6559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:33:36.817869 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-47b5c135-6871-4000-887b-1e7116f7dd91 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:33:36.819127 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-47b5c135-6871-4000-887b-1e7116f7dd91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:33:36.828672 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1211/2404] 10.222.0.17 () {58 vars in 1016 bytes} [Fri Aug 12 01:33:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 01:33:36.855028 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b5c135-6871-4000-887b-1e7116f7dd91 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:33:36.868956 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b5c135-6871-4000-887b-1e7116f7dd91 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:33:36.874749 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d1f02b-2c49-4b2f-b673-119078efaab5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd5e95467b44175be2478c2c7c89926', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:33:36.875357 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d1f02b-2c49-4b2f-b673-119078efaab5 service nova] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:33:36.875636 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d1f02b-2c49-4b2f-b673-119078efaab5 service nova] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:33:36.875907 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d1f02b-2c49-4b2f-b673-119078efaab5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:33:36.884852 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1194/2405] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:33:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:33:36.885278 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d1f02b-2c49-4b2f-b673-119078efaab5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:33:36.887040 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d1f02b-2c49-4b2f-b673-119078efaab5 service nova] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:33:36.898015 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1212/2406] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:33:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:33:39.970265 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d9093-c623-4280-81b2-82a5797ca64c None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:33:39.970942 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d9093-c623-4280-81b2-82a5797ca64c None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:33:39.970942 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d9093-c623-4280-81b2-82a5797ca64c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:33:39.991486 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-007d9093-c623-4280-81b2-82a5797ca64c None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:33:39.992670 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-007d9093-c623-4280-81b2-82a5797ca64c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:33:40.000618 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1195/2407] 10.222.0.17 () {58 vars in 1016 bytes} [Fri Aug 12 01:33:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:33:40.022283 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d1f02b-2c49-4b2f-b673-119078efaab5 service nova] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:33:40.034131 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d1f02b-2c49-4b2f-b673-119078efaab5 service nova] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:33:40.039992 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb56e89-9ba7-4afd-ae7d-27b379b454f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd5e95467b44175be2478c2c7c89926', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:33:40.040597 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb56e89-9ba7-4afd-ae7d-27b379b454f5 service nova] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:33:40.040872 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb56e89-9ba7-4afd-ae7d-27b379b454f5 service nova] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:33:40.041156 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb56e89-9ba7-4afd-ae7d-27b379b454f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:33:40.050137 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb56e89-9ba7-4afd-ae7d-27b379b454f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:33:40.051741 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb56e89-9ba7-4afd-ae7d-27b379b454f5 service nova] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:33:40.061991 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1213/2408] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:33:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:33:44.193886 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3051c60-3165-41dd-95e7-85af27703544 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:33:44.194542 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3051c60-3165-41dd-95e7-85af27703544 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:33:44.194542 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3051c60-3165-41dd-95e7-85af27703544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:33:44.214712 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-c3051c60-3165-41dd-95e7-85af27703544 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:33:44.215960 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c3051c60-3165-41dd-95e7-85af27703544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:33:44.224692 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1196/2409] 10.222.0.17 () {58 vars in 1016 bytes} [Fri Aug 12 01:33:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:33:44.250938 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb56e89-9ba7-4afd-ae7d-27b379b454f5 service nova] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:33:44.263099 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb56e89-9ba7-4afd-ae7d-27b379b454f5 service nova] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:33:44.270563 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ea6e1-23b1-4a7c-8ccf-fbb9e19e542d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd5e95467b44175be2478c2c7c89926', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:33:44.271251 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ea6e1-23b1-4a7c-8ccf-fbb9e19e542d service nova] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:33:44.271519 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ea6e1-23b1-4a7c-8ccf-fbb9e19e542d service nova] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:33:44.271789 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ea6e1-23b1-4a7c-8ccf-fbb9e19e542d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:33:44.281320 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89ea6e1-23b1-4a7c-8ccf-fbb9e19e542d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:33:44.283300 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89ea6e1-23b1-4a7c-8ccf-fbb9e19e542d service nova] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:33:44.292823 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1214/2410] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:33:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:33:46.538423 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79010d86-bba1-409a-8eae-682a53fbd6bb None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:33:46.538944 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79010d86-bba1-409a-8eae-682a53fbd6bb None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:33:46.538944 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79010d86-bba1-409a-8eae-682a53fbd6bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:33:46.558553 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-79010d86-bba1-409a-8eae-682a53fbd6bb None None] MFA Rules not processed for user `619b8ee9e99c4d0b9ec1e2f91c19569d`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:33:46.559739 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-79010d86-bba1-409a-8eae-682a53fbd6bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:33:46.617758 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1197/2411] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:33:46 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:33:54.288279 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:33:56.610404 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=65 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:34:04.447097 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9e3cd-90b3-47cb-9945-a931b61fa437 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:34:04.448012 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9e3cd-90b3-47cb-9945-a931b61fa437 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:34:04.448456 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9e3cd-90b3-47cb-9945-a931b61fa437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:34:04.469360 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-64e9e3cd-90b3-47cb-9945-a931b61fa437 None None] MFA Rules not processed for user `04bb1a772b004b1394c19d9dbd306cb0`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:34:04.470648 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-64e9e3cd-90b3-47cb-9945-a931b61fa437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:34:04.528554 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1215/2412] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:34:04 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:34:05.187095 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c113f028-e535-4b9c-9ee4-cccebdaf813c None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:34:05.187897 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c113f028-e535-4b9c-9ee4-cccebdaf813c None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:34:05.187897 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c113f028-e535-4b9c-9ee4-cccebdaf813c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:34:05.223737 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-c113f028-e535-4b9c-9ee4-cccebdaf813c None None] MFA Rules not processed for user `0644015c01124adbb76b78311b17bb62`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:34:05.224925 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c113f028-e535-4b9c-9ee4-cccebdaf813c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:34:05.236716 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1198/2413] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:34:05 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:34:14.521335 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=25 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:34:15.218321 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:34:22.047004 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169046b-c3ae-4265-8d09-4c6daccec367 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:34:22.047715 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169046b-c3ae-4265-8d09-4c6daccec367 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:34:22.047715 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169046b-c3ae-4265-8d09-4c6daccec367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:34:22.077215 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-1169046b-c3ae-4265-8d09-4c6daccec367 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:34:22.078441 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-1169046b-c3ae-4265-8d09-4c6daccec367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:34:22.089498 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1216/2414] 10.222.0.17 () {58 vars in 1016 bytes} [Fri Aug 12 01:34:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:34:22.111445 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c113f028-e535-4b9c-9ee4-cccebdaf813c None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:34:22.129274 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c113f028-e535-4b9c-9ee4-cccebdaf813c None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:34:22.137466 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871d9bb1-b8e6-4fe1-8456-df17fc9e8dd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd5e95467b44175be2478c2c7c89926', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:34:22.138161 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d9bb1-b8e6-4fe1-8456-df17fc9e8dd3 service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:34:22.138421 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d9bb1-b8e6-4fe1-8456-df17fc9e8dd3 service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:34:22.138674 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d9bb1-b8e6-4fe1-8456-df17fc9e8dd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:34:22.148758 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871d9bb1-b8e6-4fe1-8456-df17fc9e8dd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:34:22.150369 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871d9bb1-b8e6-4fe1-8456-df17fc9e8dd3 service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:34:22.162019 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1199/2415] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:34:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:34:25.399122 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d639570-c185-40bc-a875-b46bc6d08e2e None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:34:25.399693 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d639570-c185-40bc-a875-b46bc6d08e2e None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:34:25.399693 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d639570-c185-40bc-a875-b46bc6d08e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:34:25.420579 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-1d639570-c185-40bc-a875-b46bc6d08e2e None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:34:25.421847 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-1d639570-c185-40bc-a875-b46bc6d08e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:34:25.431118 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1217/2416] 10.222.0.17 () {58 vars in 1016 bytes} [Fri Aug 12 01:34:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:34:25.453153 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871d9bb1-b8e6-4fe1-8456-df17fc9e8dd3 service nova] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:34:25.464457 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871d9bb1-b8e6-4fe1-8456-df17fc9e8dd3 service nova] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:34:25.470874 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09cbf0e-a3d3-4db9-93a1-c38a762a72ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd5e95467b44175be2478c2c7c89926', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:34:25.471471 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09cbf0e-a3d3-4db9-93a1-c38a762a72ee service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:34:25.471739 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09cbf0e-a3d3-4db9-93a1-c38a762a72ee service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:34:25.471998 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09cbf0e-a3d3-4db9-93a1-c38a762a72ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:34:25.480852 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09cbf0e-a3d3-4db9-93a1-c38a762a72ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:34:25.482459 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09cbf0e-a3d3-4db9-93a1-c38a762a72ee service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:34:25.492358 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1200/2417] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:34:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:34:28.451793 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bf91a-c16f-4535-bab0-48dd699a0569 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:34:28.452387 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bf91a-c16f-4535-bab0-48dd699a0569 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:34:28.452546 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bf91a-c16f-4535-bab0-48dd699a0569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:34:28.473273 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-393bf91a-c16f-4535-bab0-48dd699a0569 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:34:28.474493 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-393bf91a-c16f-4535-bab0-48dd699a0569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:34:28.484451 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1218/2418] 10.222.0.17 () {58 vars in 1016 bytes} [Fri Aug 12 01:34:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:34:28.510417 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09cbf0e-a3d3-4db9-93a1-c38a762a72ee service nova] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:34:28.522010 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09cbf0e-a3d3-4db9-93a1-c38a762a72ee service nova] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:34:28.529056 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d6a92a-9abb-4961-a5c5-0c6fa6740293 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd5e95467b44175be2478c2c7c89926', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:34:28.529657 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6a92a-9abb-4961-a5c5-0c6fa6740293 service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:34:28.529926 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6a92a-9abb-4961-a5c5-0c6fa6740293 service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:34:28.530220 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6a92a-9abb-4961-a5c5-0c6fa6740293 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:34:28.538745 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d6a92a-9abb-4961-a5c5-0c6fa6740293 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:34:28.540317 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d6a92a-9abb-4961-a5c5-0c6fa6740293 service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:34:28.550913 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1201/2419] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:34:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:34:31.630803 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8f0a5-be58-4e08-ac51-7c8ada263c6e None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:34:31.631377 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8f0a5-be58-4e08-ac51-7c8ada263c6e None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:34:31.631487 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8f0a5-be58-4e08-ac51-7c8ada263c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:34:31.652653 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-02a8f0a5-be58-4e08-ac51-7c8ada263c6e None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:34:31.653865 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-02a8f0a5-be58-4e08-ac51-7c8ada263c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:34:31.662488 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1219/2420] 10.222.0.17 () {58 vars in 1016 bytes} [Fri Aug 12 01:34:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 01:34:31.687197 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d6a92a-9abb-4961-a5c5-0c6fa6740293 service nova] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:34:31.702095 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d6a92a-9abb-4961-a5c5-0c6fa6740293 service nova] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:34:31.712404 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c146e480-7c67-48d9-b576-0d38202b1b42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd5e95467b44175be2478c2c7c89926', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:34:31.713004 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146e480-7c67-48d9-b576-0d38202b1b42 service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:34:31.713269 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146e480-7c67-48d9-b576-0d38202b1b42 service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:34:31.713526 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146e480-7c67-48d9-b576-0d38202b1b42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:34:31.722716 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c146e480-7c67-48d9-b576-0d38202b1b42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:34:31.724402 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c146e480-7c67-48d9-b576-0d38202b1b42 service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:34:31.734759 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1202/2421] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:34:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:34:34.817183 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17660d37-389d-449d-b63f-b0319255220a None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:34:34.817737 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17660d37-389d-449d-b63f-b0319255220a None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:34:34.817737 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17660d37-389d-449d-b63f-b0319255220a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:34:34.842559 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-17660d37-389d-449d-b63f-b0319255220a None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:34:34.843781 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-17660d37-389d-449d-b63f-b0319255220a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:34:34.853568 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1220/2422] 10.222.0.17 () {58 vars in 1016 bytes} [Fri Aug 12 01:34:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:34:34.882716 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c146e480-7c67-48d9-b576-0d38202b1b42 service nova] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:34:34.893344 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c146e480-7c67-48d9-b576-0d38202b1b42 service nova] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:34:34.899632 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80bb573-a794-4cb9-b991-47cb859a1c23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd5e95467b44175be2478c2c7c89926', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:34:34.900185 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80bb573-a794-4cb9-b991-47cb859a1c23 service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:34:34.900544 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80bb573-a794-4cb9-b991-47cb859a1c23 service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:34:34.900818 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80bb573-a794-4cb9-b991-47cb859a1c23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:34:34.910500 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80bb573-a794-4cb9-b991-47cb859a1c23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:34:34.911373 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80bb573-a794-4cb9-b991-47cb859a1c23 service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:34:34.921394 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1203/2423] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:34:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:34:44.836693 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=15 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:34:44.916877 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=30 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:34:57.038218 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17660d37-389d-449d-b63f-b0319255220a None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:34:57.039758 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-17660d37-389d-449d-b63f-b0319255220a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:34:57.052967 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17660d37-389d-449d-b63f-b0319255220a None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:34:57.057462 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2408b511-dace-418b-8fba-3df87b8bc0c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:34:57.058072 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408b511-dace-418b-8fba-3df87b8bc0c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:34:57.058377 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408b511-dace-418b-8fba-3df87b8bc0c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:34:57.058671 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408b511-dace-418b-8fba-3df87b8bc0c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:34:57.060641 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-2408b511-dace-418b-8fba-3df87b8bc0c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:34:57.074923 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2408b511-dace-418b-8fba-3df87b8bc0c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:34:57.076341 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2408b511-dace-418b-8fba-3df87b8bc0c6 service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:34:57.086311 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1221/2424] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:34:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:34:59.458463 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80bb573-a794-4cb9-b991-47cb859a1c23 service nova] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:34:59.468072 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80bb573-a794-4cb9-b991-47cb859a1c23 service nova] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:34:59.471755 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9532951c-6ac5-435e-ab98-d250d5499dcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:34:59.472443 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9532951c-6ac5-435e-ab98-d250d5499dcd service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:34:59.472774 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9532951c-6ac5-435e-ab98-d250d5499dcd service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:34:59.473098 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9532951c-6ac5-435e-ab98-d250d5499dcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:34:59.474938 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-9532951c-6ac5-435e-ab98-d250d5499dcd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:34:59.489824 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9532951c-6ac5-435e-ab98-d250d5499dcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:34:59.491560 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9532951c-6ac5-435e-ab98-d250d5499dcd service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:34:59.504918 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1204/2425] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:34:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:35:01.458739 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c53fd1-1d56-445a-b6e1-090b984b62f9 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:01.459220 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c53fd1-1d56-445a-b6e1-090b984b62f9 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:01.459350 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c53fd1-1d56-445a-b6e1-090b984b62f9 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:01.460610 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1222/2426] 10.222.0.26 () {54 vars in 921 bytes} [Fri Aug 12 01:35:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 12 01:35:01.496263 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14625fc-2eed-4cc1-a39a-911c4bc2d254 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:01.496827 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14625fc-2eed-4cc1-a39a-911c4bc2d254 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:01.496827 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14625fc-2eed-4cc1-a39a-911c4bc2d254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:01.522524 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-e14625fc-2eed-4cc1-a39a-911c4bc2d254 None None] MFA Rules not processed for user `06dccf61c686414d904bdf1ecf19d53d`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:35:01.523948 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-e14625fc-2eed-4cc1-a39a-911c4bc2d254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:35:01.536123 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c53fd1-1d56-445a-b6e1-090b984b62f9 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:35:01.538104 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-27c53fd1-1d56-445a-b6e1-090b984b62f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:35:01.538411 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1205/2427] 10.222.0.26 () {58 vars in 1018 bytes} [Fri Aug 12 01:35:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:35:01.557362 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14625fc-2eed-4cc1-a39a-911c4bc2d254 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:35:01.562967 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c53fd1-1d56-445a-b6e1-090b984b62f9 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:35:01.568022 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6741dc-eb5f-47a6-810e-c17b3c6c2911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:35:01.568866 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6741dc-eb5f-47a6-810e-c17b3c6c2911 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:01.569137 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6741dc-eb5f-47a6-810e-c17b3c6c2911 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:01.569554 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6741dc-eb5f-47a6-810e-c17b3c6c2911 admin admin] PATH_INFO: `/v3/users/619b8ee9e99c4d0b9ec1e2f91c19569d` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:01.570275 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14625fc-2eed-4cc1-a39a-911c4bc2d254 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:35:01.570897 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6741dc-eb5f-47a6-810e-c17b3c6c2911 admin admin] RBAC: Authorizing `identity:delete_user(user_id=619b8ee9e99c4d0b9ec1e2f91c19569d)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:35:01.573093 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6741dc-eb5f-47a6-810e-c17b3c6c2911 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:35:01.578626 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dc715c-071e-47a0-8d33-05a363e514f4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06dccf61c686414d904bdf1ecf19d53d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:35:01.579246 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc715c-071e-47a0-8d33-05a363e514f4 service placement] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:01.579569 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc715c-071e-47a0-8d33-05a363e514f4 service placement] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:01.579770 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc715c-071e-47a0-8d33-05a363e514f4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:01.590005 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dc715c-071e-47a0-8d33-05a363e514f4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:35:01.591385 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dc715c-071e-47a0-8d33-05a363e514f4 service placement] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:35:01.605487 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1206/2428] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:35:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 01:35:01.664015 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-7f6741dc-eb5f-47a6-810e-c17b3c6c2911 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '619b8ee9e99c4d0b9ec1e2f91c19569d'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:35:01.682254 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-7f6741dc-eb5f-47a6-810e-c17b3c6c2911 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '619b8ee9e99c4d0b9ec1e2f91c19569d'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:35:01.682564 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-7f6741dc-eb5f-47a6-810e-c17b3c6c2911 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '619b8ee9e99c4d0b9ec1e2f91c19569d'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:35:01.695833 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-7f6741dc-eb5f-47a6-810e-c17b3c6c2911 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '619b8ee9e99c4d0b9ec1e2f91c19569d'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:35:01.716773 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-7f6741dc-eb5f-47a6-810e-c17b3c6c2911 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '619b8ee9e99c4d0b9ec1e2f91c19569d'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:35:01.724399 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1223/2429] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:35:01 2022] DELETE /identity/v3/users/619b8ee9e99c4d0b9ec1e2f91c19569d => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:35:01.954869 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dc715c-071e-47a0-8d33-05a363e514f4 service placement] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:35:01.973677 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dc715c-071e-47a0-8d33-05a363e514f4 service placement] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:35:02.057801 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae43f1b-cf3c-4c80-80a0-ffbb9ad013ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:35:02.060053 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae43f1b-cf3c-4c80-80a0-ffbb9ad013ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:02.060889 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae43f1b-cf3c-4c80-80a0-ffbb9ad013ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:02.064243 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae43f1b-cf3c-4c80-80a0-ffbb9ad013ef admin admin] PATH_INFO: `/v3/projects/f6b6328ff3e6440cbea089a97d44cef8` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:02.066321 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae43f1b-cf3c-4c80-80a0-ffbb9ad013ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6b6328ff3e6440cbea089a97d44cef8)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:35:02.068639 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae43f1b-cf3c-4c80-80a0-ffbb9ad013ef admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:35:02.140549 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-5ae43f1b-cf3c-4c80-80a0-ffbb9ad013ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6b6328ff3e6440cbea089a97d44cef8', 'request_id': 'req-5ae43f1b-cf3c-4c80-80a0-ffbb9ad013ef'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:35:02.152629 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-5ae43f1b-cf3c-4c80-80a0-ffbb9ad013ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6b6328ff3e6440cbea089a97d44cef8', 'request_id': 'req-5ae43f1b-cf3c-4c80-80a0-ffbb9ad013ef'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:35:02.161424 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-5ae43f1b-cf3c-4c80-80a0-ffbb9ad013ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6b6328ff3e6440cbea089a97d44cef8', 'request_id': 'req-5ae43f1b-cf3c-4c80-80a0-ffbb9ad013ef'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:35:02.176101 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-5ae43f1b-cf3c-4c80-80a0-ffbb9ad013ef admin admin] The token cache is being invalidate because project f6b6328ff3e6440cbea089a97d44cef8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:35:02.176387 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-5ae43f1b-cf3c-4c80-80a0-ffbb9ad013ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:35:02.177060 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-5ae43f1b-cf3c-4c80-80a0-ffbb9ad013ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:35:02.182202 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1207/2430] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:35:01 2022] DELETE /identity/v3/projects/f6b6328ff3e6440cbea089a97d44cef8 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:35:02.184105 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a48e1ed-ef95-4140-a3ab-6cacde226292 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:02.185011 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a48e1ed-ef95-4140-a3ab-6cacde226292 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:02.185497 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a48e1ed-ef95-4140-a3ab-6cacde226292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:02.212488 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-8a48e1ed-ef95-4140-a3ab-6cacde226292 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:35:02.214407 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-8a48e1ed-ef95-4140-a3ab-6cacde226292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:35:02.282200 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1224/2431] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:35:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:35:02.289966 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf439f2-eb45-4109-be97-f542f30d3cfa None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:02.290409 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf439f2-eb45-4109-be97-f542f30d3cfa None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:02.290993 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf439f2-eb45-4109-be97-f542f30d3cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:02.310697 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-3bf439f2-eb45-4109-be97-f542f30d3cfa None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:35:02.311934 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-3bf439f2-eb45-4109-be97-f542f30d3cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:35:02.320509 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1208/2432] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:35:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:35:02.325074 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a48e1ed-ef95-4140-a3ab-6cacde226292 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:35:02.335215 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a48e1ed-ef95-4140-a3ab-6cacde226292 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:35:02.340070 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3586a59c-1bc9-4cd3-a8c1-ce7bf34b449d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:35:02.340674 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3586a59c-1bc9-4cd3-a8c1-ce7bf34b449d admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:02.340949 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3586a59c-1bc9-4cd3-a8c1-ce7bf34b449d admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:02.341220 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3586a59c-1bc9-4cd3-a8c1-ce7bf34b449d admin admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:02.341960 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3586a59c-1bc9-4cd3-a8c1-ce7bf34b449d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:35:02.342298 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3586a59c-1bc9-4cd3-a8c1-ce7bf34b449d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:35:02.343912 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3586a59c-1bc9-4cd3-a8c1-ce7bf34b449d admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:35:02.356278 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1225/2433] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 01:35:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:35:02.360760 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf439f2-eb45-4109-be97-f542f30d3cfa None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:35:02.370034 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf439f2-eb45-4109-be97-f542f30d3cfa None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:35:02.374763 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f69bbd-4701-405a-9846-23a571868242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:35:02.375359 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f69bbd-4701-405a-9846-23a571868242 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:02.375627 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f69bbd-4701-405a-9846-23a571868242 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:02.375887 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f69bbd-4701-405a-9846-23a571868242 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:02.376499 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f69bbd-4701-405a-9846-23a571868242 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:35:02.378394 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f69bbd-4701-405a-9846-23a571868242 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:35:02.406164 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1209/2434] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:35:02 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 01:35:02.411458 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3586a59c-1bc9-4cd3-a8c1-ce7bf34b449d admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:35:02.421757 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3586a59c-1bc9-4cd3-a8c1-ce7bf34b449d admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:35:02.468159 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:35:02.488840 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085aed36-fab1-4534-bc70-adee60dce0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:35:02.489320 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085aed36-fab1-4534-bc70-adee60dce0ca admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:02.489540 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085aed36-fab1-4534-bc70-adee60dce0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:02.489803 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085aed36-fab1-4534-bc70-adee60dce0ca admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:02.490466 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085aed36-fab1-4534-bc70-adee60dce0ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:35:02.492461 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085aed36-fab1-4534-bc70-adee60dce0ca admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:35:02.516222 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1226/2435] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:35:02 2022] POST /identity/v3/users => generated 287 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:35:02.522088 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f69bbd-4701-405a-9846-23a571868242 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:35:02.535501 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f69bbd-4701-405a-9846-23a571868242 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:35:02.541847 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7f96ea-f7ec-445b-9e31-ed6f973221c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:35:02.542571 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f96ea-f7ec-445b-9e31-ed6f973221c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:02.542912 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f96ea-f7ec-445b-9e31-ed6f973221c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:02.543256 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f96ea-f7ec-445b-9e31-ed6f973221c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:02.544137 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7f96ea-f7ec-445b-9e31-ed6f973221c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:35:02.545779 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7f96ea-f7ec-445b-9e31-ed6f973221c1 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:35:02.556859 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1210/2436] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:35:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:35:02.560780 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085aed36-fab1-4534-bc70-adee60dce0ca admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:35:02.572490 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085aed36-fab1-4534-bc70-adee60dce0ca admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:35:02.578009 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b14a3-fd1e-4ebe-b7a8-1c6926d46310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:35:02.578635 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b14a3-fd1e-4ebe-b7a8-1c6926d46310 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:02.578912 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b14a3-fd1e-4ebe-b7a8-1c6926d46310 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:02.579182 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b14a3-fd1e-4ebe-b7a8-1c6926d46310 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:02.579966 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542b14a3-fd1e-4ebe-b7a8-1c6926d46310 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:35:02.581547 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542b14a3-fd1e-4ebe-b7a8-1c6926d46310 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:35:02.599680 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1227/2437] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:35:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:35:02.600678 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7f96ea-f7ec-445b-9e31-ed6f973221c1 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:35:02.611634 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7f96ea-f7ec-445b-9e31-ed6f973221c1 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:35:02.616813 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16518f4d-944d-4b70-8e4a-ee8a921e33d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:35:02.617732 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16518f4d-944d-4b70-8e4a-ee8a921e33d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:02.618005 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16518f4d-944d-4b70-8e4a-ee8a921e33d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:02.618298 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16518f4d-944d-4b70-8e4a-ee8a921e33d8 admin admin] PATH_INFO: `/v3/projects/d7c2c730a29c4c0d83ab7640e982e0e9/users/a3ebe3810ba445acb7cbeef1bdce12e2/roles/13af81971c1c428eae0a571a22ea583d` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:02.634033 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16518f4d-944d-4b70-8e4a-ee8a921e33d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7c2c730a29c4c0d83ab7640e982e0e9, user_id=a3ebe3810ba445acb7cbeef1bdce12e2, role_id=13af81971c1c428eae0a571a22ea583d)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:35:02.636742 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16518f4d-944d-4b70-8e4a-ee8a921e33d8 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:35:02.639105 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:35:02.654998 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1211/2438] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:35:02 2022] PUT /identity/v3/projects/d7c2c730a29c4c0d83ab7640e982e0e9/users/a3ebe3810ba445acb7cbeef1bdce12e2/roles/13af81971c1c428eae0a571a22ea583d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:35:02.666014 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc1d2fd-de07-49d9-9439-df3c5a6b7a4d None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:02.666419 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc1d2fd-de07-49d9-9439-df3c5a6b7a4d None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:02.666751 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc1d2fd-de07-49d9-9439-df3c5a6b7a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:02.695630 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-4fc1d2fd-de07-49d9-9439-df3c5a6b7a4d None None] MFA Rules not processed for user `a3ebe3810ba445acb7cbeef1bdce12e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:35:02.696886 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-4fc1d2fd-de07-49d9-9439-df3c5a6b7a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:35:02.774171 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1228/2439] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:35:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:35:02.783609 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16518f4d-944d-4b70-8e4a-ee8a921e33d8 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:35:02.785766 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-16518f4d-944d-4b70-8e4a-ee8a921e33d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:35:02.879778 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16518f4d-944d-4b70-8e4a-ee8a921e33d8 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:35:02.886099 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4d4f41-a80e-452e-ba53-5cb4c0f61f75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd5e95467b44175be2478c2c7c89926', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:35:02.886723 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d4f41-a80e-452e-ba53-5cb4c0f61f75 service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:02.886999 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d4f41-a80e-452e-ba53-5cb4c0f61f75 service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:02.887266 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d4f41-a80e-452e-ba53-5cb4c0f61f75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:02.897635 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4d4f41-a80e-452e-ba53-5cb4c0f61f75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:35:02.898851 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4d4f41-a80e-452e-ba53-5cb4c0f61f75 service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:35:02.910252 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1212/2440] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:35:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:35:03.292527 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc1d2fd-de07-49d9-9439-df3c5a6b7a4d None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:35:03.294033 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-4fc1d2fd-de07-49d9-9439-df3c5a6b7a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:35:03.359507 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc1d2fd-de07-49d9-9439-df3c5a6b7a4d None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:35:03.363520 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97d0842-4bef-4fae-9447-9da99986529b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7853d40c29af424c8d7913950d89750b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:35:03.364127 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d0842-4bef-4fae-9447-9da99986529b service cinder] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:03.364399 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d0842-4bef-4fae-9447-9da99986529b service cinder] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:03.364663 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d0842-4bef-4fae-9447-9da99986529b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:03.366522 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-d97d0842-4bef-4fae-9447-9da99986529b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:35:03.381417 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97d0842-4bef-4fae-9447-9da99986529b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:35:03.383313 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97d0842-4bef-4fae-9447-9da99986529b service cinder] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:35:03.396034 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1229/2441] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:35:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:35:03.911653 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba43d61-76dc-44b3-a2ca-0515859978b2 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:03.912135 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba43d61-76dc-44b3-a2ca-0515859978b2 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:03.912228 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba43d61-76dc-44b3-a2ca-0515859978b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:03.932070 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-cba43d61-76dc-44b3-a2ca-0515859978b2 None None] MFA Rules not processed for user `c8e85b77280f4a779c1d2ab66891f948`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:35:03.933365 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-cba43d61-76dc-44b3-a2ca-0515859978b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:35:03.997675 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1213/2442] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:35:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:35:05.420313 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97d0842-4bef-4fae-9447-9da99986529b service cinder] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:35:05.432050 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97d0842-4bef-4fae-9447-9da99986529b service cinder] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:35:05.437635 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ef3167-e9d2-4164-b159-4e3be56cd74b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd5e95467b44175be2478c2c7c89926', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:35:05.438258 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef3167-e9d2-4164-b159-4e3be56cd74b service nova] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:05.438841 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef3167-e9d2-4164-b159-4e3be56cd74b service nova] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:05.439105 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef3167-e9d2-4164-b159-4e3be56cd74b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:05.440881 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-84ef3167-e9d2-4164-b159-4e3be56cd74b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:35:05.499403 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:35:05.501900 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ef3167-e9d2-4164-b159-4e3be56cd74b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:35:05.504077 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ef3167-e9d2-4164-b159-4e3be56cd74b service nova] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:35:05.514647 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1230/2443] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:35:05 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:35:05.802812 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba43d61-76dc-44b3-a2ca-0515859978b2 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:35:05.895076 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba43d61-76dc-44b3-a2ca-0515859978b2 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:35:05.901414 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96319ab1-0246-45f9-a462-11cfd56e7912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:35:05.902034 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96319ab1-0246-45f9-a462-11cfd56e7912 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:05.902359 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96319ab1-0246-45f9-a462-11cfd56e7912 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:05.902634 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96319ab1-0246-45f9-a462-11cfd56e7912 admin admin] PATH_INFO: `/v3/users/a3ebe3810ba445acb7cbeef1bdce12e2` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:05.903780 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96319ab1-0246-45f9-a462-11cfd56e7912 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3ebe3810ba445acb7cbeef1bdce12e2)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:35:05.906815 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96319ab1-0246-45f9-a462-11cfd56e7912 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:35:05.948579 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:INSERT=1,keystone:SELECT=95,keystone:DELETE=4 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:35:05.969699 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-96319ab1-0246-45f9-a462-11cfd56e7912 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3ebe3810ba445acb7cbeef1bdce12e2'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:35:05.978651 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-96319ab1-0246-45f9-a462-11cfd56e7912 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3ebe3810ba445acb7cbeef1bdce12e2'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:35:05.979341 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-96319ab1-0246-45f9-a462-11cfd56e7912 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3ebe3810ba445acb7cbeef1bdce12e2'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:35:05.986331 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-96319ab1-0246-45f9-a462-11cfd56e7912 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3ebe3810ba445acb7cbeef1bdce12e2'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:35:05.999265 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-96319ab1-0246-45f9-a462-11cfd56e7912 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3ebe3810ba445acb7cbeef1bdce12e2'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:35:06.005375 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1214/2444] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:35:05 2022] DELETE /identity/v3/users/a3ebe3810ba445acb7cbeef1bdce12e2 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:35:06.010276 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df24fa2-9862-4341-8afd-7a8e2f0384be None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:06.010558 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df24fa2-9862-4341-8afd-7a8e2f0384be None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:06.010837 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df24fa2-9862-4341-8afd-7a8e2f0384be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:06.029939 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-8df24fa2-9862-4341-8afd-7a8e2f0384be None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:35:06.031162 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-8df24fa2-9862-4341-8afd-7a8e2f0384be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:35:06.093359 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1231/2445] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:35:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:35:06.103250 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96319ab1-0246-45f9-a462-11cfd56e7912 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:35:06.104748 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-96319ab1-0246-45f9-a462-11cfd56e7912 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:35:06.167339 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96319ab1-0246-45f9-a462-11cfd56e7912 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:35:06.170957 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf3ef7e-92bb-4b25-bffa-707dbc3a1caa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:35:06.171572 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf3ef7e-92bb-4b25-bffa-707dbc3a1caa service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:06.171841 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf3ef7e-92bb-4b25-bffa-707dbc3a1caa service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:06.172104 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf3ef7e-92bb-4b25-bffa-707dbc3a1caa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:06.181542 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf3ef7e-92bb-4b25-bffa-707dbc3a1caa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:35:06.183049 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf3ef7e-92bb-4b25-bffa-707dbc3a1caa service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:35:06.192914 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1215/2446] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:35:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:35:06.504691 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df24fa2-9862-4341-8afd-7a8e2f0384be None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:35:06.507241 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-8df24fa2-9862-4341-8afd-7a8e2f0384be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:35:06.551256 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df24fa2-9862-4341-8afd-7a8e2f0384be None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:35:06.558249 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8fdfe8-7ec9-4345-80ff-29cafb73897d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:35:06.559412 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8fdfe8-7ec9-4345-80ff-29cafb73897d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:06.560207 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8fdfe8-7ec9-4345-80ff-29cafb73897d admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:06.560619 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8fdfe8-7ec9-4345-80ff-29cafb73897d admin admin] PATH_INFO: `/v3/projects/d7c2c730a29c4c0d83ab7640e982e0e9` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:06.561888 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8fdfe8-7ec9-4345-80ff-29cafb73897d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7c2c730a29c4c0d83ab7640e982e0e9)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:35:06.564843 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8fdfe8-7ec9-4345-80ff-29cafb73897d admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:35:06.637747 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-ac8fdfe8-7ec9-4345-80ff-29cafb73897d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7c2c730a29c4c0d83ab7640e982e0e9', 'request_id': 'req-ac8fdfe8-7ec9-4345-80ff-29cafb73897d'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:35:06.646920 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-ac8fdfe8-7ec9-4345-80ff-29cafb73897d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7c2c730a29c4c0d83ab7640e982e0e9', 'request_id': 'req-ac8fdfe8-7ec9-4345-80ff-29cafb73897d'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:35:06.654547 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-ac8fdfe8-7ec9-4345-80ff-29cafb73897d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7c2c730a29c4c0d83ab7640e982e0e9', 'request_id': 'req-ac8fdfe8-7ec9-4345-80ff-29cafb73897d'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:35:06.681174 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-ac8fdfe8-7ec9-4345-80ff-29cafb73897d admin admin] The token cache is being invalidate because project d7c2c730a29c4c0d83ab7640e982e0e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:35:06.681941 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-ac8fdfe8-7ec9-4345-80ff-29cafb73897d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:35:06.683203 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-ac8fdfe8-7ec9-4345-80ff-29cafb73897d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:35:06.689643 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1232/2447] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:35:06 2022] DELETE /identity/v3/projects/d7c2c730a29c4c0d83ab7640e982e0e9 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:35:06.691392 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb31da-b0fc-44b7-ae04-36d4c82e5964 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:06.691986 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb31da-b0fc-44b7-ae04-36d4c82e5964 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:06.692495 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb31da-b0fc-44b7-ae04-36d4c82e5964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:06.729009 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-67bb31da-b0fc-44b7-ae04-36d4c82e5964 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:35:06.730590 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-67bb31da-b0fc-44b7-ae04-36d4c82e5964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:35:06.827373 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1216/2448] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:35:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:35:06.834373 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445adc3d-a795-4fc8-aad4-b886aa4e0711 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:06.834586 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445adc3d-a795-4fc8-aad4-b886aa4e0711 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:06.834907 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445adc3d-a795-4fc8-aad4-b886aa4e0711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:06.858277 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-445adc3d-a795-4fc8-aad4-b886aa4e0711 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:35:06.859853 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-445adc3d-a795-4fc8-aad4-b886aa4e0711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:35:06.873744 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1233/2449] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:35:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:35:06.875098 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bb31da-b0fc-44b7-ae04-36d4c82e5964 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:35:06.886050 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bb31da-b0fc-44b7-ae04-36d4c82e5964 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:35:06.890976 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b77a23-52f7-49c9-a9fc-fac73819e769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:35:06.891661 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b77a23-52f7-49c9-a9fc-fac73819e769 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:06.891996 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b77a23-52f7-49c9-a9fc-fac73819e769 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:06.892324 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b77a23-52f7-49c9-a9fc-fac73819e769 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:06.893176 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b77a23-52f7-49c9-a9fc-fac73819e769 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:35:06.893575 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b77a23-52f7-49c9-a9fc-fac73819e769 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:35:06.895285 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b77a23-52f7-49c9-a9fc-fac73819e769 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:35:06.910609 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1217/2450] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 01:35:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:35:06.914638 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445adc3d-a795-4fc8-aad4-b886aa4e0711 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:35:06.929983 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445adc3d-a795-4fc8-aad4-b886aa4e0711 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:35:06.936060 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d755b490-2ec7-4822-a98e-c9ebdbbf06e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:35:06.938247 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755b490-2ec7-4822-a98e-c9ebdbbf06e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:06.938247 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755b490-2ec7-4822-a98e-c9ebdbbf06e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:06.938247 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755b490-2ec7-4822-a98e-c9ebdbbf06e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:06.939697 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d755b490-2ec7-4822-a98e-c9ebdbbf06e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:35:06.943843 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d755b490-2ec7-4822-a98e-c9ebdbbf06e8 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:35:06.994830 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1234/2451] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:35:06 2022] POST /identity/v3/projects => generated 373 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 01:35:06.999213 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b77a23-52f7-49c9-a9fc-fac73819e769 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:35:07.013647 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b77a23-52f7-49c9-a9fc-fac73819e769 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:35:07.048410 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:35:07.085248 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf69be-4b27-4438-83de-15b616b87b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:35:07.085880 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf69be-4b27-4438-83de-15b616b87b05 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:07.086179 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf69be-4b27-4438-83de-15b616b87b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:07.086484 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf69be-4b27-4438-83de-15b616b87b05 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:07.087426 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaf69be-4b27-4438-83de-15b616b87b05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:35:07.089944 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaf69be-4b27-4438-83de-15b616b87b05 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:35:07.118862 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1218/2452] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:35:06 2022] POST /identity/v3/users => generated 287 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 01:35:07.123194 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d755b490-2ec7-4822-a98e-c9ebdbbf06e8 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:35:07.136669 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d755b490-2ec7-4822-a98e-c9ebdbbf06e8 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:35:07.142290 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b27585-cd81-4040-b4bd-b719688dc6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:35:07.142929 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b27585-cd81-4040-b4bd-b719688dc6ae admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:07.143477 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b27585-cd81-4040-b4bd-b719688dc6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:07.145102 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b27585-cd81-4040-b4bd-b719688dc6ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:07.145102 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b27585-cd81-4040-b4bd-b719688dc6ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:35:07.146006 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b27585-cd81-4040-b4bd-b719688dc6ae admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:35:07.158228 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1235/2453] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:35:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:35:07.162027 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf69be-4b27-4438-83de-15b616b87b05 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:35:07.174095 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf69be-4b27-4438-83de-15b616b87b05 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:35:07.180679 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7514b0-f6c4-4b97-8d15-0d5e0f352465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:35:07.181398 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7514b0-f6c4-4b97-8d15-0d5e0f352465 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:07.181909 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7514b0-f6c4-4b97-8d15-0d5e0f352465 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:07.182440 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7514b0-f6c4-4b97-8d15-0d5e0f352465 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:07.183366 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7514b0-f6c4-4b97-8d15-0d5e0f352465 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:35:07.185393 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7514b0-f6c4-4b97-8d15-0d5e0f352465 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:35:07.198021 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1219/2454] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:35:07 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 01:35:07.202918 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b27585-cd81-4040-b4bd-b719688dc6ae admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:35:07.216853 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b27585-cd81-4040-b4bd-b719688dc6ae admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:35:07.235449 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b0120-023e-4d41-a684-c772a243f5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:35:07.236170 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b0120-023e-4d41-a684-c772a243f5ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:07.236452 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b0120-023e-4d41-a684-c772a243f5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:07.236801 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b0120-023e-4d41-a684-c772a243f5ce admin admin] PATH_INFO: `/v3/projects/cf9b36a653254a99bd89f86239b74c1c/users/bc97c34994604750bfac69685e0d9cdd/roles/13af81971c1c428eae0a571a22ea583d` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:07.256383 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41b0120-023e-4d41-a684-c772a243f5ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf9b36a653254a99bd89f86239b74c1c, user_id=bc97c34994604750bfac69685e0d9cdd, role_id=13af81971c1c428eae0a571a22ea583d)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:35:07.259205 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41b0120-023e-4d41-a684-c772a243f5ce admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:35:07.281428 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1236/2455] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:35:07 2022] PUT /identity/v3/projects/cf9b36a653254a99bd89f86239b74c1c/users/bc97c34994604750bfac69685e0d9cdd/roles/13af81971c1c428eae0a571a22ea583d => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:35:07.293761 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1514546a-05f4-4475-b6d6-a415fef07fda None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:07.294041 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1514546a-05f4-4475-b6d6-a415fef07fda None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:07.294346 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1514546a-05f4-4475-b6d6-a415fef07fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:07.329760 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-1514546a-05f4-4475-b6d6-a415fef07fda None None] MFA Rules not processed for user `bc97c34994604750bfac69685e0d9cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:35:07.331043 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-1514546a-05f4-4475-b6d6-a415fef07fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:35:07.415120 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1220/2456] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:35:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:35:07.420595 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b0120-023e-4d41-a684-c772a243f5ce admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:35:07.480535 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:35:07.566201 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b0120-023e-4d41-a684-c772a243f5ce admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:35:07.574768 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2459f70-7053-4ca6-a4df-11ee7616833b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:35:07.575573 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2459f70-7053-4ca6-a4df-11ee7616833b admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:07.576012 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2459f70-7053-4ca6-a4df-11ee7616833b admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:07.576445 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2459f70-7053-4ca6-a4df-11ee7616833b admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:07.577263 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2459f70-7053-4ca6-a4df-11ee7616833b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:35:07.579421 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2459f70-7053-4ca6-a4df-11ee7616833b admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:35:07.616108 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1237/2457] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:35:07 2022] POST /identity/v3/projects => generated 373 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:35:07.620475 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1514546a-05f4-4475-b6d6-a415fef07fda None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:35:07.638443 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1514546a-05f4-4475-b6d6-a415fef07fda None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:35:07.715809 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c877f582-c571-41ff-91c6-d7ec44cfc807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:35:07.716542 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877f582-c571-41ff-91c6-d7ec44cfc807 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:07.716956 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877f582-c571-41ff-91c6-d7ec44cfc807 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:07.717485 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877f582-c571-41ff-91c6-d7ec44cfc807 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:07.718286 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c877f582-c571-41ff-91c6-d7ec44cfc807 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:35:07.720506 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c877f582-c571-41ff-91c6-d7ec44cfc807 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:35:07.759274 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1221/2458] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:35:07 2022] POST /identity/v3/users => generated 293 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:35:07.761788 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2459f70-7053-4ca6-a4df-11ee7616833b admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:35:07.773552 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2459f70-7053-4ca6-a4df-11ee7616833b admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:35:07.779706 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941824fd-c270-43be-b7a9-597753172ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:35:07.780410 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941824fd-c270-43be-b7a9-597753172ee1 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:07.782186 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941824fd-c270-43be-b7a9-597753172ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:07.782543 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941824fd-c270-43be-b7a9-597753172ee1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:07.783258 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941824fd-c270-43be-b7a9-597753172ee1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:35:07.785060 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941824fd-c270-43be-b7a9-597753172ee1 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:35:07.800371 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1238/2459] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:35:07 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:35:07.804877 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c877f582-c571-41ff-91c6-d7ec44cfc807 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:35:07.816016 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c877f582-c571-41ff-91c6-d7ec44cfc807 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:35:07.838137 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28f0301-716d-42ee-8370-d07b26f13866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:35:07.838920 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f0301-716d-42ee-8370-d07b26f13866 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:07.839254 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f0301-716d-42ee-8370-d07b26f13866 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:07.839531 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f0301-716d-42ee-8370-d07b26f13866 admin admin] PATH_INFO: `/v3/projects/f9bfe2f8391048bd93437f8e25609b3c/users/bc9530dd90b64195b0b4a59ea4b76b16/roles/fb48693810be495fb4b1893a79429b78` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:07.873666 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28f0301-716d-42ee-8370-d07b26f13866 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9bfe2f8391048bd93437f8e25609b3c, user_id=bc9530dd90b64195b0b4a59ea4b76b16, role_id=fb48693810be495fb4b1893a79429b78)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:35:07.876520 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28f0301-716d-42ee-8370-d07b26f13866 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:35:07.906390 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1222/2460] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:35:07 2022] PUT /identity/v3/projects/f9bfe2f8391048bd93437f8e25609b3c/users/bc9530dd90b64195b0b4a59ea4b76b16/roles/fb48693810be495fb4b1893a79429b78 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 01:35:07.907713 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941824fd-c270-43be-b7a9-597753172ee1 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:35:07.918549 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941824fd-c270-43be-b7a9-597753172ee1 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:35:07.994189 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a401483-26a5-479d-a6d4-8d13ded5992b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:35:07.994861 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a401483-26a5-479d-a6d4-8d13ded5992b admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:07.995184 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a401483-26a5-479d-a6d4-8d13ded5992b admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:07.995462 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a401483-26a5-479d-a6d4-8d13ded5992b admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:07.996107 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a401483-26a5-479d-a6d4-8d13ded5992b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:35:07.997762 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a401483-26a5-479d-a6d4-8d13ded5992b admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:35:08.017118 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1239/2461] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:35:07 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:35:08.022491 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28f0301-716d-42ee-8370-d07b26f13866 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:35:08.034926 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28f0301-716d-42ee-8370-d07b26f13866 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:35:08.041402 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83af8d72-33f1-47b2-8f2d-90e073a5faf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:35:08.042261 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af8d72-33f1-47b2-8f2d-90e073a5faf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:08.042601 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af8d72-33f1-47b2-8f2d-90e073a5faf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:08.042989 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af8d72-33f1-47b2-8f2d-90e073a5faf2 admin admin] PATH_INFO: `/v3/projects/f9bfe2f8391048bd93437f8e25609b3c/users/bc9530dd90b64195b0b4a59ea4b76b16/roles/fb48693810be495fb4b1893a79429b78` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:08.045038 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83af8d72-33f1-47b2-8f2d-90e073a5faf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9bfe2f8391048bd93437f8e25609b3c, user_id=bc9530dd90b64195b0b4a59ea4b76b16, role_id=fb48693810be495fb4b1893a79429b78)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:35:08.048103 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83af8d72-33f1-47b2-8f2d-90e073a5faf2 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:35:08.050724 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:35:08.060836 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1223/2462] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:35:08 2022] PUT /identity/v3/projects/f9bfe2f8391048bd93437f8e25609b3c/users/bc9530dd90b64195b0b4a59ea4b76b16/roles/fb48693810be495fb4b1893a79429b78 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:35:08.074463 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136b143e-3028-4c58-b4eb-faa677b0e75d None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:08.074751 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136b143e-3028-4c58-b4eb-faa677b0e75d None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:08.075029 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136b143e-3028-4c58-b4eb-faa677b0e75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:08.104891 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-136b143e-3028-4c58-b4eb-faa677b0e75d None None] MFA Rules not processed for user `bc9530dd90b64195b0b4a59ea4b76b16`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:35:08.106218 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-136b143e-3028-4c58-b4eb-faa677b0e75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:35:08.205304 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1240/2463] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:35:08 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:35:08.217361 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83af8d72-33f1-47b2-8f2d-90e073a5faf2 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:35:08.219248 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-83af8d72-33f1-47b2-8f2d-90e073a5faf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:35:08.279760 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83af8d72-33f1-47b2-8f2d-90e073a5faf2 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:35:08.283416 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dfe550-0bfa-4916-a228-06269e889fa4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7853d40c29af424c8d7913950d89750b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:35:08.284024 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dfe550-0bfa-4916-a228-06269e889fa4 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:08.284299 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dfe550-0bfa-4916-a228-06269e889fa4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:08.284564 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dfe550-0bfa-4916-a228-06269e889fa4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:08.294723 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dfe550-0bfa-4916-a228-06269e889fa4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:35:08.296188 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dfe550-0bfa-4916-a228-06269e889fa4 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:35:08.307135 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1224/2464] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:35:08 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:35:08.394355 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136b143e-3028-4c58-b4eb-faa677b0e75d None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:35:08.405460 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136b143e-3028-4c58-b4eb-faa677b0e75d None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:35:08.409942 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c22436-452c-4a59-886d-a042f8ed4da5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7853d40c29af424c8d7913950d89750b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:35:08.410699 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c22436-452c-4a59-886d-a042f8ed4da5 service cinder] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:08.410937 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c22436-452c-4a59-886d-a042f8ed4da5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:08.411285 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c22436-452c-4a59-886d-a042f8ed4da5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:08.420223 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:35:08.469375 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c22436-452c-4a59-886d-a042f8ed4da5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:35:08.470865 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c22436-452c-4a59-886d-a042f8ed4da5 service cinder] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:35:08.480694 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1241/2465] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:35:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:35:10.665020 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dfe550-0bfa-4916-a228-06269e889fa4 service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:35:10.666519 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-95dfe550-0bfa-4916-a228-06269e889fa4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:35:10.741758 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dfe550-0bfa-4916-a228-06269e889fa4 service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:35:10.746454 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64342eff-0b13-425c-a773-e9571d6ce0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:35:10.747091 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64342eff-0b13-425c-a773-e9571d6ce0b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:10.747371 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64342eff-0b13-425c-a773-e9571d6ce0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:10.747638 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64342eff-0b13-425c-a773-e9571d6ce0b9 admin admin] PATH_INFO: `/v3/users/0644015c01124adbb76b78311b17bb62` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:10.748745 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64342eff-0b13-425c-a773-e9571d6ce0b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0644015c01124adbb76b78311b17bb62)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:35:10.750683 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64342eff-0b13-425c-a773-e9571d6ce0b9 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:35:10.796911 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-64342eff-0b13-425c-a773-e9571d6ce0b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0644015c01124adbb76b78311b17bb62'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:35:10.805708 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-64342eff-0b13-425c-a773-e9571d6ce0b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0644015c01124adbb76b78311b17bb62'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:35:10.806384 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-64342eff-0b13-425c-a773-e9571d6ce0b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0644015c01124adbb76b78311b17bb62'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:35:10.814650 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-64342eff-0b13-425c-a773-e9571d6ce0b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0644015c01124adbb76b78311b17bb62'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:35:10.826450 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-64342eff-0b13-425c-a773-e9571d6ce0b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0644015c01124adbb76b78311b17bb62'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:35:10.832596 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1225/2466] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:35:10 2022] DELETE /identity/v3/users/0644015c01124adbb76b78311b17bb62 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:35:11.005278 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c22436-452c-4a59-886d-a042f8ed4da5 service cinder] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:35:11.019562 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c22436-452c-4a59-886d-a042f8ed4da5 service cinder] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:35:11.082186 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cabd4ac-f526-421c-ba08-6b2873f49041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:35:11.082809 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cabd4ac-f526-421c-ba08-6b2873f49041 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:11.083089 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cabd4ac-f526-421c-ba08-6b2873f49041 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:11.083364 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cabd4ac-f526-421c-ba08-6b2873f49041 admin admin] PATH_INFO: `/v3/projects/043a9d84ea584ed5aeb76a4190cceb80` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:11.084478 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cabd4ac-f526-421c-ba08-6b2873f49041 admin admin] RBAC: Authorizing `identity:delete_project(project_id=043a9d84ea584ed5aeb76a4190cceb80)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:35:11.087107 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cabd4ac-f526-421c-ba08-6b2873f49041 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:35:11.140307 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-0cabd4ac-f526-421c-ba08-6b2873f49041 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '043a9d84ea584ed5aeb76a4190cceb80', 'request_id': 'req-0cabd4ac-f526-421c-ba08-6b2873f49041'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:35:11.146720 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-0cabd4ac-f526-421c-ba08-6b2873f49041 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '043a9d84ea584ed5aeb76a4190cceb80', 'request_id': 'req-0cabd4ac-f526-421c-ba08-6b2873f49041'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:35:11.158817 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-0cabd4ac-f526-421c-ba08-6b2873f49041 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '043a9d84ea584ed5aeb76a4190cceb80', 'request_id': 'req-0cabd4ac-f526-421c-ba08-6b2873f49041'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:35:11.173471 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-0cabd4ac-f526-421c-ba08-6b2873f49041 admin admin] The token cache is being invalidate because project 043a9d84ea584ed5aeb76a4190cceb80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:35:11.173753 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-0cabd4ac-f526-421c-ba08-6b2873f49041 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:35:11.175078 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-0cabd4ac-f526-421c-ba08-6b2873f49041 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:35:11.178196 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1242/2467] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:35:11 2022] DELETE /identity/v3/projects/043a9d84ea584ed5aeb76a4190cceb80 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:35:20.828886 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:INSERT=2,keystone:SELECT=81,keystone:DELETE=10 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:35:21.170514 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=74,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:35:21.595019 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64342eff-0b13-425c-a773-e9571d6ce0b9 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:35:21.596714 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-64342eff-0b13-425c-a773-e9571d6ce0b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:35:21.671940 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64342eff-0b13-425c-a773-e9571d6ce0b9 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:35:21.736235 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac04efdf-82d7-4d7a-8a4c-65c998252242 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06dccf61c686414d904bdf1ecf19d53d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:35:21.736898 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac04efdf-82d7-4d7a-8a4c-65c998252242 service placement] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:21.737163 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac04efdf-82d7-4d7a-8a4c-65c998252242 service placement] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:21.737407 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac04efdf-82d7-4d7a-8a4c-65c998252242 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:21.739193 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-ac04efdf-82d7-4d7a-8a4c-65c998252242 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:35:21.750695 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac04efdf-82d7-4d7a-8a4c-65c998252242 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:35:21.752270 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac04efdf-82d7-4d7a-8a4c-65c998252242 service placement] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:35:21.764045 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1226/2468] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:35:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:35:21.830649 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c26ba6-b77c-43e0-9258-0081506d7d7f None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:21.830989 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c26ba6-b77c-43e0-9258-0081506d7d7f None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:21.831426 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c26ba6-b77c-43e0-9258-0081506d7d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:21.851051 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-35c26ba6-b77c-43e0-9258-0081506d7d7f None None] MFA Rules not processed for user `f3643631cf2d4a9592d465bdeba99669`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:35:21.852385 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-35c26ba6-b77c-43e0-9258-0081506d7d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:35:21.908875 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1243/2469] 10.222.0.26 () {58 vars in 1009 bytes} [Fri Aug 12 01:35:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:35:21.960699 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac04efdf-82d7-4d7a-8a4c-65c998252242 service placement] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:35:21.962957 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-ac04efdf-82d7-4d7a-8a4c-65c998252242 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:35:22.050439 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac04efdf-82d7-4d7a-8a4c-65c998252242 service placement] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:35:22.058730 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9847689b-37f1-421a-b3d4-c556ad0c1689 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32c1ba237f864b5d9699cb817e42e647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:35:22.059807 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847689b-37f1-421a-b3d4-c556ad0c1689 service swift] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:22.060305 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847689b-37f1-421a-b3d4-c556ad0c1689 service swift] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:22.060683 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847689b-37f1-421a-b3d4-c556ad0c1689 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:22.072798 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9847689b-37f1-421a-b3d4-c556ad0c1689 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:35:22.074374 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9847689b-37f1-421a-b3d4-c556ad0c1689 service swift] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:35:22.082886 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1227/2470] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Aug 12 01:35:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 12 01:35:25.454322 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c26ba6-b77c-43e0-9258-0081506d7d7f None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:35:25.455789 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-35c26ba6-b77c-43e0-9258-0081506d7d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:35:25.537147 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c26ba6-b77c-43e0-9258-0081506d7d7f None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:35:25.541277 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67637580-ffcc-42a9-9a72-60eb2f56fa22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:35:25.542287 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67637580-ffcc-42a9-9a72-60eb2f56fa22 service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:25.542634 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67637580-ffcc-42a9-9a72-60eb2f56fa22 service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:25.542988 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67637580-ffcc-42a9-9a72-60eb2f56fa22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:25.545536 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-67637580-ffcc-42a9-9a72-60eb2f56fa22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:35:25.559844 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67637580-ffcc-42a9-9a72-60eb2f56fa22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:35:25.561312 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67637580-ffcc-42a9-9a72-60eb2f56fa22 service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:35:25.574312 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1244/2471] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:35:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:35:32.079531 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=90 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:35:35.566797 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=51 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:35:35.867907 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b7ed6-360e-492d-a3fd-99c617ed837d None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:35.868687 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b7ed6-360e-492d-a3fd-99c617ed837d None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:35.868971 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b7ed6-360e-492d-a3fd-99c617ed837d None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:35.872432 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1228/2472] 10.222.0.26 () {54 vars in 921 bytes} [Fri Aug 12 01:35:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:35:35.879148 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c5da4-5b92-48f7-8fac-456c8a5be43b None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:35.879313 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c5da4-5b92-48f7-8fac-456c8a5be43b None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:35.879758 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c5da4-5b92-48f7-8fac-456c8a5be43b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:35.902137 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-116c5da4-5b92-48f7-8fac-456c8a5be43b None None] MFA Rules not processed for user `fcd5e95467b44175be2478c2c7c89926`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:35:35.903369 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-116c5da4-5b92-48f7-8fac-456c8a5be43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:35:36.000068 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1245/2473] 10.222.0.26 () {58 vars in 1018 bytes} [Fri Aug 12 01:35:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:35:36.019299 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9b7ed6-360e-492d-a3fd-99c617ed837d None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:35:36.021077 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-4e9b7ed6-360e-492d-a3fd-99c617ed837d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:35:36.089411 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9b7ed6-360e-492d-a3fd-99c617ed837d None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:35:36.093821 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441ed769-9377-49ae-a908-4c231ac4d92e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd73d9b9b63a499d909fec034bf9a259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:35:36.094633 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ed769-9377-49ae-a908-4c231ac4d92e service glance] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:36.094956 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ed769-9377-49ae-a908-4c231ac4d92e service glance] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:36.095255 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ed769-9377-49ae-a908-4c231ac4d92e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:36.108278 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441ed769-9377-49ae-a908-4c231ac4d92e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:35:36.110038 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441ed769-9377-49ae-a908-4c231ac4d92e service glance] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:35:36.127110 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1229/2474] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:35:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:35:36.210433 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3253eea-a1ac-4ec8-9aad-1e3395472ed0 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:36.210810 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3253eea-a1ac-4ec8-9aad-1e3395472ed0 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:36.211140 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3253eea-a1ac-4ec8-9aad-1e3395472ed0 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:36.212672 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1246/2475] 10.222.0.26 () {54 vars in 921 bytes} [Fri Aug 12 01:35:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:35:36.218027 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8361e-45b6-495d-a970-4fe93dded54a None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:36.218355 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8361e-45b6-495d-a970-4fe93dded54a None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:36.218596 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8361e-45b6-495d-a970-4fe93dded54a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:36.239956 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-c7e8361e-45b6-495d-a970-4fe93dded54a None None] MFA Rules not processed for user `a80678458dc9405285b70da707a399c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:35:36.241166 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c7e8361e-45b6-495d-a970-4fe93dded54a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:35:36.253402 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1230/2476] 10.222.0.26 () {58 vars in 1018 bytes} [Fri Aug 12 01:35:36 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:35:36.267022 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3253eea-a1ac-4ec8-9aad-1e3395472ed0 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:35:36.269122 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-b3253eea-a1ac-4ec8-9aad-1e3395472ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:35:36.286549 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3253eea-a1ac-4ec8-9aad-1e3395472ed0 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:35:36.291152 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae27c920-023d-4801-8827-3f41ac22df80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:35:36.291824 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae27c920-023d-4801-8827-3f41ac22df80 service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:36.292102 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae27c920-023d-4801-8827-3f41ac22df80 service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:36.292376 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae27c920-023d-4801-8827-3f41ac22df80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:36.306444 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae27c920-023d-4801-8827-3f41ac22df80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:35:36.308625 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae27c920-023d-4801-8827-3f41ac22df80 service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:35:36.318625 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1247/2477] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:35:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:35:36.425848 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b130d-0054-433e-8a17-d9c4ec645b5a None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:36.426183 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b130d-0054-433e-8a17-d9c4ec645b5a None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:36.426547 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b130d-0054-433e-8a17-d9c4ec645b5a None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:36.428086 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1231/2478] 10.222.0.26 () {54 vars in 921 bytes} [Fri Aug 12 01:35:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 12 01:35:36.435206 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15281fb9-9fc0-4535-8601-7b179ae8db77 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:36.435913 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15281fb9-9fc0-4535-8601-7b179ae8db77 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:36.436192 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15281fb9-9fc0-4535-8601-7b179ae8db77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:36.460355 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-15281fb9-9fc0-4535-8601-7b179ae8db77 None None] MFA Rules not processed for user `fcd5e95467b44175be2478c2c7c89926`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:35:36.461634 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-15281fb9-9fc0-4535-8601-7b179ae8db77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:35:36.472720 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1248/2479] 10.222.0.26 () {58 vars in 1018 bytes} [Fri Aug 12 01:35:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:35:36.486359 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590b130d-0054-433e-8a17-d9c4ec645b5a None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:35:36.501834 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590b130d-0054-433e-8a17-d9c4ec645b5a None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:35:36.505799 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab32065-f6ba-41e8-8b2d-69141430ef43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:35:36.506454 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab32065-f6ba-41e8-8b2d-69141430ef43 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:36.506727 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab32065-f6ba-41e8-8b2d-69141430ef43 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:36.506991 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab32065-f6ba-41e8-8b2d-69141430ef43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:36.517329 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab32065-f6ba-41e8-8b2d-69141430ef43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:35:36.518807 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab32065-f6ba-41e8-8b2d-69141430ef43 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:35:36.529523 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1232/2480] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:35:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 01:35:38.336479 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eca42e-ce62-438e-9f82-dce279004fb1 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:38.337285 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eca42e-ce62-438e-9f82-dce279004fb1 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:38.337285 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eca42e-ce62-438e-9f82-dce279004fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:38.356712 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-87eca42e-ce62-438e-9f82-dce279004fb1 None None] MFA Rules not processed for user `f3643631cf2d4a9592d465bdeba99669`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:35:38.357932 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-87eca42e-ce62-438e-9f82-dce279004fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:35:38.365096 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1249/2481] 10.222.0.26 () {58 vars in 1009 bytes} [Fri Aug 12 01:35:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:35:38.377470 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab32065-f6ba-41e8-8b2d-69141430ef43 service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:35:38.388823 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab32065-f6ba-41e8-8b2d-69141430ef43 service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:35:38.395113 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7734f0-e775-49b9-8533-6c9585303080 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32c1ba237f864b5d9699cb817e42e647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:35:38.395713 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7734f0-e775-49b9-8533-6c9585303080 service swift] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:38.395985 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7734f0-e775-49b9-8533-6c9585303080 service swift] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:38.396245 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7734f0-e775-49b9-8533-6c9585303080 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:38.404912 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7734f0-e775-49b9-8533-6c9585303080 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:35:38.406509 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7734f0-e775-49b9-8533-6c9585303080 service swift] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:35:38.414322 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1233/2482] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Aug 12 01:35:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 12 01:35:39.114513 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eca42e-ce62-438e-9f82-dce279004fb1 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:35:39.116282 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-87eca42e-ce62-438e-9f82-dce279004fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:35:39.199875 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eca42e-ce62-438e-9f82-dce279004fb1 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:35:39.205372 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4368e59b-79e9-4ec2-bc78-2977f468a991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:35:39.206003 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368e59b-79e9-4ec2-bc78-2977f468a991 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:39.206305 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368e59b-79e9-4ec2-bc78-2977f468a991 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:39.206573 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368e59b-79e9-4ec2-bc78-2977f468a991 admin admin] PATH_INFO: `/v3/users/bc97c34994604750bfac69685e0d9cdd` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:39.207718 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4368e59b-79e9-4ec2-bc78-2977f468a991 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc97c34994604750bfac69685e0d9cdd)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:35:39.209634 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4368e59b-79e9-4ec2-bc78-2977f468a991 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:35:39.268279 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-4368e59b-79e9-4ec2-bc78-2977f468a991 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc97c34994604750bfac69685e0d9cdd'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:35:39.278633 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-4368e59b-79e9-4ec2-bc78-2977f468a991 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc97c34994604750bfac69685e0d9cdd'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:35:39.279615 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-4368e59b-79e9-4ec2-bc78-2977f468a991 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc97c34994604750bfac69685e0d9cdd'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:35:39.288830 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-4368e59b-79e9-4ec2-bc78-2977f468a991 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc97c34994604750bfac69685e0d9cdd'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:35:39.294339 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:35:39.303639 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-4368e59b-79e9-4ec2-bc78-2977f468a991 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc97c34994604750bfac69685e0d9cdd'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:35:39.317287 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1250/2483] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:35:39 2022] DELETE /identity/v3/users/bc97c34994604750bfac69685e0d9cdd => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:35:39.319505 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e17a0-322f-4936-9973-3e135e82e3fc None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:39.320063 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e17a0-322f-4936-9973-3e135e82e3fc None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:39.320468 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e17a0-322f-4936-9973-3e135e82e3fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:39.343862 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-3f3e17a0-322f-4936-9973-3e135e82e3fc None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:35:39.345434 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-3f3e17a0-322f-4936-9973-3e135e82e3fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:35:39.444274 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1234/2484] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:35:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:35:39.452149 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4368e59b-79e9-4ec2-bc78-2977f468a991 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:35:39.454681 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-4368e59b-79e9-4ec2-bc78-2977f468a991 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:35:39.570058 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4368e59b-79e9-4ec2-bc78-2977f468a991 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:35:39.575133 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be579d91-e925-4904-8f8a-5586a52af81b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:35:39.575930 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be579d91-e925-4904-8f8a-5586a52af81b service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:39.576202 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be579d91-e925-4904-8f8a-5586a52af81b service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:39.576469 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be579d91-e925-4904-8f8a-5586a52af81b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:39.592730 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be579d91-e925-4904-8f8a-5586a52af81b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:35:39.594370 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be579d91-e925-4904-8f8a-5586a52af81b service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:35:39.611470 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1251/2485] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:35:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:35:39.936708 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3e17a0-322f-4936-9973-3e135e82e3fc None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:35:39.938644 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-3f3e17a0-322f-4936-9973-3e135e82e3fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:35:39.956722 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3e17a0-322f-4936-9973-3e135e82e3fc None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:35:39.964338 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab3ff14-34a2-41d4-bee6-6d6c5d16ce97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:35:39.965033 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab3ff14-34a2-41d4-bee6-6d6c5d16ce97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:39.965467 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab3ff14-34a2-41d4-bee6-6d6c5d16ce97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:39.965831 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab3ff14-34a2-41d4-bee6-6d6c5d16ce97 admin admin] PATH_INFO: `/v3/projects/cf9b36a653254a99bd89f86239b74c1c` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:39.967256 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab3ff14-34a2-41d4-bee6-6d6c5d16ce97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf9b36a653254a99bd89f86239b74c1c)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:35:39.978192 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab3ff14-34a2-41d4-bee6-6d6c5d16ce97 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:35:40.035198 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-cab3ff14-34a2-41d4-bee6-6d6c5d16ce97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf9b36a653254a99bd89f86239b74c1c', 'request_id': 'req-cab3ff14-34a2-41d4-bee6-6d6c5d16ce97'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:35:40.046480 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-cab3ff14-34a2-41d4-bee6-6d6c5d16ce97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf9b36a653254a99bd89f86239b74c1c', 'request_id': 'req-cab3ff14-34a2-41d4-bee6-6d6c5d16ce97'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:35:40.053105 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-cab3ff14-34a2-41d4-bee6-6d6c5d16ce97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf9b36a653254a99bd89f86239b74c1c', 'request_id': 'req-cab3ff14-34a2-41d4-bee6-6d6c5d16ce97'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:35:40.054500 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:35:40.071669 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-cab3ff14-34a2-41d4-bee6-6d6c5d16ce97 admin admin] The token cache is being invalidate because project cf9b36a653254a99bd89f86239b74c1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:35:40.072350 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-cab3ff14-34a2-41d4-bee6-6d6c5d16ce97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:35:40.073840 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-cab3ff14-34a2-41d4-bee6-6d6c5d16ce97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:35:40.075343 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1235/2486] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:35:39 2022] DELETE /identity/v3/projects/cf9b36a653254a99bd89f86239b74c1c => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:35:40.079267 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be579d91-e925-4904-8f8a-5586a52af81b service neutron] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:35:40.089804 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be579d91-e925-4904-8f8a-5586a52af81b service neutron] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:35:40.161158 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c684c02a-a11e-4b03-b765-49d3c3785793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:35:40.161868 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684c02a-a11e-4b03-b765-49d3c3785793 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:40.162225 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684c02a-a11e-4b03-b765-49d3c3785793 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:40.162506 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684c02a-a11e-4b03-b765-49d3c3785793 admin admin] PATH_INFO: `/v3/users/bc9530dd90b64195b0b4a59ea4b76b16` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:40.163646 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c684c02a-a11e-4b03-b765-49d3c3785793 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc9530dd90b64195b0b4a59ea4b76b16)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:35:40.166593 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c684c02a-a11e-4b03-b765-49d3c3785793 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:35:40.225656 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-c684c02a-a11e-4b03-b765-49d3c3785793 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc9530dd90b64195b0b4a59ea4b76b16'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:35:40.236504 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-c684c02a-a11e-4b03-b765-49d3c3785793 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc9530dd90b64195b0b4a59ea4b76b16'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:35:40.237155 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-c684c02a-a11e-4b03-b765-49d3c3785793 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc9530dd90b64195b0b4a59ea4b76b16'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:35:40.245491 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-c684c02a-a11e-4b03-b765-49d3c3785793 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc9530dd90b64195b0b4a59ea4b76b16'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:35:40.260593 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-c684c02a-a11e-4b03-b765-49d3c3785793 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc9530dd90b64195b0b4a59ea4b76b16'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:35:40.267462 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1252/2487] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:35:40 2022] DELETE /identity/v3/users/bc9530dd90b64195b0b4a59ea4b76b16 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:35:40.564290 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab3ff14-34a2-41d4-bee6-6d6c5d16ce97 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:35:40.565913 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-cab3ff14-34a2-41d4-bee6-6d6c5d16ce97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:35:40.580803 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab3ff14-34a2-41d4-bee6-6d6c5d16ce97 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:35:40.676231 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae3302f-1cc1-43ec-94db-ea1ea6b14e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:35:40.676886 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae3302f-1cc1-43ec-94db-ea1ea6b14e62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:40.679803 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae3302f-1cc1-43ec-94db-ea1ea6b14e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:40.679803 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae3302f-1cc1-43ec-94db-ea1ea6b14e62 admin admin] PATH_INFO: `/v3/projects/f9bfe2f8391048bd93437f8e25609b3c` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:40.679803 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae3302f-1cc1-43ec-94db-ea1ea6b14e62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9bfe2f8391048bd93437f8e25609b3c)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:35:40.681206 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae3302f-1cc1-43ec-94db-ea1ea6b14e62 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:35:40.771218 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-eae3302f-1cc1-43ec-94db-ea1ea6b14e62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9bfe2f8391048bd93437f8e25609b3c', 'request_id': 'req-eae3302f-1cc1-43ec-94db-ea1ea6b14e62'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:35:40.787720 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-eae3302f-1cc1-43ec-94db-ea1ea6b14e62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9bfe2f8391048bd93437f8e25609b3c', 'request_id': 'req-eae3302f-1cc1-43ec-94db-ea1ea6b14e62'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:35:40.794597 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-eae3302f-1cc1-43ec-94db-ea1ea6b14e62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9bfe2f8391048bd93437f8e25609b3c', 'request_id': 'req-eae3302f-1cc1-43ec-94db-ea1ea6b14e62'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:35:40.817357 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-eae3302f-1cc1-43ec-94db-ea1ea6b14e62 admin admin] The token cache is being invalidate because project f9bfe2f8391048bd93437f8e25609b3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:35:40.817642 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-eae3302f-1cc1-43ec-94db-ea1ea6b14e62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:35:40.818311 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-eae3302f-1cc1-43ec-94db-ea1ea6b14e62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:35:40.819791 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1236/2488] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:35:40 2022] DELETE /identity/v3/projects/f9bfe2f8391048bd93437f8e25609b3c => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:35:40.824870 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052f174-4899-4157-a8a8-f51caf5ed99e None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:40.825381 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052f174-4899-4157-a8a8-f51caf5ed99e None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:40.825523 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052f174-4899-4157-a8a8-f51caf5ed99e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:40.839883 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:35:40.846772 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-b052f174-4899-4157-a8a8-f51caf5ed99e None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:35:40.848018 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-b052f174-4899-4157-a8a8-f51caf5ed99e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:35:40.911103 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1253/2489] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:35:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:35:40.919764 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7426d8b-3687-400e-be67-9a8df15977a6 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:40.920048 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7426d8b-3687-400e-be67-9a8df15977a6 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:40.920323 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7426d8b-3687-400e-be67-9a8df15977a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:40.940161 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-f7426d8b-3687-400e-be67-9a8df15977a6 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:35:40.941367 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f7426d8b-3687-400e-be67-9a8df15977a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:35:40.951950 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1237/2490] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:35:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 01:35:40.958725 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b052f174-4899-4157-a8a8-f51caf5ed99e None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:35:40.974663 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b052f174-4899-4157-a8a8-f51caf5ed99e None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:35:40.980763 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cb83c4-7974-4343-a060-02663c02bc59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:35:40.981390 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb83c4-7974-4343-a060-02663c02bc59 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:40.981667 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb83c4-7974-4343-a060-02663c02bc59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:40.981924 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb83c4-7974-4343-a060-02663c02bc59 admin admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:40.982614 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cb83c4-7974-4343-a060-02663c02bc59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:35:40.982916 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cb83c4-7974-4343-a060-02663c02bc59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:35:40.984908 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cb83c4-7974-4343-a060-02663c02bc59 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:35:40.998695 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1254/2491] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 01:35:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:35:41.003416 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7426d8b-3687-400e-be67-9a8df15977a6 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:35:41.013931 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7426d8b-3687-400e-be67-9a8df15977a6 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:35:41.019077 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52608db9-a2b7-4f25-8c29-00425c8350f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:35:41.019692 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52608db9-a2b7-4f25-8c29-00425c8350f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:41.019965 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52608db9-a2b7-4f25-8c29-00425c8350f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:41.020241 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52608db9-a2b7-4f25-8c29-00425c8350f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:41.020853 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52608db9-a2b7-4f25-8c29-00425c8350f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:35:41.022849 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52608db9-a2b7-4f25-8c29-00425c8350f3 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:35:41.054697 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1238/2492] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:35:41 2022] POST /identity/v3/projects => generated 363 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:35:41.058590 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cb83c4-7974-4343-a060-02663c02bc59 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:35:41.069597 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cb83c4-7974-4343-a060-02663c02bc59 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:35:41.138326 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237b2b91-2473-4eec-8554-a640c477ea10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:35:41.138933 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b2b91-2473-4eec-8554-a640c477ea10 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:41.139209 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b2b91-2473-4eec-8554-a640c477ea10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:41.139483 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b2b91-2473-4eec-8554-a640c477ea10 admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:41.140131 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237b2b91-2473-4eec-8554-a640c477ea10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:35:41.142164 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237b2b91-2473-4eec-8554-a640c477ea10 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:35:41.171399 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1255/2493] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:35:41 2022] POST /identity/v3/users => generated 282 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:35:41.175920 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52608db9-a2b7-4f25-8c29-00425c8350f3 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:35:41.188840 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52608db9-a2b7-4f25-8c29-00425c8350f3 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:35:41.194058 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a2763-9c38-443e-9ed8-ee32f5903006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:35:41.194668 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a2763-9c38-443e-9ed8-ee32f5903006 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:41.194943 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a2763-9c38-443e-9ed8-ee32f5903006 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:41.195207 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a2763-9c38-443e-9ed8-ee32f5903006 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:41.195918 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6a2763-9c38-443e-9ed8-ee32f5903006 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:35:41.197535 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6a2763-9c38-443e-9ed8-ee32f5903006 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:35:41.209460 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1239/2494] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:35:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 01:35:41.213669 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237b2b91-2473-4eec-8554-a640c477ea10 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:35:41.224606 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237b2b91-2473-4eec-8554-a640c477ea10 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:35:41.229648 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3cee39-b390-4eaf-b769-90aa0a484e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:35:41.230314 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3cee39-b390-4eaf-b769-90aa0a484e0a admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:41.230594 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3cee39-b390-4eaf-b769-90aa0a484e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:41.230913 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3cee39-b390-4eaf-b769-90aa0a484e0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:41.231561 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3cee39-b390-4eaf-b769-90aa0a484e0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:35:41.233183 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3cee39-b390-4eaf-b769-90aa0a484e0a admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:35:41.246412 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1256/2495] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:35:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:35:41.251254 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a2763-9c38-443e-9ed8-ee32f5903006 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:35:41.265989 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a2763-9c38-443e-9ed8-ee32f5903006 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:35:41.272090 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0ce270-3332-4d1c-9bea-395b86b570d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:35:41.272924 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0ce270-3332-4d1c-9bea-395b86b570d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:41.273215 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0ce270-3332-4d1c-9bea-395b86b570d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:41.273422 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0ce270-3332-4d1c-9bea-395b86b570d9 admin admin] PATH_INFO: `/v3/projects/d879d3f2ec6e4a19b77a56f75990a0ea/users/4d43462b70fd473f87099d5e4a4b6f94/roles/13af81971c1c428eae0a571a22ea583d` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:41.291567 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0ce270-3332-4d1c-9bea-395b86b570d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d879d3f2ec6e4a19b77a56f75990a0ea, user_id=4d43462b70fd473f87099d5e4a4b6f94, role_id=13af81971c1c428eae0a571a22ea583d)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:35:41.294705 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0ce270-3332-4d1c-9bea-395b86b570d9 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:35:41.322205 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1240/2496] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:35:41 2022] PUT /identity/v3/projects/d879d3f2ec6e4a19b77a56f75990a0ea/users/4d43462b70fd473f87099d5e4a4b6f94/roles/13af81971c1c428eae0a571a22ea583d => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:35:41.325893 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d726a-276e-49a3-bbe7-72d8b71dd573 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:41.326331 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d726a-276e-49a3-bbe7-72d8b71dd573 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:41.326623 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d726a-276e-49a3-bbe7-72d8b71dd573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:41.354064 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-d24d726a-276e-49a3-bbe7-72d8b71dd573 None None] MFA Rules not processed for user `4d43462b70fd473f87099d5e4a4b6f94`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:35:41.355438 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-d24d726a-276e-49a3-bbe7-72d8b71dd573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:35:41.420737 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1257/2497] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:35:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:35:41.425864 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0ce270-3332-4d1c-9bea-395b86b570d9 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:35:41.452511 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:35:41.504708 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0ce270-3332-4d1c-9bea-395b86b570d9 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:35:41.509608 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f6e5b-d5a5-4dfa-9f8a-763fe2c573e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:35:41.510291 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f6e5b-d5a5-4dfa-9f8a-763fe2c573e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:41.510562 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f6e5b-d5a5-4dfa-9f8a-763fe2c573e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:41.510834 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f6e5b-d5a5-4dfa-9f8a-763fe2c573e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:41.511540 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8f6e5b-d5a5-4dfa-9f8a-763fe2c573e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:35:41.513396 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8f6e5b-d5a5-4dfa-9f8a-763fe2c573e9 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:35:41.544526 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1241/2498] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:35:41 2022] POST /identity/v3/projects => generated 365 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 01:35:41.548571 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24d726a-276e-49a3-bbe7-72d8b71dd573 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:35:41.554022 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:35:41.560722 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24d726a-276e-49a3-bbe7-72d8b71dd573 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:35:41.619784 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a20418e-4fd6-421e-b610-6bcbbc9f6be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:35:41.620756 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20418e-4fd6-421e-b610-6bcbbc9f6be1 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:41.621109 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20418e-4fd6-421e-b610-6bcbbc9f6be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:41.621415 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20418e-4fd6-421e-b610-6bcbbc9f6be1 admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:41.622143 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a20418e-4fd6-421e-b610-6bcbbc9f6be1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:35:41.624229 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a20418e-4fd6-421e-b610-6bcbbc9f6be1 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:35:41.650509 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1258/2499] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:35:41 2022] POST /identity/v3/users => generated 289 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:35:41.652027 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f6e5b-d5a5-4dfa-9f8a-763fe2c573e9 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:35:41.663653 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f6e5b-d5a5-4dfa-9f8a-763fe2c573e9 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:35:41.668872 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2336b7-e059-43d7-8e54-9eae82be6eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:35:41.669531 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2336b7-e059-43d7-8e54-9eae82be6eff admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:41.669803 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2336b7-e059-43d7-8e54-9eae82be6eff admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:41.670068 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2336b7-e059-43d7-8e54-9eae82be6eff admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:41.670740 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2336b7-e059-43d7-8e54-9eae82be6eff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:35:41.672997 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2336b7-e059-43d7-8e54-9eae82be6eff admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:35:41.685555 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1242/2500] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:35:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:35:41.690174 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a20418e-4fd6-421e-b610-6bcbbc9f6be1 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:35:41.702069 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a20418e-4fd6-421e-b610-6bcbbc9f6be1 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:35:41.707699 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c04e694-34ad-4383-9887-f23102369cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:35:41.708442 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04e694-34ad-4383-9887-f23102369cd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:41.709064 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04e694-34ad-4383-9887-f23102369cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:41.709466 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04e694-34ad-4383-9887-f23102369cd4 admin admin] PATH_INFO: `/v3/projects/4aff9bac5a8740e4b59bedf4a25bb241/users/26df74b8927f4d749051be0c5e5ec91d/roles/fb48693810be495fb4b1893a79429b78` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:41.725518 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c04e694-34ad-4383-9887-f23102369cd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4aff9bac5a8740e4b59bedf4a25bb241, user_id=26df74b8927f4d749051be0c5e5ec91d, role_id=fb48693810be495fb4b1893a79429b78)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:35:41.728201 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c04e694-34ad-4383-9887-f23102369cd4 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:35:41.743661 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1259/2501] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:35:41 2022] PUT /identity/v3/projects/4aff9bac5a8740e4b59bedf4a25bb241/users/26df74b8927f4d749051be0c5e5ec91d/roles/fb48693810be495fb4b1893a79429b78 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 01:35:41.748279 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2336b7-e059-43d7-8e54-9eae82be6eff admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:35:41.759133 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2336b7-e059-43d7-8e54-9eae82be6eff admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:35:41.822271 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d115ecf4-d683-49db-a647-52e53a1ad05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:35:41.823027 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d115ecf4-d683-49db-a647-52e53a1ad05d admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:41.823362 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d115ecf4-d683-49db-a647-52e53a1ad05d admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:41.823951 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d115ecf4-d683-49db-a647-52e53a1ad05d admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:41.824528 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d115ecf4-d683-49db-a647-52e53a1ad05d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:35:41.826239 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d115ecf4-d683-49db-a647-52e53a1ad05d admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:35:41.844140 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c04e694-34ad-4383-9887-f23102369cd4 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:35:41.845253 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1243/2502] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:35:41 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:35:41.855339 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c04e694-34ad-4383-9887-f23102369cd4 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:35:41.860124 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac995126-decf-42e7-bff5-59335ec19b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:35:41.860866 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac995126-decf-42e7-bff5-59335ec19b30 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:41.861265 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac995126-decf-42e7-bff5-59335ec19b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:41.861599 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac995126-decf-42e7-bff5-59335ec19b30 admin admin] PATH_INFO: `/v3/projects/4aff9bac5a8740e4b59bedf4a25bb241/users/26df74b8927f4d749051be0c5e5ec91d/roles/fb48693810be495fb4b1893a79429b78` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:41.863794 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac995126-decf-42e7-bff5-59335ec19b30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4aff9bac5a8740e4b59bedf4a25bb241, user_id=26df74b8927f4d749051be0c5e5ec91d, role_id=fb48693810be495fb4b1893a79429b78)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:35:41.866538 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac995126-decf-42e7-bff5-59335ec19b30 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:35:41.889826 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1260/2503] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:35:41 2022] PUT /identity/v3/projects/4aff9bac5a8740e4b59bedf4a25bb241/users/26df74b8927f4d749051be0c5e5ec91d/roles/fb48693810be495fb4b1893a79429b78 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 01:35:41.891430 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137cdc93-846d-43e6-8d96-c97eec37a9ab None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:41.891904 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137cdc93-846d-43e6-8d96-c97eec37a9ab None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:41.892247 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137cdc93-846d-43e6-8d96-c97eec37a9ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:41.932459 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-137cdc93-846d-43e6-8d96-c97eec37a9ab None None] MFA Rules not processed for user `26df74b8927f4d749051be0c5e5ec91d`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:35:41.934228 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-137cdc93-846d-43e6-8d96-c97eec37a9ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:35:42.024114 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1244/2504] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:35:41 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 01:35:42.036743 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac995126-decf-42e7-bff5-59335ec19b30 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:35:42.038576 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-ac995126-decf-42e7-bff5-59335ec19b30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:35:42.103659 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac995126-decf-42e7-bff5-59335ec19b30 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:35:42.107380 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0aa656-c25b-4fcc-a998-ff9af9f156e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7853d40c29af424c8d7913950d89750b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:35:42.107999 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0aa656-c25b-4fcc-a998-ff9af9f156e8 service cinder] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:42.108280 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0aa656-c25b-4fcc-a998-ff9af9f156e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:42.108552 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0aa656-c25b-4fcc-a998-ff9af9f156e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:42.118235 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0aa656-c25b-4fcc-a998-ff9af9f156e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:35:42.119792 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0aa656-c25b-4fcc-a998-ff9af9f156e8 service cinder] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:35:42.129789 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1261/2505] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:35:42 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:35:42.628772 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137cdc93-846d-43e6-8d96-c97eec37a9ab None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:35:42.654523 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:35:42.705188 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137cdc93-846d-43e6-8d96-c97eec37a9ab None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:35:42.709542 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356c4050-2038-4e28-8c95-8f6dbf9f75a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:35:42.710222 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c4050-2038-4e28-8c95-8f6dbf9f75a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:42.710496 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c4050-2038-4e28-8c95-8f6dbf9f75a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:42.710773 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c4050-2038-4e28-8c95-8f6dbf9f75a6 admin admin] PATH_INFO: `/v3/users/4d43462b70fd473f87099d5e4a4b6f94` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:42.711924 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356c4050-2038-4e28-8c95-8f6dbf9f75a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d43462b70fd473f87099d5e4a4b6f94)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:35:42.713944 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356c4050-2038-4e28-8c95-8f6dbf9f75a6 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:35:42.773543 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-356c4050-2038-4e28-8c95-8f6dbf9f75a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d43462b70fd473f87099d5e4a4b6f94'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:35:42.782460 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-356c4050-2038-4e28-8c95-8f6dbf9f75a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d43462b70fd473f87099d5e4a4b6f94'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:35:42.783156 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-356c4050-2038-4e28-8c95-8f6dbf9f75a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d43462b70fd473f87099d5e4a4b6f94'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:35:42.791958 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-356c4050-2038-4e28-8c95-8f6dbf9f75a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d43462b70fd473f87099d5e4a4b6f94'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:35:42.805027 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-356c4050-2038-4e28-8c95-8f6dbf9f75a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d43462b70fd473f87099d5e4a4b6f94'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:35:42.811592 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1245/2506] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:35:42 2022] DELETE /identity/v3/users/4d43462b70fd473f87099d5e4a4b6f94 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:35:42.816426 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08cc304-de33-45e3-b5e1-0fef465af740 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:42.816942 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08cc304-de33-45e3-b5e1-0fef465af740 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:42.817216 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08cc304-de33-45e3-b5e1-0fef465af740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:42.836696 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-e08cc304-de33-45e3-b5e1-0fef465af740 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:35:42.838011 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-e08cc304-de33-45e3-b5e1-0fef465af740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:35:42.890048 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:35:42.910017 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1262/2507] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:35:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 01:35:42.910859 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356c4050-2038-4e28-8c95-8f6dbf9f75a6 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:35:42.913864 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-356c4050-2038-4e28-8c95-8f6dbf9f75a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:35:42.978265 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356c4050-2038-4e28-8c95-8f6dbf9f75a6 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:35:42.982210 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f51f0-27f6-46e4-b5ae-c52d25de805e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:35:42.982853 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f51f0-27f6-46e4-b5ae-c52d25de805e service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:42.983127 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f51f0-27f6-46e4-b5ae-c52d25de805e service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:42.983394 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f51f0-27f6-46e4-b5ae-c52d25de805e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:42.995782 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5f51f0-27f6-46e4-b5ae-c52d25de805e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:35:42.997755 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5f51f0-27f6-46e4-b5ae-c52d25de805e service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:35:43.008161 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1246/2508] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:35:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 01:35:43.390033 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08cc304-de33-45e3-b5e1-0fef465af740 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:35:43.391724 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-e08cc304-de33-45e3-b5e1-0fef465af740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:35:43.404939 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08cc304-de33-45e3-b5e1-0fef465af740 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:35:43.410543 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1893999e-5c00-451a-99bb-7ffebebd8c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:35:43.411425 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1893999e-5c00-451a-99bb-7ffebebd8c96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:43.411707 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1893999e-5c00-451a-99bb-7ffebebd8c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:43.412005 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1893999e-5c00-451a-99bb-7ffebebd8c96 admin admin] PATH_INFO: `/v3/projects/d879d3f2ec6e4a19b77a56f75990a0ea` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:43.413230 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1893999e-5c00-451a-99bb-7ffebebd8c96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d879d3f2ec6e4a19b77a56f75990a0ea)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:35:43.415296 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1893999e-5c00-451a-99bb-7ffebebd8c96 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:35:43.511768 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-1893999e-5c00-451a-99bb-7ffebebd8c96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd879d3f2ec6e4a19b77a56f75990a0ea', 'request_id': 'req-1893999e-5c00-451a-99bb-7ffebebd8c96'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:35:43.518933 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-1893999e-5c00-451a-99bb-7ffebebd8c96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd879d3f2ec6e4a19b77a56f75990a0ea', 'request_id': 'req-1893999e-5c00-451a-99bb-7ffebebd8c96'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:35:43.531191 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-1893999e-5c00-451a-99bb-7ffebebd8c96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd879d3f2ec6e4a19b77a56f75990a0ea', 'request_id': 'req-1893999e-5c00-451a-99bb-7ffebebd8c96'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:35:43.559139 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-1893999e-5c00-451a-99bb-7ffebebd8c96 admin admin] The token cache is being invalidate because project d879d3f2ec6e4a19b77a56f75990a0ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:35:43.560224 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-1893999e-5c00-451a-99bb-7ffebebd8c96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:35:43.560941 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-1893999e-5c00-451a-99bb-7ffebebd8c96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:35:43.562535 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1263/2509] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:35:43 2022] DELETE /identity/v3/projects/d879d3f2ec6e4a19b77a56f75990a0ea => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:35:43.566627 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f51f0-27f6-46e4-b5ae-c52d25de805e service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:35:43.577129 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f51f0-27f6-46e4-b5ae-c52d25de805e service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:35:43.613190 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:35:43.639833 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb098f61-258d-437b-be08-96165e117cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:35:43.640669 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb098f61-258d-437b-be08-96165e117cf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:43.641043 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb098f61-258d-437b-be08-96165e117cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:43.641511 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb098f61-258d-437b-be08-96165e117cf9 admin admin] PATH_INFO: `/v3/users/26df74b8927f4d749051be0c5e5ec91d` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:43.642782 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb098f61-258d-437b-be08-96165e117cf9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26df74b8927f4d749051be0c5e5ec91d)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:35:43.644820 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb098f61-258d-437b-be08-96165e117cf9 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:35:43.701933 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-cb098f61-258d-437b-be08-96165e117cf9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26df74b8927f4d749051be0c5e5ec91d'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:35:43.711585 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-cb098f61-258d-437b-be08-96165e117cf9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26df74b8927f4d749051be0c5e5ec91d'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:35:43.712228 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-cb098f61-258d-437b-be08-96165e117cf9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26df74b8927f4d749051be0c5e5ec91d'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:35:43.719997 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-cb098f61-258d-437b-be08-96165e117cf9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26df74b8927f4d749051be0c5e5ec91d'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:35:43.734209 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-cb098f61-258d-437b-be08-96165e117cf9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26df74b8927f4d749051be0c5e5ec91d'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:35:43.740696 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1247/2510] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:35:43 2022] DELETE /identity/v3/users/26df74b8927f4d749051be0c5e5ec91d => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:35:44.047977 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1893999e-5c00-451a-99bb-7ffebebd8c96 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:35:44.049533 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-1893999e-5c00-451a-99bb-7ffebebd8c96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:35:44.075917 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1893999e-5c00-451a-99bb-7ffebebd8c96 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:35:44.145300 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d24c6-3251-4a79-90ee-2730381b0068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:35:44.146087 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d24c6-3251-4a79-90ee-2730381b0068 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:44.146391 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d24c6-3251-4a79-90ee-2730381b0068 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:44.146663 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d24c6-3251-4a79-90ee-2730381b0068 admin admin] PATH_INFO: `/v3/projects/4aff9bac5a8740e4b59bedf4a25bb241` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:44.147821 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15d24c6-3251-4a79-90ee-2730381b0068 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4aff9bac5a8740e4b59bedf4a25bb241)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:35:44.149702 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15d24c6-3251-4a79-90ee-2730381b0068 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:35:44.204584 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-b15d24c6-3251-4a79-90ee-2730381b0068 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4aff9bac5a8740e4b59bedf4a25bb241', 'request_id': 'req-b15d24c6-3251-4a79-90ee-2730381b0068'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:35:44.211046 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-b15d24c6-3251-4a79-90ee-2730381b0068 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4aff9bac5a8740e4b59bedf4a25bb241', 'request_id': 'req-b15d24c6-3251-4a79-90ee-2730381b0068'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:35:44.217573 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-b15d24c6-3251-4a79-90ee-2730381b0068 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4aff9bac5a8740e4b59bedf4a25bb241', 'request_id': 'req-b15d24c6-3251-4a79-90ee-2730381b0068'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:35:44.233090 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-b15d24c6-3251-4a79-90ee-2730381b0068 admin admin] The token cache is being invalidate because project 4aff9bac5a8740e4b59bedf4a25bb241 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:35:44.233647 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-b15d24c6-3251-4a79-90ee-2730381b0068 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:35:44.234523 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-b15d24c6-3251-4a79-90ee-2730381b0068 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:35:44.236427 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1264/2511] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:35:44 2022] DELETE /identity/v3/projects/4aff9bac5a8740e4b59bedf4a25bb241 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:35:44.241378 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c127e66b-ef4a-40f8-a466-b8cfdcbd1daa None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:44.241775 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c127e66b-ef4a-40f8-a466-b8cfdcbd1daa None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:44.242194 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c127e66b-ef4a-40f8-a466-b8cfdcbd1daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:44.269691 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-c127e66b-ef4a-40f8-a466-b8cfdcbd1daa None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:35:44.271114 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c127e66b-ef4a-40f8-a466-b8cfdcbd1daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:35:44.355514 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1248/2512] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:35:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 01:35:44.363293 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98555b8-4a71-4b3c-a5bd-96ad49bb3d8f None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:44.363580 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98555b8-4a71-4b3c-a5bd-96ad49bb3d8f None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:44.363861 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98555b8-4a71-4b3c-a5bd-96ad49bb3d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:44.387716 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-e98555b8-4a71-4b3c-a5bd-96ad49bb3d8f None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:35:44.389050 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-e98555b8-4a71-4b3c-a5bd-96ad49bb3d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:35:44.397381 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1265/2513] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:35:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 01:35:44.401819 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c127e66b-ef4a-40f8-a466-b8cfdcbd1daa None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:35:44.415623 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c127e66b-ef4a-40f8-a466-b8cfdcbd1daa None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:35:44.433853 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7894bbd-8343-466c-8437-4cada99246ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:35:44.438485 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7894bbd-8343-466c-8437-4cada99246ee admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:44.438785 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7894bbd-8343-466c-8437-4cada99246ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:44.439058 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7894bbd-8343-466c-8437-4cada99246ee admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:44.439761 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7894bbd-8343-466c-8437-4cada99246ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:35:44.440052 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7894bbd-8343-466c-8437-4cada99246ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:35:44.441697 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7894bbd-8343-466c-8437-4cada99246ee admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:35:44.455137 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1249/2514] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 01:35:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:35:44.459454 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98555b8-4a71-4b3c-a5bd-96ad49bb3d8f None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:35:44.465961 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:35:44.473095 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98555b8-4a71-4b3c-a5bd-96ad49bb3d8f None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:35:44.485352 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabbee6f-43d8-4489-ab95-171bb5aad29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:35:44.485998 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabbee6f-43d8-4489-ab95-171bb5aad29e admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:44.486299 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabbee6f-43d8-4489-ab95-171bb5aad29e admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:44.486564 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabbee6f-43d8-4489-ab95-171bb5aad29e admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:44.487215 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabbee6f-43d8-4489-ab95-171bb5aad29e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:35:44.489211 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabbee6f-43d8-4489-ab95-171bb5aad29e admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:35:44.523276 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1266/2515] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:35:44 2022] POST /identity/v3/projects => generated 375 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:35:44.527846 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7894bbd-8343-466c-8437-4cada99246ee admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:35:44.539926 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7894bbd-8343-466c-8437-4cada99246ee admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:35:44.589562 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:35:44.606354 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e7db04-0f5d-404d-9595-c8c22c83331c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:35:44.606975 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7db04-0f5d-404d-9595-c8c22c83331c admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:44.607248 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7db04-0f5d-404d-9595-c8c22c83331c admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:44.607515 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7db04-0f5d-404d-9595-c8c22c83331c admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:44.608151 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e7db04-0f5d-404d-9595-c8c22c83331c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:35:44.610140 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e7db04-0f5d-404d-9595-c8c22c83331c admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:35:44.633538 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1250/2516] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:35:44 2022] POST /identity/v3/users => generated 288 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:35:44.637768 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabbee6f-43d8-4489-ab95-171bb5aad29e admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:35:44.648564 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabbee6f-43d8-4489-ab95-171bb5aad29e admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:35:44.653575 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf59c96-97b7-4dad-8c5e-e13fe54d50cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:35:44.654228 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf59c96-97b7-4dad-8c5e-e13fe54d50cf admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:44.654501 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf59c96-97b7-4dad-8c5e-e13fe54d50cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:44.654767 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf59c96-97b7-4dad-8c5e-e13fe54d50cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:44.655419 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf59c96-97b7-4dad-8c5e-e13fe54d50cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:35:44.657007 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf59c96-97b7-4dad-8c5e-e13fe54d50cf admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:35:44.670146 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1267/2517] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:35:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:35:44.672335 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e7db04-0f5d-404d-9595-c8c22c83331c admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:35:44.682831 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e7db04-0f5d-404d-9595-c8c22c83331c admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:35:44.692311 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff1faf9-e761-46d0-ac66-4efa4b1a4034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:35:44.692933 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1faf9-e761-46d0-ac66-4efa4b1a4034 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:44.693203 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1faf9-e761-46d0-ac66-4efa4b1a4034 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:44.693466 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1faf9-e761-46d0-ac66-4efa4b1a4034 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:44.694159 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff1faf9-e761-46d0-ac66-4efa4b1a4034 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:35:44.695784 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff1faf9-e761-46d0-ac66-4efa4b1a4034 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:35:44.710435 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1251/2518] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:35:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:35:44.712315 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf59c96-97b7-4dad-8c5e-e13fe54d50cf admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:35:44.723257 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf59c96-97b7-4dad-8c5e-e13fe54d50cf admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:35:44.730481 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5f18f1-6c9d-4bc9-a68e-c9d0a85fd969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:35:44.731250 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f18f1-6c9d-4bc9-a68e-c9d0a85fd969 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:44.731529 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f18f1-6c9d-4bc9-a68e-c9d0a85fd969 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:44.731824 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f18f1-6c9d-4bc9-a68e-c9d0a85fd969 admin admin] PATH_INFO: `/v3/projects/0d6913627b7e4724a11be4649d098c48/users/890b86a83f4442a9bbe68b54910c1b8a/roles/13af81971c1c428eae0a571a22ea583d` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:44.748479 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5f18f1-6c9d-4bc9-a68e-c9d0a85fd969 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d6913627b7e4724a11be4649d098c48, user_id=890b86a83f4442a9bbe68b54910c1b8a, role_id=13af81971c1c428eae0a571a22ea583d)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:35:44.751330 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5f18f1-6c9d-4bc9-a68e-c9d0a85fd969 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:35:44.776488 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1268/2519] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:35:44 2022] PUT /identity/v3/projects/0d6913627b7e4724a11be4649d098c48/users/890b86a83f4442a9bbe68b54910c1b8a/roles/13af81971c1c428eae0a571a22ea583d => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 01:35:44.788183 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9cfb57-59b3-43fc-ac58-8845c778962d None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:44.788577 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9cfb57-59b3-43fc-ac58-8845c778962d None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:44.788906 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9cfb57-59b3-43fc-ac58-8845c778962d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:44.820945 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-5a9cfb57-59b3-43fc-ac58-8845c778962d None None] MFA Rules not processed for user `890b86a83f4442a9bbe68b54910c1b8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:35:44.822639 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-5a9cfb57-59b3-43fc-ac58-8845c778962d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:35:44.898085 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1252/2520] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:35:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:35:44.903081 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5f18f1-6c9d-4bc9-a68e-c9d0a85fd969 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:35:44.974041 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5f18f1-6c9d-4bc9-a68e-c9d0a85fd969 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:35:44.979114 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc35da-89ab-49c8-b338-75590cad9c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:35:44.979822 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc35da-89ab-49c8-b338-75590cad9c00 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:44.980175 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc35da-89ab-49c8-b338-75590cad9c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:44.980508 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc35da-89ab-49c8-b338-75590cad9c00 admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:44.981250 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecc35da-89ab-49c8-b338-75590cad9c00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:35:44.983353 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecc35da-89ab-49c8-b338-75590cad9c00 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:35:45.013879 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1269/2521] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:35:44 2022] POST /identity/v3/projects => generated 377 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:35:45.018089 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9cfb57-59b3-43fc-ac58-8845c778962d None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:35:45.030334 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9cfb57-59b3-43fc-ac58-8845c778962d None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:35:45.098501 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1976d3b7-b581-413d-b678-2b5fa0b86f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:35:45.099144 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1976d3b7-b581-413d-b678-2b5fa0b86f97 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:45.099413 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1976d3b7-b581-413d-b678-2b5fa0b86f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:45.099676 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1976d3b7-b581-413d-b678-2b5fa0b86f97 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:45.100293 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1976d3b7-b581-413d-b678-2b5fa0b86f97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:35:45.102406 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1976d3b7-b581-413d-b678-2b5fa0b86f97 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:35:45.128472 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1253/2522] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:35:45 2022] POST /identity/v3/users => generated 295 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:35:45.129650 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc35da-89ab-49c8-b338-75590cad9c00 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:35:45.140824 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc35da-89ab-49c8-b338-75590cad9c00 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:35:45.145593 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b384a65e-1899-4aee-bf4c-2fc55af14d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:35:45.146229 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b384a65e-1899-4aee-bf4c-2fc55af14d35 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:45.146528 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b384a65e-1899-4aee-bf4c-2fc55af14d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:45.146830 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b384a65e-1899-4aee-bf4c-2fc55af14d35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:45.147431 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b384a65e-1899-4aee-bf4c-2fc55af14d35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:35:45.149047 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b384a65e-1899-4aee-bf4c-2fc55af14d35 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:35:45.160526 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1270/2523] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:35:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:35:45.164775 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1976d3b7-b581-413d-b678-2b5fa0b86f97 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:35:45.175104 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1976d3b7-b581-413d-b678-2b5fa0b86f97 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:35:45.179594 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e361aaf-0d48-45f0-86e6-f67bfce422b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:35:45.180236 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e361aaf-0d48-45f0-86e6-f67bfce422b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:45.180593 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e361aaf-0d48-45f0-86e6-f67bfce422b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:45.180863 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e361aaf-0d48-45f0-86e6-f67bfce422b7 admin admin] PATH_INFO: `/v3/projects/b91d2196647548b780df118dd8e598df/users/acb0b294dd464c21af79ccf7a1f297dc/roles/fb48693810be495fb4b1893a79429b78` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:45.201963 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e361aaf-0d48-45f0-86e6-f67bfce422b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b91d2196647548b780df118dd8e598df, user_id=acb0b294dd464c21af79ccf7a1f297dc, role_id=fb48693810be495fb4b1893a79429b78)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:35:45.204834 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e361aaf-0d48-45f0-86e6-f67bfce422b7 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:35:45.220329 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1254/2524] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:35:45 2022] PUT /identity/v3/projects/b91d2196647548b780df118dd8e598df/users/acb0b294dd464c21af79ccf7a1f297dc/roles/fb48693810be495fb4b1893a79429b78 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:35:45.224561 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b384a65e-1899-4aee-bf4c-2fc55af14d35 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:35:45.235328 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b384a65e-1899-4aee-bf4c-2fc55af14d35 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:35:45.312270 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f76d31-af4d-48dd-8329-210b112ea82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:35:45.313139 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f76d31-af4d-48dd-8329-210b112ea82e admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:45.313459 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f76d31-af4d-48dd-8329-210b112ea82e admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:45.313888 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f76d31-af4d-48dd-8329-210b112ea82e admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:45.314679 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f76d31-af4d-48dd-8329-210b112ea82e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:35:45.316400 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f76d31-af4d-48dd-8329-210b112ea82e admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:35:45.327729 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1271/2525] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:35:45 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:35:45.332278 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e361aaf-0d48-45f0-86e6-f67bfce422b7 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:35:45.342916 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e361aaf-0d48-45f0-86e6-f67bfce422b7 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:35:45.347456 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e043d0fe-7d27-461b-8576-ad44870d5c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:35:45.348113 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e043d0fe-7d27-461b-8576-ad44870d5c97 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:45.348382 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e043d0fe-7d27-461b-8576-ad44870d5c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:45.348644 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e043d0fe-7d27-461b-8576-ad44870d5c97 admin admin] PATH_INFO: `/v3/projects/b91d2196647548b780df118dd8e598df/users/acb0b294dd464c21af79ccf7a1f297dc/roles/fb48693810be495fb4b1893a79429b78` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:45.350587 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e043d0fe-7d27-461b-8576-ad44870d5c97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b91d2196647548b780df118dd8e598df, user_id=acb0b294dd464c21af79ccf7a1f297dc, role_id=fb48693810be495fb4b1893a79429b78)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:35:45.353183 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e043d0fe-7d27-461b-8576-ad44870d5c97 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:35:45.364215 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1255/2526] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:35:45 2022] PUT /identity/v3/projects/b91d2196647548b780df118dd8e598df/users/acb0b294dd464c21af79ccf7a1f297dc/roles/fb48693810be495fb4b1893a79429b78 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:35:45.374305 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c71d4d-ff00-420a-9e40-a1b9a2e7ae98 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:45.374563 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c71d4d-ff00-420a-9e40-a1b9a2e7ae98 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:45.374863 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c71d4d-ff00-420a-9e40-a1b9a2e7ae98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:45.406474 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-07c71d4d-ff00-420a-9e40-a1b9a2e7ae98 None None] MFA Rules not processed for user `acb0b294dd464c21af79ccf7a1f297dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:35:45.407618 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-07c71d4d-ff00-420a-9e40-a1b9a2e7ae98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:35:45.412813 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:35:45.480061 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1272/2527] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:35:45 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:35:45.491374 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e043d0fe-7d27-461b-8576-ad44870d5c97 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:35:45.493308 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-e043d0fe-7d27-461b-8576-ad44870d5c97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:35:45.500058 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:35:45.567828 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e043d0fe-7d27-461b-8576-ad44870d5c97 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:35:45.571769 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307cafa1-5c34-411e-8e87-7c179eb3d925 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7853d40c29af424c8d7913950d89750b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:35:45.572950 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307cafa1-5c34-411e-8e87-7c179eb3d925 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:45.573393 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307cafa1-5c34-411e-8e87-7c179eb3d925 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:45.573826 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307cafa1-5c34-411e-8e87-7c179eb3d925 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:45.647178 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307cafa1-5c34-411e-8e87-7c179eb3d925 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:35:45.649098 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307cafa1-5c34-411e-8e87-7c179eb3d925 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:35:45.662167 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1256/2528] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:35:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:35:48.322711 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c71d4d-ff00-420a-9e40-a1b9a2e7ae98 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:35:48.332831 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c71d4d-ff00-420a-9e40-a1b9a2e7ae98 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:35:48.337066 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7dc75a-fab3-4321-984b-7983f0f54dd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7853d40c29af424c8d7913950d89750b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:35:48.337815 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7dc75a-fab3-4321-984b-7983f0f54dd8 service cinder] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:48.338370 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7dc75a-fab3-4321-984b-7983f0f54dd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:48.338370 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7dc75a-fab3-4321-984b-7983f0f54dd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:48.347520 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7dc75a-fab3-4321-984b-7983f0f54dd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:35:48.348936 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7dc75a-fab3-4321-984b-7983f0f54dd8 service cinder] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:35:48.358574 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1273/2529] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:35:48 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 01:35:52.841699 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307cafa1-5c34-411e-8e87-7c179eb3d925 service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:35:52.843388 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-307cafa1-5c34-411e-8e87-7c179eb3d925 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:35:52.918379 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307cafa1-5c34-411e-8e87-7c179eb3d925 service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:35:52.923942 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257c2eb5-5b14-4cfe-b9f3-090e16afeafa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd5e95467b44175be2478c2c7c89926', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:35:52.924557 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c2eb5-5b14-4cfe-b9f3-090e16afeafa service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:52.924833 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c2eb5-5b14-4cfe-b9f3-090e16afeafa service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:52.925103 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c2eb5-5b14-4cfe-b9f3-090e16afeafa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:52.926872 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-257c2eb5-5b14-4cfe-b9f3-090e16afeafa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:35:52.984415 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:35:52.988028 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257c2eb5-5b14-4cfe-b9f3-090e16afeafa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:35:52.990107 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257c2eb5-5b14-4cfe-b9f3-090e16afeafa service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:35:52.999847 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1257/2530] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:35:52 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:35:53.068436 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7dc75a-fab3-4321-984b-7983f0f54dd8 service cinder] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:35:53.069876 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-0a7dc75a-fab3-4321-984b-7983f0f54dd8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:35:53.085874 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7dc75a-fab3-4321-984b-7983f0f54dd8 service cinder] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:35:53.092472 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af3092-a6f8-4a59-b818-95b16be0ee29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd5e95467b44175be2478c2c7c89926', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:35:53.093161 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af3092-a6f8-4a59-b818-95b16be0ee29 service nova] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:53.093443 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af3092-a6f8-4a59-b818-95b16be0ee29 service nova] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:53.093713 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af3092-a6f8-4a59-b818-95b16be0ee29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:53.095826 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-e3af3092-a6f8-4a59-b818-95b16be0ee29 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:35:53.109572 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3af3092-a6f8-4a59-b818-95b16be0ee29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:35:53.111358 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3af3092-a6f8-4a59-b818-95b16be0ee29 service nova] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:35:53.122535 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1274/2531] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:35:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:35:54.655655 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3e1d2-9e12-4ac9-a179-68cc5914d180 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:54.656163 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3e1d2-9e12-4ac9-a179-68cc5914d180 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:54.656285 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3e1d2-9e12-4ac9-a179-68cc5914d180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:54.681938 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-eee3e1d2-9e12-4ac9-a179-68cc5914d180 None None] MFA Rules not processed for user `f3643631cf2d4a9592d465bdeba99669`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:35:54.683931 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-eee3e1d2-9e12-4ac9-a179-68cc5914d180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:35:54.746449 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1258/2532] 10.222.0.26 () {58 vars in 967 bytes} [Fri Aug 12 01:35:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:35:54.759711 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af3092-a6f8-4a59-b818-95b16be0ee29 service nova] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:35:54.761987 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-e3af3092-a6f8-4a59-b818-95b16be0ee29 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:35:54.849937 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af3092-a6f8-4a59-b818-95b16be0ee29 service nova] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:35:54.855064 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541c0105-9a08-4a49-9a82-b069aaa89efd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32c1ba237f864b5d9699cb817e42e647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:35:54.855690 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c0105-9a08-4a49-9a82-b069aaa89efd service swift] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:35:54.855962 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c0105-9a08-4a49-9a82-b069aaa89efd service swift] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:35:54.856227 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c0105-9a08-4a49-9a82-b069aaa89efd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:35:54.864942 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541c0105-9a08-4a49-9a82-b069aaa89efd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:35:54.866570 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541c0105-9a08-4a49-9a82-b069aaa89efd service swift] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:35:54.875015 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1275/2533] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Aug 12 01:35:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 12 01:36:01.051923 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee3e1d2-9e12-4ac9-a179-68cc5914d180 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:01.117362 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee3e1d2-9e12-4ac9-a179-68cc5914d180 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:01.122106 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e5f2e9-6b80-4e7a-bc50-925ddaf05fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:01.123246 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5f2e9-6b80-4e7a-bc50-925ddaf05fe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:01.123520 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5f2e9-6b80-4e7a-bc50-925ddaf05fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:01.123788 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5f2e9-6b80-4e7a-bc50-925ddaf05fe3 admin admin] PATH_INFO: `/v3/users/890b86a83f4442a9bbe68b54910c1b8a` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:01.124944 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e5f2e9-6b80-4e7a-bc50-925ddaf05fe3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=890b86a83f4442a9bbe68b54910c1b8a)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:01.126899 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e5f2e9-6b80-4e7a-bc50-925ddaf05fe3 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:01.176238 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-e2e5f2e9-6b80-4e7a-bc50-925ddaf05fe3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '890b86a83f4442a9bbe68b54910c1b8a'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:01.184968 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-e2e5f2e9-6b80-4e7a-bc50-925ddaf05fe3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '890b86a83f4442a9bbe68b54910c1b8a'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:01.185679 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-e2e5f2e9-6b80-4e7a-bc50-925ddaf05fe3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '890b86a83f4442a9bbe68b54910c1b8a'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:01.193358 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-e2e5f2e9-6b80-4e7a-bc50-925ddaf05fe3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '890b86a83f4442a9bbe68b54910c1b8a'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:01.205633 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-e2e5f2e9-6b80-4e7a-bc50-925ddaf05fe3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '890b86a83f4442a9bbe68b54910c1b8a'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:01.211507 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1259/2534] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:36:01 2022] DELETE /identity/v3/users/890b86a83f4442a9bbe68b54910c1b8a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:36:01.216745 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4070a-7b24-444a-a677-3a5ca7170cf9 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:01.217268 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4070a-7b24-444a-a677-3a5ca7170cf9 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:01.217372 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4070a-7b24-444a-a677-3a5ca7170cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:01.236870 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-07b4070a-7b24-444a-a677-3a5ca7170cf9 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:36:01.238053 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-07b4070a-7b24-444a-a677-3a5ca7170cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:01.299197 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1276/2535] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:36:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 01:36:01.310424 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e5f2e9-6b80-4e7a-bc50-925ddaf05fe3 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:01.312267 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-e2e5f2e9-6b80-4e7a-bc50-925ddaf05fe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:01.335773 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:36:01.377569 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e5f2e9-6b80-4e7a-bc50-925ddaf05fe3 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:01.381392 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6437825e-f383-40d5-b814-c8c8626b68e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:01.381997 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6437825e-f383-40d5-b814-c8c8626b68e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:01.382297 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6437825e-f383-40d5-b814-c8c8626b68e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:01.382559 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6437825e-f383-40d5-b814-c8c8626b68e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:01.391968 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6437825e-f383-40d5-b814-c8c8626b68e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:01.393366 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6437825e-f383-40d5-b814-c8c8626b68e8 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:01.403199 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1260/2536] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:36:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:36:01.770558 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b4070a-7b24-444a-a677-3a5ca7170cf9 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:01.772008 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-07b4070a-7b24-444a-a677-3a5ca7170cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:01.794981 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b4070a-7b24-444a-a677-3a5ca7170cf9 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:01.800491 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20413031-a820-44cb-86d4-0757106c891d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:01.801276 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20413031-a820-44cb-86d4-0757106c891d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:01.801694 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20413031-a820-44cb-86d4-0757106c891d admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:01.802035 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20413031-a820-44cb-86d4-0757106c891d admin admin] PATH_INFO: `/v3/projects/0d6913627b7e4724a11be4649d098c48` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:01.803254 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20413031-a820-44cb-86d4-0757106c891d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d6913627b7e4724a11be4649d098c48)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:01.805155 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20413031-a820-44cb-86d4-0757106c891d admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:01.807096 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:36:01.861897 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-20413031-a820-44cb-86d4-0757106c891d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d6913627b7e4724a11be4649d098c48', 'request_id': 'req-20413031-a820-44cb-86d4-0757106c891d'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:01.870106 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-20413031-a820-44cb-86d4-0757106c891d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d6913627b7e4724a11be4649d098c48', 'request_id': 'req-20413031-a820-44cb-86d4-0757106c891d'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:01.873224 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6437825e-f383-40d5-b814-c8c8626b68e8 service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:01.875736 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-6437825e-f383-40d5-b814-c8c8626b68e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:01.877914 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-20413031-a820-44cb-86d4-0757106c891d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d6913627b7e4724a11be4649d098c48', 'request_id': 'req-20413031-a820-44cb-86d4-0757106c891d'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:01.896765 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-20413031-a820-44cb-86d4-0757106c891d admin admin] The token cache is being invalidate because project 0d6913627b7e4724a11be4649d098c48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:36:01.897058 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-20413031-a820-44cb-86d4-0757106c891d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:01.897747 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-20413031-a820-44cb-86d4-0757106c891d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:01.903862 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1277/2537] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:36:01 2022] DELETE /identity/v3/projects/0d6913627b7e4724a11be4649d098c48 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 01:36:01.908753 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20413031-a820-44cb-86d4-0757106c891d admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:01.910481 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-20413031-a820-44cb-86d4-0757106c891d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:01.989560 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6437825e-f383-40d5-b814-c8c8626b68e8 service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:02.019519 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20413031-a820-44cb-86d4-0757106c891d admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:02.026336 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eb27ad-e8a9-41e9-99e4-b0f386ca94a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:02.027500 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb27ad-e8a9-41e9-99e4-b0f386ca94a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:02.027882 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb27ad-e8a9-41e9-99e4-b0f386ca94a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:02.028307 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb27ad-e8a9-41e9-99e4-b0f386ca94a4 admin admin] PATH_INFO: `/v3/users/acb0b294dd464c21af79ccf7a1f297dc` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:02.029890 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eb27ad-e8a9-41e9-99e4-b0f386ca94a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=acb0b294dd464c21af79ccf7a1f297dc)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:02.032815 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eb27ad-e8a9-41e9-99e4-b0f386ca94a4 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:02.081266 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5478a03-d0c5-4be3-b6dc-e5af1746f3b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd5e95467b44175be2478c2c7c89926', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:02.081969 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5478a03-d0c5-4be3-b6dc-e5af1746f3b6 service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:02.082409 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5478a03-d0c5-4be3-b6dc-e5af1746f3b6 service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:02.082813 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5478a03-d0c5-4be3-b6dc-e5af1746f3b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:02.084697 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c5478a03-d0c5-4be3-b6dc-e5af1746f3b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:02.098737 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5478a03-d0c5-4be3-b6dc-e5af1746f3b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:02.100991 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5478a03-d0c5-4be3-b6dc-e5af1746f3b6 service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:02.114461 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1261/2538] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:36:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:36:02.121446 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-11eb27ad-e8a9-41e9-99e4-b0f386ca94a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acb0b294dd464c21af79ccf7a1f297dc'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:02.130371 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-11eb27ad-e8a9-41e9-99e4-b0f386ca94a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acb0b294dd464c21af79ccf7a1f297dc'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:02.131105 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-11eb27ad-e8a9-41e9-99e4-b0f386ca94a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acb0b294dd464c21af79ccf7a1f297dc'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:02.142415 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-11eb27ad-e8a9-41e9-99e4-b0f386ca94a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acb0b294dd464c21af79ccf7a1f297dc'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:02.168675 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-11eb27ad-e8a9-41e9-99e4-b0f386ca94a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acb0b294dd464c21af79ccf7a1f297dc'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:02.175254 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1278/2539] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:36:01 2022] DELETE /identity/v3/users/acb0b294dd464c21af79ccf7a1f297dc => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:36:02.493734 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5478a03-d0c5-4be3-b6dc-e5af1746f3b6 service nova] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:02.507448 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5478a03-d0c5-4be3-b6dc-e5af1746f3b6 service nova] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:02.554228 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:36:02.569068 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcc9bb5-21f8-4fb0-bc95-38fd9a1fdce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:02.569683 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc9bb5-21f8-4fb0-bc95-38fd9a1fdce0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:02.569977 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc9bb5-21f8-4fb0-bc95-38fd9a1fdce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:02.570282 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc9bb5-21f8-4fb0-bc95-38fd9a1fdce0 admin admin] PATH_INFO: `/v3/projects/b91d2196647548b780df118dd8e598df` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:02.571417 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcc9bb5-21f8-4fb0-bc95-38fd9a1fdce0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b91d2196647548b780df118dd8e598df)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:02.573313 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcc9bb5-21f8-4fb0-bc95-38fd9a1fdce0 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:02.619916 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-cfcc9bb5-21f8-4fb0-bc95-38fd9a1fdce0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b91d2196647548b780df118dd8e598df', 'request_id': 'req-cfcc9bb5-21f8-4fb0-bc95-38fd9a1fdce0'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:02.627976 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-cfcc9bb5-21f8-4fb0-bc95-38fd9a1fdce0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b91d2196647548b780df118dd8e598df', 'request_id': 'req-cfcc9bb5-21f8-4fb0-bc95-38fd9a1fdce0'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:02.633853 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-cfcc9bb5-21f8-4fb0-bc95-38fd9a1fdce0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b91d2196647548b780df118dd8e598df', 'request_id': 'req-cfcc9bb5-21f8-4fb0-bc95-38fd9a1fdce0'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:02.646339 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-cfcc9bb5-21f8-4fb0-bc95-38fd9a1fdce0 admin admin] The token cache is being invalidate because project b91d2196647548b780df118dd8e598df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:36:02.646606 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-cfcc9bb5-21f8-4fb0-bc95-38fd9a1fdce0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:02.647405 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-cfcc9bb5-21f8-4fb0-bc95-38fd9a1fdce0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:02.649026 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1262/2540] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:36:02 2022] DELETE /identity/v3/projects/b91d2196647548b780df118dd8e598df => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:36:02.654568 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d9934-b198-46f6-a773-3ab10a560fe4 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:02.655070 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d9934-b198-46f6-a773-3ab10a560fe4 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:02.655173 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d9934-b198-46f6-a773-3ab10a560fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:02.687140 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-929d9934-b198-46f6-a773-3ab10a560fe4 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:36:02.688360 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-929d9934-b198-46f6-a773-3ab10a560fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:02.693165 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:36:02.776745 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1279/2541] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:36:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:36:02.785317 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9212101-f287-43fb-a3d8-1a00a20dd6f2 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:02.785726 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9212101-f287-43fb-a3d8-1a00a20dd6f2 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:02.785965 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9212101-f287-43fb-a3d8-1a00a20dd6f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:02.807821 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-e9212101-f287-43fb-a3d8-1a00a20dd6f2 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:36:02.809461 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-e9212101-f287-43fb-a3d8-1a00a20dd6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:02.819277 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1263/2542] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:36:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:36:02.823866 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d9934-b198-46f6-a773-3ab10a560fe4 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:02.838622 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d9934-b198-46f6-a773-3ab10a560fe4 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:02.843841 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06645c7-a303-40a2-8ab4-14ba4e580abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:02.844459 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06645c7-a303-40a2-8ab4-14ba4e580abb admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:02.844732 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06645c7-a303-40a2-8ab4-14ba4e580abb admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:02.845030 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06645c7-a303-40a2-8ab4-14ba4e580abb admin admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:02.845729 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06645c7-a303-40a2-8ab4-14ba4e580abb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:36:02.846032 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06645c7-a303-40a2-8ab4-14ba4e580abb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:02.847800 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06645c7-a303-40a2-8ab4-14ba4e580abb admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:02.861399 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1280/2543] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 01:36:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:36:02.866097 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9212101-f287-43fb-a3d8-1a00a20dd6f2 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:02.875749 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9212101-f287-43fb-a3d8-1a00a20dd6f2 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:02.881285 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15836a3-061e-416f-b7fb-30cd449d61c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:02.882031 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15836a3-061e-416f-b7fb-30cd449d61c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:02.882340 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15836a3-061e-416f-b7fb-30cd449d61c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:02.882664 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15836a3-061e-416f-b7fb-30cd449d61c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:02.883294 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15836a3-061e-416f-b7fb-30cd449d61c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:02.885918 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15836a3-061e-416f-b7fb-30cd449d61c0 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:02.938441 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1264/2544] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:36:02 2022] POST /identity/v3/projects => generated 385 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:36:02.939692 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06645c7-a303-40a2-8ab4-14ba4e580abb admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:02.950448 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06645c7-a303-40a2-8ab4-14ba4e580abb admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:03.028232 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b888a-3f73-4c3a-b5c7-a683b43ef9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:03.028875 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b888a-3f73-4c3a-b5c7-a683b43ef9e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:03.029122 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b888a-3f73-4c3a-b5c7-a683b43ef9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:03.029396 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b888a-3f73-4c3a-b5c7-a683b43ef9e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:03.030017 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174b888a-3f73-4c3a-b5c7-a683b43ef9e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:03.032186 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174b888a-3f73-4c3a-b5c7-a683b43ef9e6 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:03.059907 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1281/2545] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:36:02 2022] POST /identity/v3/users => generated 293 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:36:03.061476 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15836a3-061e-416f-b7fb-30cd449d61c0 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:03.073562 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15836a3-061e-416f-b7fb-30cd449d61c0 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:03.078538 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8fc991-8b27-46e8-83f8-ff688c61ee7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:03.079274 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8fc991-8b27-46e8-83f8-ff688c61ee7e admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:03.079545 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8fc991-8b27-46e8-83f8-ff688c61ee7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:03.079810 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8fc991-8b27-46e8-83f8-ff688c61ee7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:03.080450 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8fc991-8b27-46e8-83f8-ff688c61ee7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:03.082845 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8fc991-8b27-46e8-83f8-ff688c61ee7e admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:03.101098 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1265/2546] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:36:03 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:36:03.102835 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b888a-3f73-4c3a-b5c7-a683b43ef9e6 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:03.116378 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b888a-3f73-4c3a-b5c7-a683b43ef9e6 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:03.121681 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faaf4ef-fc39-4dbd-a2ce-cc2003ab0624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:03.122797 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faaf4ef-fc39-4dbd-a2ce-cc2003ab0624 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:03.123592 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faaf4ef-fc39-4dbd-a2ce-cc2003ab0624 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:03.123971 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faaf4ef-fc39-4dbd-a2ce-cc2003ab0624 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:03.125081 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faaf4ef-fc39-4dbd-a2ce-cc2003ab0624 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:03.126479 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faaf4ef-fc39-4dbd-a2ce-cc2003ab0624 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:03.139816 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1282/2547] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:36:03 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:36:03.144681 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8fc991-8b27-46e8-83f8-ff688c61ee7e admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:03.156011 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8fc991-8b27-46e8-83f8-ff688c61ee7e admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:03.160978 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fabf68-e924-460e-90c7-ea600f1dcf3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:03.161773 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fabf68-e924-460e-90c7-ea600f1dcf3b admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:03.162137 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fabf68-e924-460e-90c7-ea600f1dcf3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:03.162472 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fabf68-e924-460e-90c7-ea600f1dcf3b admin admin] PATH_INFO: `/v3/projects/12cfb314ccc14bc9bf75ae3d5bb5a82b/users/036bc23362ea4fb5a178bc14eeea399d/roles/13af81971c1c428eae0a571a22ea583d` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:03.178823 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fabf68-e924-460e-90c7-ea600f1dcf3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=12cfb314ccc14bc9bf75ae3d5bb5a82b, user_id=036bc23362ea4fb5a178bc14eeea399d, role_id=13af81971c1c428eae0a571a22ea583d)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:03.181580 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fabf68-e924-460e-90c7-ea600f1dcf3b admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:03.198886 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1266/2548] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:36:03 2022] PUT /identity/v3/projects/12cfb314ccc14bc9bf75ae3d5bb5a82b/users/036bc23362ea4fb5a178bc14eeea399d/roles/13af81971c1c428eae0a571a22ea583d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:36:03.211355 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6be52e-e6d6-4456-96a9-bfa1412fe92a None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:03.211643 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6be52e-e6d6-4456-96a9-bfa1412fe92a None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:03.211930 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6be52e-e6d6-4456-96a9-bfa1412fe92a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:03.382397 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-2f6be52e-e6d6-4456-96a9-bfa1412fe92a None None] MFA Rules not processed for user `036bc23362ea4fb5a178bc14eeea399d`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:36:03.383496 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-2f6be52e-e6d6-4456-96a9-bfa1412fe92a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:03.456743 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1283/2549] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:36:03 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:36:03.461285 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fabf68-e924-460e-90c7-ea600f1dcf3b admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:03.538059 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fabf68-e924-460e-90c7-ea600f1dcf3b admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:03.542668 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd01fd93-d102-47fa-99b7-6fc7af0bd009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:03.543276 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01fd93-d102-47fa-99b7-6fc7af0bd009 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:03.543551 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01fd93-d102-47fa-99b7-6fc7af0bd009 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:03.543896 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01fd93-d102-47fa-99b7-6fc7af0bd009 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:03.544522 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd01fd93-d102-47fa-99b7-6fc7af0bd009 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:03.546490 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd01fd93-d102-47fa-99b7-6fc7af0bd009 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:03.569026 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:36:03.578777 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1267/2550] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:36:03 2022] POST /identity/v3/projects => generated 383 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:36:03.582788 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6be52e-e6d6-4456-96a9-bfa1412fe92a None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:03.589490 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:36:03.594968 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6be52e-e6d6-4456-96a9-bfa1412fe92a None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:03.652476 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f25dba-f41e-465c-9869-de451949def8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:03.653130 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f25dba-f41e-465c-9869-de451949def8 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:03.653408 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f25dba-f41e-465c-9869-de451949def8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:03.653707 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f25dba-f41e-465c-9869-de451949def8 admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:03.654380 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f25dba-f41e-465c-9869-de451949def8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:03.656337 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f25dba-f41e-465c-9869-de451949def8 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:03.679163 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1284/2551] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:36:03 2022] POST /identity/v3/users => generated 298 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 01:36:03.683575 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd01fd93-d102-47fa-99b7-6fc7af0bd009 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:03.694899 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd01fd93-d102-47fa-99b7-6fc7af0bd009 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:03.700530 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed549460-40d9-49f9-9cab-ca91a278b15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:03.701137 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed549460-40d9-49f9-9cab-ca91a278b15b admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:03.701512 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed549460-40d9-49f9-9cab-ca91a278b15b admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:03.701786 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed549460-40d9-49f9-9cab-ca91a278b15b admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:03.702494 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed549460-40d9-49f9-9cab-ca91a278b15b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:03.704092 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed549460-40d9-49f9-9cab-ca91a278b15b admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:03.718758 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1268/2552] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:36:03 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:36:03.725681 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f25dba-f41e-465c-9869-de451949def8 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:03.740360 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f25dba-f41e-465c-9869-de451949def8 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:03.747672 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19648092-fc75-4a60-a0ab-5b446014430e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:03.748313 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19648092-fc75-4a60-a0ab-5b446014430e admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:03.748586 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19648092-fc75-4a60-a0ab-5b446014430e admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:03.748854 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19648092-fc75-4a60-a0ab-5b446014430e admin admin] PATH_INFO: `/v3/projects/f1549e590a3e4ba9950780802b16ea9a/users/b3a5f02b1d3c487a9ee74c4f282da9a7/roles/fb48693810be495fb4b1893a79429b78` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:03.764690 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19648092-fc75-4a60-a0ab-5b446014430e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1549e590a3e4ba9950780802b16ea9a, user_id=b3a5f02b1d3c487a9ee74c4f282da9a7, role_id=fb48693810be495fb4b1893a79429b78)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:03.767442 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19648092-fc75-4a60-a0ab-5b446014430e admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:03.783380 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1285/2553] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:36:03 2022] PUT /identity/v3/projects/f1549e590a3e4ba9950780802b16ea9a/users/b3a5f02b1d3c487a9ee74c4f282da9a7/roles/fb48693810be495fb4b1893a79429b78 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:36:03.787498 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed549460-40d9-49f9-9cab-ca91a278b15b admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:03.798321 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed549460-40d9-49f9-9cab-ca91a278b15b admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:03.854688 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d6097c-72cb-48a2-a6fe-ddf8ee30183a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:03.855282 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d6097c-72cb-48a2-a6fe-ddf8ee30183a admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:03.855549 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d6097c-72cb-48a2-a6fe-ddf8ee30183a admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:03.855814 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d6097c-72cb-48a2-a6fe-ddf8ee30183a admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:03.856596 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d6097c-72cb-48a2-a6fe-ddf8ee30183a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:03.858140 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d6097c-72cb-48a2-a6fe-ddf8ee30183a admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:03.867732 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1269/2554] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:36:03 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:36:03.872298 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19648092-fc75-4a60-a0ab-5b446014430e admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:03.882932 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19648092-fc75-4a60-a0ab-5b446014430e admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:03.887823 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa185e2-2952-49ce-864a-8760c4dcf816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:03.888476 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa185e2-2952-49ce-864a-8760c4dcf816 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:03.888771 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa185e2-2952-49ce-864a-8760c4dcf816 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:03.889010 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa185e2-2952-49ce-864a-8760c4dcf816 admin admin] PATH_INFO: `/v3/projects/f1549e590a3e4ba9950780802b16ea9a/users/b3a5f02b1d3c487a9ee74c4f282da9a7/roles/fb48693810be495fb4b1893a79429b78` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:03.890927 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa185e2-2952-49ce-864a-8760c4dcf816 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1549e590a3e4ba9950780802b16ea9a, user_id=b3a5f02b1d3c487a9ee74c4f282da9a7, role_id=fb48693810be495fb4b1893a79429b78)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:03.893502 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa185e2-2952-49ce-864a-8760c4dcf816 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:03.903731 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1286/2555] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:36:03 2022] PUT /identity/v3/projects/f1549e590a3e4ba9950780802b16ea9a/users/b3a5f02b1d3c487a9ee74c4f282da9a7/roles/fb48693810be495fb4b1893a79429b78 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:36:03.913864 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed975c-2760-4bfe-8b6d-56640eaceefe None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:03.914145 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed975c-2760-4bfe-8b6d-56640eaceefe None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:03.914429 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed975c-2760-4bfe-8b6d-56640eaceefe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:03.942416 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-29ed975c-2760-4bfe-8b6d-56640eaceefe None None] MFA Rules not processed for user `b3a5f02b1d3c487a9ee74c4f282da9a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:36:03.943597 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-29ed975c-2760-4bfe-8b6d-56640eaceefe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:04.023411 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1270/2556] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:36:03 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 01:36:04.034734 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa185e2-2952-49ce-864a-8760c4dcf816 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:04.036770 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-ffa185e2-2952-49ce-864a-8760c4dcf816 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:04.094986 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa185e2-2952-49ce-864a-8760c4dcf816 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:04.098768 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6354ef70-d0fa-462b-8075-0a885ffb5d98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7853d40c29af424c8d7913950d89750b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:04.099364 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354ef70-d0fa-462b-8075-0a885ffb5d98 service cinder] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:04.099638 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354ef70-d0fa-462b-8075-0a885ffb5d98 service cinder] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:04.099904 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354ef70-d0fa-462b-8075-0a885ffb5d98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:04.166990 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6354ef70-d0fa-462b-8075-0a885ffb5d98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:04.168407 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6354ef70-d0fa-462b-8075-0a885ffb5d98 service cinder] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:04.177218 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1287/2557] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:36:04 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:36:07.153364 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ed975c-2760-4bfe-8b6d-56640eaceefe None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:07.155184 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-29ed975c-2760-4bfe-8b6d-56640eaceefe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:07.220020 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ed975c-2760-4bfe-8b6d-56640eaceefe None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:07.223946 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80e5791-b6f9-4674-a611-4884d7dfec0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:07.224600 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e5791-b6f9-4674-a611-4884d7dfec0d service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:07.224921 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e5791-b6f9-4674-a611-4884d7dfec0d service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:07.225238 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e5791-b6f9-4674-a611-4884d7dfec0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:07.227192 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d80e5791-b6f9-4674-a611-4884d7dfec0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:07.253896 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:36:07.301786 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80e5791-b6f9-4674-a611-4884d7dfec0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:07.303304 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80e5791-b6f9-4674-a611-4884d7dfec0d service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:07.317768 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1271/2558] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:36:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:36:08.539152 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6354ef70-d0fa-462b-8075-0a885ffb5d98 service cinder] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:08.540796 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-6354ef70-d0fa-462b-8075-0a885ffb5d98 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:08.552830 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6354ef70-d0fa-462b-8075-0a885ffb5d98 service cinder] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:08.556612 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ffa50b-c9f0-4d08-83c3-4493e23684f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7853d40c29af424c8d7913950d89750b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:08.557629 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ffa50b-c9f0-4d08-83c3-4493e23684f6 service cinder] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:08.557991 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ffa50b-c9f0-4d08-83c3-4493e23684f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:08.558371 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ffa50b-c9f0-4d08-83c3-4493e23684f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:08.571854 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ffa50b-c9f0-4d08-83c3-4493e23684f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:08.573297 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ffa50b-c9f0-4d08-83c3-4493e23684f6 service cinder] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:08.578464 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:36:08.597385 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1288/2559] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:36:08 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:36:10.607290 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80e5791-b6f9-4674-a611-4884d7dfec0d service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:10.610370 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d80e5791-b6f9-4674-a611-4884d7dfec0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:10.623443 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80e5791-b6f9-4674-a611-4884d7dfec0d service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:10.628231 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb62de0-497b-4502-8d51-6deac72052a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:10.628865 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb62de0-497b-4502-8d51-6deac72052a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:10.629164 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb62de0-497b-4502-8d51-6deac72052a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:10.629429 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb62de0-497b-4502-8d51-6deac72052a2 admin admin] PATH_INFO: `/v3/users/c8e85b77280f4a779c1d2ab66891f948` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:10.630565 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb62de0-497b-4502-8d51-6deac72052a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8e85b77280f4a779c1d2ab66891f948)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:10.632470 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb62de0-497b-4502-8d51-6deac72052a2 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:10.686621 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ddb62de0-497b-4502-8d51-6deac72052a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8e85b77280f4a779c1d2ab66891f948'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:10.694538 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ddb62de0-497b-4502-8d51-6deac72052a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8e85b77280f4a779c1d2ab66891f948'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:10.695212 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ddb62de0-497b-4502-8d51-6deac72052a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8e85b77280f4a779c1d2ab66891f948'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:10.702059 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ddb62de0-497b-4502-8d51-6deac72052a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8e85b77280f4a779c1d2ab66891f948'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:10.713444 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ddb62de0-497b-4502-8d51-6deac72052a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8e85b77280f4a779c1d2ab66891f948'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:10.719537 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1272/2560] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:36:10 2022] DELETE /identity/v3/users/c8e85b77280f4a779c1d2ab66891f948 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:36:10.898703 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ffa50b-c9f0-4d08-83c3-4493e23684f6 service cinder] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:10.910593 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ffa50b-c9f0-4d08-83c3-4493e23684f6 service cinder] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:10.970465 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af98b7f1-96a4-4585-9d4d-116378e362af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:10.971097 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98b7f1-96a4-4585-9d4d-116378e362af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:10.971371 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98b7f1-96a4-4585-9d4d-116378e362af admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:10.971638 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98b7f1-96a4-4585-9d4d-116378e362af admin admin] PATH_INFO: `/v3/projects/cbfe5be0639a4caeb8e2e1cbf5e59122` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:10.972747 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af98b7f1-96a4-4585-9d4d-116378e362af admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbfe5be0639a4caeb8e2e1cbf5e59122)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:10.974684 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af98b7f1-96a4-4585-9d4d-116378e362af admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:11.022346 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-af98b7f1-96a4-4585-9d4d-116378e362af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbfe5be0639a4caeb8e2e1cbf5e59122', 'request_id': 'req-af98b7f1-96a4-4585-9d4d-116378e362af'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:11.028474 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-af98b7f1-96a4-4585-9d4d-116378e362af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbfe5be0639a4caeb8e2e1cbf5e59122', 'request_id': 'req-af98b7f1-96a4-4585-9d4d-116378e362af'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:11.034564 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-af98b7f1-96a4-4585-9d4d-116378e362af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbfe5be0639a4caeb8e2e1cbf5e59122', 'request_id': 'req-af98b7f1-96a4-4585-9d4d-116378e362af'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:11.048609 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-af98b7f1-96a4-4585-9d4d-116378e362af admin admin] The token cache is being invalidate because project cbfe5be0639a4caeb8e2e1cbf5e59122 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:36:11.048890 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-af98b7f1-96a4-4585-9d4d-116378e362af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:11.049526 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-af98b7f1-96a4-4585-9d4d-116378e362af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:11.051100 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1289/2561] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:36:10 2022] DELETE /identity/v3/projects/cbfe5be0639a4caeb8e2e1cbf5e59122 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:36:11.056167 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e49914-1e9d-44df-a4c6-eb785935a4a3 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:11.056476 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e49914-1e9d-44df-a4c6-eb785935a4a3 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:11.057063 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e49914-1e9d-44df-a4c6-eb785935a4a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:11.076355 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-a4e49914-1e9d-44df-a4c6-eb785935a4a3 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:36:11.077541 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-a4e49914-1e9d-44df-a4c6-eb785935a4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:11.136578 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1273/2562] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:36:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:36:11.146660 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ec8f2-b3f1-46ce-b58b-627c89602787 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:11.146946 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ec8f2-b3f1-46ce-b58b-627c89602787 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:11.147216 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ec8f2-b3f1-46ce-b58b-627c89602787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:11.168503 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-f00ec8f2-b3f1-46ce-b58b-627c89602787 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:36:11.169722 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-f00ec8f2-b3f1-46ce-b58b-627c89602787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:11.179336 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1290/2563] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:36:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:36:11.184705 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e49914-1e9d-44df-a4c6-eb785935a4a3 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:11.199578 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e49914-1e9d-44df-a4c6-eb785935a4a3 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:11.207929 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3321045-1007-4ccd-a197-13fe2bb3448b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:11.208784 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3321045-1007-4ccd-a197-13fe2bb3448b admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:11.209131 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3321045-1007-4ccd-a197-13fe2bb3448b admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:11.209489 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3321045-1007-4ccd-a197-13fe2bb3448b admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:11.210511 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3321045-1007-4ccd-a197-13fe2bb3448b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:36:11.210877 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3321045-1007-4ccd-a197-13fe2bb3448b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:11.213320 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3321045-1007-4ccd-a197-13fe2bb3448b admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:11.225766 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1274/2564] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 01:36:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:36:11.231946 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00ec8f2-b3f1-46ce-b58b-627c89602787 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:11.244901 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00ec8f2-b3f1-46ce-b58b-627c89602787 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:11.251113 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e7b34-105f-4ed9-8d33-e1b033796218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:11.251761 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e7b34-105f-4ed9-8d33-e1b033796218 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:11.252002 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e7b34-105f-4ed9-8d33-e1b033796218 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:11.252256 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e7b34-105f-4ed9-8d33-e1b033796218 admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:11.252867 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414e7b34-105f-4ed9-8d33-e1b033796218 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:11.254845 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414e7b34-105f-4ed9-8d33-e1b033796218 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:11.282566 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1291/2565] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:36:11 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 01:36:11.286745 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3321045-1007-4ccd-a197-13fe2bb3448b admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:11.296749 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3321045-1007-4ccd-a197-13fe2bb3448b admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:11.309483 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:36:11.362326 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d10df-1c8a-46af-b125-ea63d2160377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:11.363138 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d10df-1c8a-46af-b125-ea63d2160377 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:11.363450 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d10df-1c8a-46af-b125-ea63d2160377 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:11.363734 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d10df-1c8a-46af-b125-ea63d2160377 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:11.364374 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96d10df-1c8a-46af-b125-ea63d2160377 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:11.366540 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96d10df-1c8a-46af-b125-ea63d2160377 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:11.396170 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1275/2566] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:36:11 2022] POST /identity/v3/users => generated 287 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:36:11.400361 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e7b34-105f-4ed9-8d33-e1b033796218 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:11.410488 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e7b34-105f-4ed9-8d33-e1b033796218 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:11.414905 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be8cb07-9c25-45ea-9d46-bfa1315e2992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:11.415495 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8cb07-9c25-45ea-9d46-bfa1315e2992 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:11.415765 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8cb07-9c25-45ea-9d46-bfa1315e2992 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:11.416031 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8cb07-9c25-45ea-9d46-bfa1315e2992 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:11.416691 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be8cb07-9c25-45ea-9d46-bfa1315e2992 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:11.418527 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be8cb07-9c25-45ea-9d46-bfa1315e2992 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:11.428776 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1292/2567] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:36:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:36:11.433564 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d10df-1c8a-46af-b125-ea63d2160377 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:11.450720 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d10df-1c8a-46af-b125-ea63d2160377 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:11.458917 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc15bfed-f780-4c82-a331-595ee0e0aee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:11.460008 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc15bfed-f780-4c82-a331-595ee0e0aee8 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:11.460500 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc15bfed-f780-4c82-a331-595ee0e0aee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:11.460885 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc15bfed-f780-4c82-a331-595ee0e0aee8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:11.462172 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc15bfed-f780-4c82-a331-595ee0e0aee8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:11.464464 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc15bfed-f780-4c82-a331-595ee0e0aee8 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:11.477109 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1276/2568] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:36:11 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:36:11.482979 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be8cb07-9c25-45ea-9d46-bfa1315e2992 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:11.494369 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be8cb07-9c25-45ea-9d46-bfa1315e2992 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:11.500013 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39737bc9-df9d-44fd-a284-f8a30c4996b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:11.500673 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39737bc9-df9d-44fd-a284-f8a30c4996b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:11.500997 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39737bc9-df9d-44fd-a284-f8a30c4996b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:11.501215 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39737bc9-df9d-44fd-a284-f8a30c4996b6 admin admin] PATH_INFO: `/v3/projects/44ac2e27fe26446ba01046a564b09b40/users/a0749fd9a93146509f39915a58b4f2ca/roles/13af81971c1c428eae0a571a22ea583d` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:11.517771 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39737bc9-df9d-44fd-a284-f8a30c4996b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44ac2e27fe26446ba01046a564b09b40, user_id=a0749fd9a93146509f39915a58b4f2ca, role_id=13af81971c1c428eae0a571a22ea583d)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:11.520496 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39737bc9-df9d-44fd-a284-f8a30c4996b6 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:11.534293 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1293/2569] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:36:11 2022] PUT /identity/v3/projects/44ac2e27fe26446ba01046a564b09b40/users/a0749fd9a93146509f39915a58b4f2ca/roles/13af81971c1c428eae0a571a22ea583d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:36:11.544847 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7167725a-ccbf-4ce9-bef4-e866032975b8 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:11.545124 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7167725a-ccbf-4ce9-bef4-e866032975b8 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:11.545393 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7167725a-ccbf-4ce9-bef4-e866032975b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:11.574180 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-7167725a-ccbf-4ce9-bef4-e866032975b8 None None] MFA Rules not processed for user `a0749fd9a93146509f39915a58b4f2ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:36:11.575504 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-7167725a-ccbf-4ce9-bef4-e866032975b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:11.644856 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1277/2570] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:36:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:36:11.649454 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39737bc9-df9d-44fd-a284-f8a30c4996b6 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:11.676223 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:36:11.714808 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39737bc9-df9d-44fd-a284-f8a30c4996b6 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:11.720280 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a76844-6d94-47de-85d4-4acc194a283a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:11.720885 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a76844-6d94-47de-85d4-4acc194a283a admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:11.721156 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a76844-6d94-47de-85d4-4acc194a283a admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:11.721421 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a76844-6d94-47de-85d4-4acc194a283a admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:11.722039 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a76844-6d94-47de-85d4-4acc194a283a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:11.723952 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a76844-6d94-47de-85d4-4acc194a283a admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:11.753116 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1294/2571] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:36:11 2022] POST /identity/v3/projects => generated 373 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:36:11.757273 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7167725a-ccbf-4ce9-bef4-e866032975b8 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:11.769031 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7167725a-ccbf-4ce9-bef4-e866032975b8 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:11.828651 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcc3217-b2ea-4d63-9676-53449b74bee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:11.829320 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc3217-b2ea-4d63-9676-53449b74bee8 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:11.829595 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc3217-b2ea-4d63-9676-53449b74bee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:11.829860 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc3217-b2ea-4d63-9676-53449b74bee8 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:11.830512 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcc3217-b2ea-4d63-9676-53449b74bee8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:11.832412 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcc3217-b2ea-4d63-9676-53449b74bee8 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:11.854677 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1278/2572] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:36:11 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:36:11.858890 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a76844-6d94-47de-85d4-4acc194a283a admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:11.869540 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a76844-6d94-47de-85d4-4acc194a283a admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:11.874377 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a340de2-1dfc-4cbe-a87c-2904a61434c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:11.874960 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a340de2-1dfc-4cbe-a87c-2904a61434c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:11.875226 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a340de2-1dfc-4cbe-a87c-2904a61434c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:11.875491 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a340de2-1dfc-4cbe-a87c-2904a61434c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:11.876152 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a340de2-1dfc-4cbe-a87c-2904a61434c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:11.877707 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a340de2-1dfc-4cbe-a87c-2904a61434c1 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:11.888284 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1295/2573] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:36:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:36:11.892549 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcc3217-b2ea-4d63-9676-53449b74bee8 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:11.903415 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcc3217-b2ea-4d63-9676-53449b74bee8 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:11.909291 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e799f0b5-7837-478b-a06b-dafdd06b3337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:11.910087 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e799f0b5-7837-478b-a06b-dafdd06b3337 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:11.910397 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e799f0b5-7837-478b-a06b-dafdd06b3337 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:11.910657 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e799f0b5-7837-478b-a06b-dafdd06b3337 admin admin] PATH_INFO: `/v3/projects/988fa0fe3ddb416f9bda4c0208c284ce/users/22875b9c23d540e190d0fa64c2aa2970/roles/fb48693810be495fb4b1893a79429b78` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:11.923778 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:36:11.926897 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e799f0b5-7837-478b-a06b-dafdd06b3337 admin admin] RBAC: Authorizing `identity:create_grant(project_id=988fa0fe3ddb416f9bda4c0208c284ce, user_id=22875b9c23d540e190d0fa64c2aa2970, role_id=fb48693810be495fb4b1893a79429b78)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:11.930063 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e799f0b5-7837-478b-a06b-dafdd06b3337 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:11.946199 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1279/2574] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:36:11 2022] PUT /identity/v3/projects/988fa0fe3ddb416f9bda4c0208c284ce/users/22875b9c23d540e190d0fa64c2aa2970/roles/fb48693810be495fb4b1893a79429b78 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:36:11.949906 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a340de2-1dfc-4cbe-a87c-2904a61434c1 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:11.960662 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a340de2-1dfc-4cbe-a87c-2904a61434c1 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:12.022925 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf59867-6aef-4729-bd11-89184e26b4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:12.023672 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf59867-6aef-4729-bd11-89184e26b4ac admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:12.024070 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf59867-6aef-4729-bd11-89184e26b4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:12.024444 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf59867-6aef-4729-bd11-89184e26b4ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:12.025405 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf59867-6aef-4729-bd11-89184e26b4ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:12.027952 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf59867-6aef-4729-bd11-89184e26b4ac admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:12.038057 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1296/2575] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:36:11 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:36:12.042512 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e799f0b5-7837-478b-a06b-dafdd06b3337 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:12.053225 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e799f0b5-7837-478b-a06b-dafdd06b3337 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:12.058617 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4624fda2-57f7-4f07-a041-ac23df1355ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:12.059260 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624fda2-57f7-4f07-a041-ac23df1355ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:12.059540 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624fda2-57f7-4f07-a041-ac23df1355ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:12.059809 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624fda2-57f7-4f07-a041-ac23df1355ef admin admin] PATH_INFO: `/v3/projects/988fa0fe3ddb416f9bda4c0208c284ce/users/22875b9c23d540e190d0fa64c2aa2970/roles/fb48693810be495fb4b1893a79429b78` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:12.061792 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4624fda2-57f7-4f07-a041-ac23df1355ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=988fa0fe3ddb416f9bda4c0208c284ce, user_id=22875b9c23d540e190d0fa64c2aa2970, role_id=fb48693810be495fb4b1893a79429b78)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:12.064481 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4624fda2-57f7-4f07-a041-ac23df1355ef admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:12.075153 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1280/2576] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:36:12 2022] PUT /identity/v3/projects/988fa0fe3ddb416f9bda4c0208c284ce/users/22875b9c23d540e190d0fa64c2aa2970/roles/fb48693810be495fb4b1893a79429b78 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:36:12.085501 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb715f5-c775-4194-b033-02bcf2a55068 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:12.085718 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb715f5-c775-4194-b033-02bcf2a55068 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:12.085992 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb715f5-c775-4194-b033-02bcf2a55068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:12.114780 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-6cb715f5-c775-4194-b033-02bcf2a55068 None None] MFA Rules not processed for user `22875b9c23d540e190d0fa64c2aa2970`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:36:12.115986 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-6cb715f5-c775-4194-b033-02bcf2a55068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:12.184895 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1297/2577] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:36:12 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 01:36:12.196626 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4624fda2-57f7-4f07-a041-ac23df1355ef admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:12.198480 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-4624fda2-57f7-4f07-a041-ac23df1355ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:12.258325 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4624fda2-57f7-4f07-a041-ac23df1355ef admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:12.262196 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ebb53-5e29-4598-adc8-1a601972dd3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7853d40c29af424c8d7913950d89750b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:12.262799 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ebb53-5e29-4598-adc8-1a601972dd3c service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:12.263184 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ebb53-5e29-4598-adc8-1a601972dd3c service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:12.263451 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ebb53-5e29-4598-adc8-1a601972dd3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:12.274079 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26ebb53-5e29-4598-adc8-1a601972dd3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:12.275534 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26ebb53-5e29-4598-adc8-1a601972dd3c service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:12.285108 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1281/2578] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:36:12 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:36:12.695290 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb715f5-c775-4194-b033-02bcf2a55068 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:12.716293 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:36:12.765401 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb715f5-c775-4194-b033-02bcf2a55068 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:12.770173 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a314b9ae-bdcb-4008-8c95-cb6f7063a2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:12.770811 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314b9ae-bdcb-4008-8c95-cb6f7063a2a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:12.771087 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314b9ae-bdcb-4008-8c95-cb6f7063a2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:12.771359 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314b9ae-bdcb-4008-8c95-cb6f7063a2a9 admin admin] PATH_INFO: `/v3/users/a0749fd9a93146509f39915a58b4f2ca` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:12.772475 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a314b9ae-bdcb-4008-8c95-cb6f7063a2a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0749fd9a93146509f39915a58b4f2ca)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:12.774418 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a314b9ae-bdcb-4008-8c95-cb6f7063a2a9 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:12.825406 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-a314b9ae-bdcb-4008-8c95-cb6f7063a2a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0749fd9a93146509f39915a58b4f2ca'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:12.833429 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-a314b9ae-bdcb-4008-8c95-cb6f7063a2a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0749fd9a93146509f39915a58b4f2ca'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:12.834435 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-a314b9ae-bdcb-4008-8c95-cb6f7063a2a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0749fd9a93146509f39915a58b4f2ca'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:12.843005 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-a314b9ae-bdcb-4008-8c95-cb6f7063a2a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0749fd9a93146509f39915a58b4f2ca'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:12.854970 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-a314b9ae-bdcb-4008-8c95-cb6f7063a2a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0749fd9a93146509f39915a58b4f2ca'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:12.860847 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1298/2579] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:36:12 2022] DELETE /identity/v3/users/a0749fd9a93146509f39915a58b4f2ca => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:36:12.865433 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320215b7-4825-4b70-a8de-e84a016789a3 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:12.865916 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320215b7-4825-4b70-a8de-e84a016789a3 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:12.866036 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320215b7-4825-4b70-a8de-e84a016789a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:12.884410 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-320215b7-4825-4b70-a8de-e84a016789a3 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:36:12.885612 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-320215b7-4825-4b70-a8de-e84a016789a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:12.946717 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1282/2580] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:36:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:36:12.957221 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a314b9ae-bdcb-4008-8c95-cb6f7063a2a9 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:12.959324 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-a314b9ae-bdcb-4008-8c95-cb6f7063a2a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:13.023330 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a314b9ae-bdcb-4008-8c95-cb6f7063a2a9 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:13.027724 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd4df7e-7020-428c-bc91-aac2319c0832 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:13.028335 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd4df7e-7020-428c-bc91-aac2319c0832 service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:13.028613 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd4df7e-7020-428c-bc91-aac2319c0832 service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:13.028940 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd4df7e-7020-428c-bc91-aac2319c0832 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:13.038253 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd4df7e-7020-428c-bc91-aac2319c0832 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:13.039679 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd4df7e-7020-428c-bc91-aac2319c0832 service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:13.049259 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1299/2581] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:36:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:36:13.338583 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320215b7-4825-4b70-a8de-e84a016789a3 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:13.340649 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-320215b7-4825-4b70-a8de-e84a016789a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:13.353484 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320215b7-4825-4b70-a8de-e84a016789a3 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:13.359548 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9764e689-1c0d-4d59-ab66-536922b8361a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:13.360205 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9764e689-1c0d-4d59-ab66-536922b8361a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:13.360586 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9764e689-1c0d-4d59-ab66-536922b8361a admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:13.360859 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9764e689-1c0d-4d59-ab66-536922b8361a admin admin] PATH_INFO: `/v3/projects/44ac2e27fe26446ba01046a564b09b40` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:13.362057 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9764e689-1c0d-4d59-ab66-536922b8361a admin admin] RBAC: Authorizing `identity:delete_project(project_id=44ac2e27fe26446ba01046a564b09b40)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:13.364216 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9764e689-1c0d-4d59-ab66-536922b8361a admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:13.416423 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-9764e689-1c0d-4d59-ab66-536922b8361a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44ac2e27fe26446ba01046a564b09b40', 'request_id': 'req-9764e689-1c0d-4d59-ab66-536922b8361a'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:13.425248 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-9764e689-1c0d-4d59-ab66-536922b8361a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44ac2e27fe26446ba01046a564b09b40', 'request_id': 'req-9764e689-1c0d-4d59-ab66-536922b8361a'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:13.432026 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-9764e689-1c0d-4d59-ab66-536922b8361a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44ac2e27fe26446ba01046a564b09b40', 'request_id': 'req-9764e689-1c0d-4d59-ab66-536922b8361a'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:13.443727 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-9764e689-1c0d-4d59-ab66-536922b8361a admin admin] The token cache is being invalidate because project 44ac2e27fe26446ba01046a564b09b40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:36:13.444012 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-9764e689-1c0d-4d59-ab66-536922b8361a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:13.444772 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-9764e689-1c0d-4d59-ab66-536922b8361a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:13.446411 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1283/2582] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:36:13 2022] DELETE /identity/v3/projects/44ac2e27fe26446ba01046a564b09b40 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:36:13.450807 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd4df7e-7020-428c-bc91-aac2319c0832 service neutron] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:13.461346 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd4df7e-7020-428c-bc91-aac2319c0832 service neutron] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:13.511003 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:36:13.530201 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9dbb0b-dcd7-4e4f-a30c-a87f7f2d5c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:13.530953 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9dbb0b-dcd7-4e4f-a30c-a87f7f2d5c3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:13.531224 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9dbb0b-dcd7-4e4f-a30c-a87f7f2d5c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:13.531498 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9dbb0b-dcd7-4e4f-a30c-a87f7f2d5c3f admin admin] PATH_INFO: `/v3/users/22875b9c23d540e190d0fa64c2aa2970` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:13.533203 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9dbb0b-dcd7-4e4f-a30c-a87f7f2d5c3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=22875b9c23d540e190d0fa64c2aa2970)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:13.535036 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9dbb0b-dcd7-4e4f-a30c-a87f7f2d5c3f admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:13.554499 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9764e689-1c0d-4d59-ab66-536922b8361a admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:13.556102 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-9764e689-1c0d-4d59-ab66-536922b8361a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:13.570732 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:36:13.575264 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9764e689-1c0d-4d59-ab66-536922b8361a admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:13.581665 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50efc312-2919-4063-9b54-a57a3a8051ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:13.582565 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50efc312-2919-4063-9b54-a57a3a8051ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:13.583025 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50efc312-2919-4063-9b54-a57a3a8051ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:13.583469 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50efc312-2919-4063-9b54-a57a3a8051ab admin admin] PATH_INFO: `/v3/users/036bc23362ea4fb5a178bc14eeea399d` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:13.584794 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50efc312-2919-4063-9b54-a57a3a8051ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=036bc23362ea4fb5a178bc14eeea399d)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:13.586837 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50efc312-2919-4063-9b54-a57a3a8051ab admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:13.591429 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-4a9dbb0b-dcd7-4e4f-a30c-a87f7f2d5c3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22875b9c23d540e190d0fa64c2aa2970'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:13.600370 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-4a9dbb0b-dcd7-4e4f-a30c-a87f7f2d5c3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22875b9c23d540e190d0fa64c2aa2970'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:13.601016 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-4a9dbb0b-dcd7-4e4f-a30c-a87f7f2d5c3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22875b9c23d540e190d0fa64c2aa2970'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:13.608595 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-4a9dbb0b-dcd7-4e4f-a30c-a87f7f2d5c3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22875b9c23d540e190d0fa64c2aa2970'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:13.623657 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-4a9dbb0b-dcd7-4e4f-a30c-a87f7f2d5c3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22875b9c23d540e190d0fa64c2aa2970'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:13.630569 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1300/2583] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:36:13 2022] DELETE /identity/v3/users/22875b9c23d540e190d0fa64c2aa2970 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:36:13.644382 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-50efc312-2919-4063-9b54-a57a3a8051ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '036bc23362ea4fb5a178bc14eeea399d'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:13.654893 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-50efc312-2919-4063-9b54-a57a3a8051ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '036bc23362ea4fb5a178bc14eeea399d'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:13.655607 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-50efc312-2919-4063-9b54-a57a3a8051ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '036bc23362ea4fb5a178bc14eeea399d'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:13.663171 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-50efc312-2919-4063-9b54-a57a3a8051ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '036bc23362ea4fb5a178bc14eeea399d'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:13.676011 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-50efc312-2919-4063-9b54-a57a3a8051ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '036bc23362ea4fb5a178bc14eeea399d'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:13.682856 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1284/2584] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:36:13 2022] DELETE /identity/v3/users/036bc23362ea4fb5a178bc14eeea399d => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:36:13.687546 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b5d73-a57f-4c08-9f1a-b37d40f77604 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:13.687842 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b5d73-a57f-4c08-9f1a-b37d40f77604 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:13.688103 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b5d73-a57f-4c08-9f1a-b37d40f77604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:13.708150 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-a17b5d73-a57f-4c08-9f1a-b37d40f77604 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:36:13.709378 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-a17b5d73-a57f-4c08-9f1a-b37d40f77604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:13.775554 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1301/2585] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:36:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:36:13.786751 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50efc312-2919-4063-9b54-a57a3a8051ab admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:13.788214 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-50efc312-2919-4063-9b54-a57a3a8051ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:13.848340 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50efc312-2919-4063-9b54-a57a3a8051ab admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:13.852027 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b26309-daae-47b4-a25a-f14e21171861 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:13.852629 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b26309-daae-47b4-a25a-f14e21171861 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:13.852906 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b26309-daae-47b4-a25a-f14e21171861 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:13.853175 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b26309-daae-47b4-a25a-f14e21171861 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:13.862620 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b26309-daae-47b4-a25a-f14e21171861 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:13.864206 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b26309-daae-47b4-a25a-f14e21171861 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:13.874478 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1285/2586] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:36:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 01:36:13.950541 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17b5d73-a57f-4c08-9f1a-b37d40f77604 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:13.952037 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-a17b5d73-a57f-4c08-9f1a-b37d40f77604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:13.965577 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17b5d73-a57f-4c08-9f1a-b37d40f77604 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:13.971180 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa4d6e-3bd6-42b2-a114-8a632a850dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:13.971816 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa4d6e-3bd6-42b2-a114-8a632a850dda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:13.972096 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa4d6e-3bd6-42b2-a114-8a632a850dda admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:13.972370 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa4d6e-3bd6-42b2-a114-8a632a850dda admin admin] PATH_INFO: `/v3/projects/988fa0fe3ddb416f9bda4c0208c284ce` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:13.973587 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fa4d6e-3bd6-42b2-a114-8a632a850dda admin admin] RBAC: Authorizing `identity:delete_project(project_id=988fa0fe3ddb416f9bda4c0208c284ce)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:13.975571 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fa4d6e-3bd6-42b2-a114-8a632a850dda admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:14.031389 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-d2fa4d6e-3bd6-42b2-a114-8a632a850dda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '988fa0fe3ddb416f9bda4c0208c284ce', 'request_id': 'req-d2fa4d6e-3bd6-42b2-a114-8a632a850dda'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:14.035924 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:36:14.038375 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-d2fa4d6e-3bd6-42b2-a114-8a632a850dda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '988fa0fe3ddb416f9bda4c0208c284ce', 'request_id': 'req-d2fa4d6e-3bd6-42b2-a114-8a632a850dda'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:14.046654 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-d2fa4d6e-3bd6-42b2-a114-8a632a850dda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '988fa0fe3ddb416f9bda4c0208c284ce', 'request_id': 'req-d2fa4d6e-3bd6-42b2-a114-8a632a850dda'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:14.060956 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-d2fa4d6e-3bd6-42b2-a114-8a632a850dda admin admin] The token cache is being invalidate because project 988fa0fe3ddb416f9bda4c0208c284ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:36:14.061248 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-d2fa4d6e-3bd6-42b2-a114-8a632a850dda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:14.061888 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-d2fa4d6e-3bd6-42b2-a114-8a632a850dda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:14.063622 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1302/2587] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:36:13 2022] DELETE /identity/v3/projects/988fa0fe3ddb416f9bda4c0208c284ce => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:36:14.069008 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ae425-d911-41b9-8f24-b99046bfb2b5 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:14.070003 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ae425-d911-41b9-8f24-b99046bfb2b5 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:14.070362 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ae425-d911-41b9-8f24-b99046bfb2b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:14.090532 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-299ae425-d911-41b9-8f24-b99046bfb2b5 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:36:14.091749 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-299ae425-d911-41b9-8f24-b99046bfb2b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:14.160543 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1286/2588] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:36:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 01:36:14.162758 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca5227-2186-4d21-a950-1eb9e43afaed None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:14.163110 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca5227-2186-4d21-a950-1eb9e43afaed None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:14.163450 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca5227-2186-4d21-a950-1eb9e43afaed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:14.183833 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-4cca5227-2186-4d21-a950-1eb9e43afaed None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:36:14.185058 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-4cca5227-2186-4d21-a950-1eb9e43afaed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:14.193659 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1303/2589] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:36:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:36:14.198022 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299ae425-d911-41b9-8f24-b99046bfb2b5 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:14.198844 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cca5227-2186-4d21-a950-1eb9e43afaed None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:14.200496 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-4cca5227-2186-4d21-a950-1eb9e43afaed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:14.208618 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299ae425-d911-41b9-8f24-b99046bfb2b5 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:14.213248 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cca5227-2186-4d21-a950-1eb9e43afaed None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:14.214021 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e26e6c-0a8c-47e2-999c-16598b12727f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:14.214834 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e26e6c-0a8c-47e2-999c-16598b12727f admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:14.215055 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e26e6c-0a8c-47e2-999c-16598b12727f admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:14.215318 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e26e6c-0a8c-47e2-999c-16598b12727f admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:14.216539 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e26e6c-0a8c-47e2-999c-16598b12727f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:36:14.216539 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e26e6c-0a8c-47e2-999c-16598b12727f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:14.217911 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e26e6c-0a8c-47e2-999c-16598b12727f admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:14.219236 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9ee97-8710-488d-8377-802cc2b16292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:14.219941 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9ee97-8710-488d-8377-802cc2b16292 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:14.220222 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9ee97-8710-488d-8377-802cc2b16292 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:14.220496 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9ee97-8710-488d-8377-802cc2b16292 admin admin] PATH_INFO: `/v3/projects/12cfb314ccc14bc9bf75ae3d5bb5a82b` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:14.221817 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f9ee97-8710-488d-8377-802cc2b16292 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12cfb314ccc14bc9bf75ae3d5bb5a82b)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:14.223933 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f9ee97-8710-488d-8377-802cc2b16292 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:14.236287 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1287/2590] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 01:36:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:36:14.238588 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e26e6c-0a8c-47e2-999c-16598b12727f admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:14.249060 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e26e6c-0a8c-47e2-999c-16598b12727f admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:14.253761 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b20a7f-2776-4837-9079-874b8e4897cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:14.254523 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b20a7f-2776-4837-9079-874b8e4897cf admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:14.254790 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b20a7f-2776-4837-9079-874b8e4897cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:14.255054 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b20a7f-2776-4837-9079-874b8e4897cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:14.255674 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b20a7f-2776-4837-9079-874b8e4897cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:14.257583 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b20a7f-2776-4837-9079-874b8e4897cf admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:14.262675 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:36:14.272869 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-c0f9ee97-8710-488d-8377-802cc2b16292 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12cfb314ccc14bc9bf75ae3d5bb5a82b', 'request_id': 'req-c0f9ee97-8710-488d-8377-802cc2b16292'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:14.278574 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-c0f9ee97-8710-488d-8377-802cc2b16292 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12cfb314ccc14bc9bf75ae3d5bb5a82b', 'request_id': 'req-c0f9ee97-8710-488d-8377-802cc2b16292'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:14.284816 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-c0f9ee97-8710-488d-8377-802cc2b16292 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12cfb314ccc14bc9bf75ae3d5bb5a82b', 'request_id': 'req-c0f9ee97-8710-488d-8377-802cc2b16292'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:14.288006 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1288/2591] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:36:14 2022] POST /identity/v3/projects => generated 353 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 01:36:14.292740 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b20a7f-2776-4837-9079-874b8e4897cf admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:14.299285 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-c0f9ee97-8710-488d-8377-802cc2b16292 admin admin] The token cache is being invalidate because project 12cfb314ccc14bc9bf75ae3d5bb5a82b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:36:14.299743 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-c0f9ee97-8710-488d-8377-802cc2b16292 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:14.300366 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-c0f9ee97-8710-488d-8377-802cc2b16292 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:14.302079 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1304/2592] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:36:14 2022] DELETE /identity/v3/projects/12cfb314ccc14bc9bf75ae3d5bb5a82b => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 01:36:14.306648 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9ee97-8710-488d-8377-802cc2b16292 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:14.308041 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-c0f9ee97-8710-488d-8377-802cc2b16292 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:14.355173 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b20a7f-2776-4837-9079-874b8e4897cf admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:14.360000 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ed9cbc-bbe2-417a-b709-6863330f35ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:14.360688 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed9cbc-bbe2-417a-b709-6863330f35ff admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:14.360965 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed9cbc-bbe2-417a-b709-6863330f35ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:14.361234 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed9cbc-bbe2-417a-b709-6863330f35ff admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:14.361882 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ed9cbc-bbe2-417a-b709-6863330f35ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:14.363841 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ed9cbc-bbe2-417a-b709-6863330f35ff admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:14.372635 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9ee97-8710-488d-8377-802cc2b16292 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:14.377531 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2172f662-1cfb-4191-a9b1-7cc52a317ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:14.378349 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172f662-1cfb-4191-a9b1-7cc52a317ed7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:14.378664 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172f662-1cfb-4191-a9b1-7cc52a317ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:14.378981 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172f662-1cfb-4191-a9b1-7cc52a317ed7 admin admin] PATH_INFO: `/v3/users/b3a5f02b1d3c487a9ee74c4f282da9a7` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:14.380160 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2172f662-1cfb-4191-a9b1-7cc52a317ed7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3a5f02b1d3c487a9ee74c4f282da9a7)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:14.382240 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2172f662-1cfb-4191-a9b1-7cc52a317ed7 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:14.386321 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1289/2593] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:36:14 2022] POST /identity/v3/users => generated 277 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 01:36:14.390370 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ed9cbc-bbe2-417a-b709-6863330f35ff admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:14.391993 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-65ed9cbc-bbe2-417a-b709-6863330f35ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:14.404626 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ed9cbc-bbe2-417a-b709-6863330f35ff admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:14.409264 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0995c1c7-0a18-46e4-883f-b1e9e69e049b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:14.409869 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0995c1c7-0a18-46e4-883f-b1e9e69e049b admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:14.410176 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0995c1c7-0a18-46e4-883f-b1e9e69e049b admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:14.410455 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0995c1c7-0a18-46e4-883f-b1e9e69e049b admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:14.411100 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0995c1c7-0a18-46e4-883f-b1e9e69e049b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:14.412702 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0995c1c7-0a18-46e4-883f-b1e9e69e049b admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:14.423389 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1290/2594] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:36:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 01:36:14.427308 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0995c1c7-0a18-46e4-883f-b1e9e69e049b admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:14.433952 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-2172f662-1cfb-4191-a9b1-7cc52a317ed7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3a5f02b1d3c487a9ee74c4f282da9a7'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:14.437194 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0995c1c7-0a18-46e4-883f-b1e9e69e049b admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:14.442502 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b530ecc6-2d6f-478f-8e7e-e0cae03d386e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:14.443093 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530ecc6-2d6f-478f-8e7e-e0cae03d386e admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:14.443222 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-2172f662-1cfb-4191-a9b1-7cc52a317ed7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3a5f02b1d3c487a9ee74c4f282da9a7'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:14.443365 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530ecc6-2d6f-478f-8e7e-e0cae03d386e admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:14.443632 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530ecc6-2d6f-478f-8e7e-e0cae03d386e admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:14.443897 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-2172f662-1cfb-4191-a9b1-7cc52a317ed7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3a5f02b1d3c487a9ee74c4f282da9a7'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:14.444322 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b530ecc6-2d6f-478f-8e7e-e0cae03d386e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:14.446054 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b530ecc6-2d6f-478f-8e7e-e0cae03d386e admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:14.451059 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-2172f662-1cfb-4191-a9b1-7cc52a317ed7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3a5f02b1d3c487a9ee74c4f282da9a7'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:14.452327 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=81,keystone:INSERT=3,keystone:DELETE=16 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:36:14.456903 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1291/2595] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:36:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 01:36:14.461311 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b530ecc6-2d6f-478f-8e7e-e0cae03d386e admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:14.463266 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-b530ecc6-2d6f-478f-8e7e-e0cae03d386e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:14.466536 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-2172f662-1cfb-4191-a9b1-7cc52a317ed7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3a5f02b1d3c487a9ee74c4f282da9a7'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:14.472618 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1305/2596] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:36:14 2022] DELETE /identity/v3/users/b3a5f02b1d3c487a9ee74c4f282da9a7 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 01:36:14.476083 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b530ecc6-2d6f-478f-8e7e-e0cae03d386e admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:14.535346 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc98ebe-605f-49eb-951f-e68d7ee6a090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:14.536050 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc98ebe-605f-49eb-951f-e68d7ee6a090 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:14.536324 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc98ebe-605f-49eb-951f-e68d7ee6a090 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:14.536613 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc98ebe-605f-49eb-951f-e68d7ee6a090 admin admin] PATH_INFO: `/v3/projects/afa47ad8a60b4cfca0f34dfe66516a4e/users/addd7b9dd0444793a494bc743c9dbfd6/roles/13af81971c1c428eae0a571a22ea583d` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:14.552336 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc98ebe-605f-49eb-951f-e68d7ee6a090 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afa47ad8a60b4cfca0f34dfe66516a4e, user_id=addd7b9dd0444793a494bc743c9dbfd6, role_id=13af81971c1c428eae0a571a22ea583d)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:14.555031 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc98ebe-605f-49eb-951f-e68d7ee6a090 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:14.568779 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1292/2597] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:36:14 2022] PUT /identity/v3/projects/afa47ad8a60b4cfca0f34dfe66516a4e/users/addd7b9dd0444793a494bc743c9dbfd6/roles/13af81971c1c428eae0a571a22ea583d => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 01:36:14.580904 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b87082-d4b9-48cd-85f5-c28ffef8a3a2 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:14.581400 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b87082-d4b9-48cd-85f5-c28ffef8a3a2 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:14.581732 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b87082-d4b9-48cd-85f5-c28ffef8a3a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:14.612461 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-b6b87082-d4b9-48cd-85f5-c28ffef8a3a2 None None] MFA Rules not processed for user `addd7b9dd0444793a494bc743c9dbfd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:36:14.613771 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-b6b87082-d4b9-48cd-85f5-c28ffef8a3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:14.687950 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1306/2598] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:36:14 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:36:14.692531 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc98ebe-605f-49eb-951f-e68d7ee6a090 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:14.736235 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:36:14.753393 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b87082-d4b9-48cd-85f5-c28ffef8a3a2 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:14.755421 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-b6b87082-d4b9-48cd-85f5-c28ffef8a3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:14.763570 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc98ebe-605f-49eb-951f-e68d7ee6a090 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:14.770576 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b87082-d4b9-48cd-85f5-c28ffef8a3a2 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:14.773979 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debfb065-8566-4112-bc76-42fe040fc9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:14.774658 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debfb065-8566-4112-bc76-42fe040fc9c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:14.774943 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debfb065-8566-4112-bc76-42fe040fc9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:14.775217 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debfb065-8566-4112-bc76-42fe040fc9c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:14.775824 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc1c365-07bd-42c1-b74e-df28b92b59b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:14.776026 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debfb065-8566-4112-bc76-42fe040fc9c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:14.776545 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc1c365-07bd-42c1-b74e-df28b92b59b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:14.777545 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc1c365-07bd-42c1-b74e-df28b92b59b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:14.777866 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc1c365-07bd-42c1-b74e-df28b92b59b4 admin admin] PATH_INFO: `/v3/projects/f1549e590a3e4ba9950780802b16ea9a` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:14.777970 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debfb065-8566-4112-bc76-42fe040fc9c7 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:14.779134 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc1c365-07bd-42c1-b74e-df28b92b59b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1549e590a3e4ba9950780802b16ea9a)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:14.781085 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc1c365-07bd-42c1-b74e-df28b92b59b4 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:14.821004 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1293/2599] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:36:14 2022] POST /identity/v3/projects => generated 355 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:36:14.822012 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debfb065-8566-4112-bc76-42fe040fc9c7 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:14.838625 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-3cc1c365-07bd-42c1-b74e-df28b92b59b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1549e590a3e4ba9950780802b16ea9a', 'request_id': 'req-3cc1c365-07bd-42c1-b74e-df28b92b59b4'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:14.845667 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-3cc1c365-07bd-42c1-b74e-df28b92b59b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1549e590a3e4ba9950780802b16ea9a', 'request_id': 'req-3cc1c365-07bd-42c1-b74e-df28b92b59b4'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:14.852229 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-3cc1c365-07bd-42c1-b74e-df28b92b59b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1549e590a3e4ba9950780802b16ea9a', 'request_id': 'req-3cc1c365-07bd-42c1-b74e-df28b92b59b4'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:14.865697 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-3cc1c365-07bd-42c1-b74e-df28b92b59b4 admin admin] The token cache is being invalidate because project f1549e590a3e4ba9950780802b16ea9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:36:14.866000 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-3cc1c365-07bd-42c1-b74e-df28b92b59b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:14.867244 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-3cc1c365-07bd-42c1-b74e-df28b92b59b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:14.869457 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1307/2600] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:36:14 2022] DELETE /identity/v3/projects/f1549e590a3e4ba9950780802b16ea9a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:36:14.875112 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef50abb-4d46-4871-b993-590a0c60447b None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:14.875485 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef50abb-4d46-4871-b993-590a0c60447b None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:14.875823 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef50abb-4d46-4871-b993-590a0c60447b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:14.887998 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debfb065-8566-4112-bc76-42fe040fc9c7 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:14.897124 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-8ef50abb-4d46-4871-b993-590a0c60447b None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:36:14.898392 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-8ef50abb-4d46-4871-b993-590a0c60447b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:14.947141 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ae965b-6fe3-4cad-a5c7-272a44d44c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:14.947663 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae965b-6fe3-4cad-a5c7-272a44d44c92 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:14.948066 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae965b-6fe3-4cad-a5c7-272a44d44c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:14.948341 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae965b-6fe3-4cad-a5c7-272a44d44c92 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:14.949050 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ae965b-6fe3-4cad-a5c7-272a44d44c92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:14.949476 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:36:14.951118 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ae965b-6fe3-4cad-a5c7-272a44d44c92 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:14.964473 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1308/2601] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:36:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:36:14.974225 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb9188-f1a7-4f22-a907-7b36732a7892 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:14.974851 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb9188-f1a7-4f22-a907-7b36732a7892 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:14.974989 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1294/2602] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:36:14 2022] POST /identity/v3/users => generated 284 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 01:36:14.975220 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb9188-f1a7-4f22-a907-7b36732a7892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:14.979005 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ae965b-6fe3-4cad-a5c7-272a44d44c92 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:14.980763 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-44ae965b-6fe3-4cad-a5c7-272a44d44c92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:14.992462 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ae965b-6fe3-4cad-a5c7-272a44d44c92 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:14.995811 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-dddb9188-f1a7-4f22-a907-7b36732a7892 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:36:14.997025 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-dddb9188-f1a7-4f22-a907-7b36732a7892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:14.997475 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b818355d-c000-4efb-9b11-4b32a52b619c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:14.998078 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818355d-c000-4efb-9b11-4b32a52b619c admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:14.998396 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818355d-c000-4efb-9b11-4b32a52b619c admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:14.998663 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818355d-c000-4efb-9b11-4b32a52b619c admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:14.999316 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b818355d-c000-4efb-9b11-4b32a52b619c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:15.000959 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b818355d-c000-4efb-9b11-4b32a52b619c admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:15.005187 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1309/2603] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:36:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 01:36:15.009700 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddb9188-f1a7-4f22-a907-7b36732a7892 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:15.014026 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1295/2604] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:36:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 01:36:15.015765 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b818355d-c000-4efb-9b11-4b32a52b619c admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:15.019795 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddb9188-f1a7-4f22-a907-7b36732a7892 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:15.024815 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c6bfb2-c35a-4e97-909f-bfe4916b49be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:15.025417 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c6bfb2-c35a-4e97-909f-bfe4916b49be admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:15.025691 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c6bfb2-c35a-4e97-909f-bfe4916b49be admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:15.025954 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c6bfb2-c35a-4e97-909f-bfe4916b49be admin admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:15.026777 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c6bfb2-c35a-4e97-909f-bfe4916b49be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:36:15.026975 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b818355d-c000-4efb-9b11-4b32a52b619c admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:15.027163 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c6bfb2-c35a-4e97-909f-bfe4916b49be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:15.028816 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c6bfb2-c35a-4e97-909f-bfe4916b49be admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:15.032439 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3e2496-0d0e-4081-a61b-cc9c10ccdc70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:15.033125 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e2496-0d0e-4081-a61b-cc9c10ccdc70 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:15.033401 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e2496-0d0e-4081-a61b-cc9c10ccdc70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:15.033673 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e2496-0d0e-4081-a61b-cc9c10ccdc70 admin admin] PATH_INFO: `/v3/projects/1c4f910fd3a943f2a6da9d8b9660cdc7/users/5c1df28a75b245de8bd0666202a99a21/roles/fb48693810be495fb4b1893a79429b78` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:15.041041 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1310/2605] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 01:36:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:36:15.045677 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c6bfb2-c35a-4e97-909f-bfe4916b49be admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:15.048725 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3e2496-0d0e-4081-a61b-cc9c10ccdc70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c4f910fd3a943f2a6da9d8b9660cdc7, user_id=5c1df28a75b245de8bd0666202a99a21, role_id=fb48693810be495fb4b1893a79429b78)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:15.051450 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3e2496-0d0e-4081-a61b-cc9c10ccdc70 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:15.055399 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c6bfb2-c35a-4e97-909f-bfe4916b49be admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:15.061116 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02209713-203b-41f6-97c1-5637f60e9aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:15.061890 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02209713-203b-41f6-97c1-5637f60e9aee admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:15.062212 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02209713-203b-41f6-97c1-5637f60e9aee admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:15.062558 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02209713-203b-41f6-97c1-5637f60e9aee admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:15.063362 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02209713-203b-41f6-97c1-5637f60e9aee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:15.065240 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02209713-203b-41f6-97c1-5637f60e9aee admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:15.066871 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1296/2606] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:36:15 2022] PUT /identity/v3/projects/1c4f910fd3a943f2a6da9d8b9660cdc7/users/5c1df28a75b245de8bd0666202a99a21/roles/fb48693810be495fb4b1893a79429b78 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 01:36:15.070957 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3e2496-0d0e-4081-a61b-cc9c10ccdc70 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:15.098158 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1311/2607] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:36:15 2022] POST /identity/v3/projects => generated 363 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 01:36:15.098457 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:36:15.099263 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02209713-203b-41f6-97c1-5637f60e9aee admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:15.139104 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3e2496-0d0e-4081-a61b-cc9c10ccdc70 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:15.168207 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02209713-203b-41f6-97c1-5637f60e9aee admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:15.172874 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c4bb26-78bc-4f33-a34a-715b50f85329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:15.173503 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4bb26-78bc-4f33-a34a-715b50f85329 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:15.173778 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4bb26-78bc-4f33-a34a-715b50f85329 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:15.174058 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4bb26-78bc-4f33-a34a-715b50f85329 admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:15.174724 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c4bb26-78bc-4f33-a34a-715b50f85329 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:15.176620 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c4bb26-78bc-4f33-a34a-715b50f85329 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:15.199691 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3381ab6-06db-4886-aa57-a3628c179aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:15.200236 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3381ab6-06db-4886-aa57-a3628c179aee admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:15.200514 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3381ab6-06db-4886-aa57-a3628c179aee admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:15.200782 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3381ab6-06db-4886-aa57-a3628c179aee admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:15.204447 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1312/2608] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:36:15 2022] POST /identity/v3/users => generated 282 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:36:15.204597 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3381ab6-06db-4886-aa57-a3628c179aee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:15.204597 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3381ab6-06db-4886-aa57-a3628c179aee admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:15.206150 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c4bb26-78bc-4f33-a34a-715b50f85329 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:15.213672 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1297/2609] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:36:15 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 01:36:15.217485 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c4bb26-78bc-4f33-a34a-715b50f85329 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:15.218257 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3381ab6-06db-4886-aa57-a3628c179aee admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:15.222687 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f236de-fc4e-4272-86fb-04f5b05cd0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:15.223258 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f236de-fc4e-4272-86fb-04f5b05cd0d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:15.223529 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f236de-fc4e-4272-86fb-04f5b05cd0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:15.223794 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f236de-fc4e-4272-86fb-04f5b05cd0d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:15.224431 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f236de-fc4e-4272-86fb-04f5b05cd0d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:15.226001 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f236de-fc4e-4272-86fb-04f5b05cd0d3 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:15.227775 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3381ab6-06db-4886-aa57-a3628c179aee admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:15.233004 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f46858-3bfb-4e16-8cda-ad93d0980bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:15.233642 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f46858-3bfb-4e16-8cda-ad93d0980bf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:15.233914 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f46858-3bfb-4e16-8cda-ad93d0980bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:15.234200 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f46858-3bfb-4e16-8cda-ad93d0980bf7 admin admin] PATH_INFO: `/v3/projects/1c4f910fd3a943f2a6da9d8b9660cdc7/users/5c1df28a75b245de8bd0666202a99a21/roles/fb48693810be495fb4b1893a79429b78` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:15.236100 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f46858-3bfb-4e16-8cda-ad93d0980bf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c4f910fd3a943f2a6da9d8b9660cdc7, user_id=5c1df28a75b245de8bd0666202a99a21, role_id=fb48693810be495fb4b1893a79429b78)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:15.236304 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1313/2610] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:36:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:36:15.238771 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f46858-3bfb-4e16-8cda-ad93d0980bf7 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:15.240178 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f236de-fc4e-4272-86fb-04f5b05cd0d3 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:15.249865 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1298/2611] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:36:15 2022] PUT /identity/v3/projects/1c4f910fd3a943f2a6da9d8b9660cdc7/users/5c1df28a75b245de8bd0666202a99a21/roles/fb48693810be495fb4b1893a79429b78 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:36:15.250023 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f236de-fc4e-4272-86fb-04f5b05cd0d3 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:15.260744 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36112817-4125-420d-9402-0d6f2460dc68 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:15.261079 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36112817-4125-420d-9402-0d6f2460dc68 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:15.261990 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36112817-4125-420d-9402-0d6f2460dc68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:15.293249 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-36112817-4125-420d-9402-0d6f2460dc68 None None] MFA Rules not processed for user `5c1df28a75b245de8bd0666202a99a21`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:36:15.294937 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-36112817-4125-420d-9402-0d6f2460dc68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:15.307712 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91853dbf-23b5-4f7f-b503-ee831fa4503c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:15.309119 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91853dbf-23b5-4f7f-b503-ee831fa4503c admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:15.309432 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91853dbf-23b5-4f7f-b503-ee831fa4503c admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:15.309768 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91853dbf-23b5-4f7f-b503-ee831fa4503c admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:15.310543 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91853dbf-23b5-4f7f-b503-ee831fa4503c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:15.312235 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91853dbf-23b5-4f7f-b503-ee831fa4503c admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:15.327043 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1314/2612] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:36:15 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 01:36:15.331380 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91853dbf-23b5-4f7f-b503-ee831fa4503c admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:15.342003 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91853dbf-23b5-4f7f-b503-ee831fa4503c admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:15.346943 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243e885d-fdb1-4c0d-b074-1da1651218d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:15.347605 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e885d-fdb1-4c0d-b074-1da1651218d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:15.347899 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e885d-fdb1-4c0d-b074-1da1651218d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:15.348153 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e885d-fdb1-4c0d-b074-1da1651218d3 admin admin] PATH_INFO: `/v3/projects/07deee95d6034915bfb0d54914035278/users/aae5fe967a6748c4aa4bba59cdbe34f4/roles/13af81971c1c428eae0a571a22ea583d` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:15.364361 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243e885d-fdb1-4c0d-b074-1da1651218d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07deee95d6034915bfb0d54914035278, user_id=aae5fe967a6748c4aa4bba59cdbe34f4, role_id=13af81971c1c428eae0a571a22ea583d)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:15.367176 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243e885d-fdb1-4c0d-b074-1da1651218d3 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:15.379742 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1299/2613] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:36:15 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 01:36:15.383197 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1315/2614] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:36:15 2022] PUT /identity/v3/projects/07deee95d6034915bfb0d54914035278/users/aae5fe967a6748c4aa4bba59cdbe34f4/roles/13af81971c1c428eae0a571a22ea583d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:36:15.396562 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36112817-4125-420d-9402-0d6f2460dc68 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:15.399061 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-36112817-4125-420d-9402-0d6f2460dc68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:15.454041 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea74f5-17f3-482d-9645-19968049447e None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:15.454290 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea74f5-17f3-482d-9645-19968049447e None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:15.454502 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea74f5-17f3-482d-9645-19968049447e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:15.454613 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:36:15.463726 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:36:15.485418 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36112817-4125-420d-9402-0d6f2460dc68 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:15.491716 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-9aea74f5-17f3-482d-9645-19968049447e None None] MFA Rules not processed for user `aae5fe967a6748c4aa4bba59cdbe34f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:36:15.494021 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-9aea74f5-17f3-482d-9645-19968049447e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:15.550794 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ff90e8-f3ce-4813-aabc-0e367aacc801 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7853d40c29af424c8d7913950d89750b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:15.551716 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff90e8-f3ce-4813-aabc-0e367aacc801 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:15.552058 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff90e8-f3ce-4813-aabc-0e367aacc801 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:15.552425 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff90e8-f3ce-4813-aabc-0e367aacc801 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:15.564625 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1316/2615] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:36:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 01:36:15.576901 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aea74f5-17f3-482d-9645-19968049447e None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:15.578931 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-9aea74f5-17f3-482d-9645-19968049447e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:15.598777 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aea74f5-17f3-482d-9645-19968049447e None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:15.603784 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c84391c-e152-4366-b730-d60b5fe79f8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7853d40c29af424c8d7913950d89750b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:15.604629 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c84391c-e152-4366-b730-d60b5fe79f8b service cinder] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:15.604942 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c84391c-e152-4366-b730-d60b5fe79f8b service cinder] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:15.605282 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c84391c-e152-4366-b730-d60b5fe79f8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:15.616542 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c84391c-e152-4366-b730-d60b5fe79f8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:15.617976 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c84391c-e152-4366-b730-d60b5fe79f8b service cinder] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:15.627271 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ff90e8-f3ce-4813-aabc-0e367aacc801 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:15.628838 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ff90e8-f3ce-4813-aabc-0e367aacc801 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:15.629671 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1317/2616] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:36:15 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 01:36:15.639656 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1300/2617] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:36:15 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:36:15.725216 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c84391c-e152-4366-b730-d60b5fe79f8b service cinder] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:15.734734 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c84391c-e152-4366-b730-d60b5fe79f8b service cinder] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:15.738700 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674fafc3-829b-46fa-8868-beae548bd56c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7853d40c29af424c8d7913950d89750b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:15.739330 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674fafc3-829b-46fa-8868-beae548bd56c service cinder] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:15.739607 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674fafc3-829b-46fa-8868-beae548bd56c service cinder] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:15.740032 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674fafc3-829b-46fa-8868-beae548bd56c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:15.741884 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-674fafc3-829b-46fa-8868-beae548bd56c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:15.814455 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674fafc3-829b-46fa-8868-beae548bd56c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:15.816050 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674fafc3-829b-46fa-8868-beae548bd56c service cinder] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:15.829357 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1318/2618] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:36:15 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:36:25.634479 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=53 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:36:25.822400 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=65 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:36:30.938982 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ff90e8-f3ce-4813-aabc-0e367aacc801 service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:31.009488 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ff90e8-f3ce-4813-aabc-0e367aacc801 service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:31.014659 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba736ecf-f9b2-4c53-ab74-c50a0ddc975d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:31.015304 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba736ecf-f9b2-4c53-ab74-c50a0ddc975d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:31.015575 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba736ecf-f9b2-4c53-ab74-c50a0ddc975d admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:31.015836 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba736ecf-f9b2-4c53-ab74-c50a0ddc975d admin admin] PATH_INFO: `/v3/users/addd7b9dd0444793a494bc743c9dbfd6` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:31.017034 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba736ecf-f9b2-4c53-ab74-c50a0ddc975d admin admin] RBAC: Authorizing `identity:delete_user(user_id=addd7b9dd0444793a494bc743c9dbfd6)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:31.019054 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba736ecf-f9b2-4c53-ab74-c50a0ddc975d admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:31.074869 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ba736ecf-f9b2-4c53-ab74-c50a0ddc975d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'addd7b9dd0444793a494bc743c9dbfd6'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:31.083574 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ba736ecf-f9b2-4c53-ab74-c50a0ddc975d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'addd7b9dd0444793a494bc743c9dbfd6'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:31.084174 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ba736ecf-f9b2-4c53-ab74-c50a0ddc975d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'addd7b9dd0444793a494bc743c9dbfd6'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:31.091516 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ba736ecf-f9b2-4c53-ab74-c50a0ddc975d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'addd7b9dd0444793a494bc743c9dbfd6'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:31.106976 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ba736ecf-f9b2-4c53-ab74-c50a0ddc975d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'addd7b9dd0444793a494bc743c9dbfd6'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:31.113871 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1301/2619] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:36:30 2022] DELETE /identity/v3/users/addd7b9dd0444793a494bc743c9dbfd6 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:36:31.118691 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248687c6-7962-4544-aa75-77f1223c2f93 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:31.119157 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248687c6-7962-4544-aa75-77f1223c2f93 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:31.119251 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248687c6-7962-4544-aa75-77f1223c2f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:31.140475 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-248687c6-7962-4544-aa75-77f1223c2f93 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:36:31.141681 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-248687c6-7962-4544-aa75-77f1223c2f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:31.204964 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1319/2620] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:36:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:36:31.219089 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba736ecf-f9b2-4c53-ab74-c50a0ddc975d admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:31.220704 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-ba736ecf-f9b2-4c53-ab74-c50a0ddc975d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:31.289209 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba736ecf-f9b2-4c53-ab74-c50a0ddc975d admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:31.292812 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27060b7-9143-44df-80b8-24e76669eda5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:31.293506 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27060b7-9143-44df-80b8-24e76669eda5 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:31.293783 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27060b7-9143-44df-80b8-24e76669eda5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:31.294049 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27060b7-9143-44df-80b8-24e76669eda5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:31.303668 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27060b7-9143-44df-80b8-24e76669eda5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:31.305459 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27060b7-9143-44df-80b8-24e76669eda5 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:31.324156 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1302/2621] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:36:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:36:31.633270 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248687c6-7962-4544-aa75-77f1223c2f93 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:31.635133 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-248687c6-7962-4544-aa75-77f1223c2f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:31.648645 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248687c6-7962-4544-aa75-77f1223c2f93 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:31.653603 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7f747d-72c0-4d97-98e6-19ca75f7254e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:31.654319 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f747d-72c0-4d97-98e6-19ca75f7254e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:31.654592 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f747d-72c0-4d97-98e6-19ca75f7254e admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:31.654858 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f747d-72c0-4d97-98e6-19ca75f7254e admin admin] PATH_INFO: `/v3/projects/afa47ad8a60b4cfca0f34dfe66516a4e` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:31.656025 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7f747d-72c0-4d97-98e6-19ca75f7254e admin admin] RBAC: Authorizing `identity:delete_project(project_id=afa47ad8a60b4cfca0f34dfe66516a4e)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:31.657920 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7f747d-72c0-4d97-98e6-19ca75f7254e admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:31.707214 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-6c7f747d-72c0-4d97-98e6-19ca75f7254e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afa47ad8a60b4cfca0f34dfe66516a4e', 'request_id': 'req-6c7f747d-72c0-4d97-98e6-19ca75f7254e'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:31.712623 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-6c7f747d-72c0-4d97-98e6-19ca75f7254e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afa47ad8a60b4cfca0f34dfe66516a4e', 'request_id': 'req-6c7f747d-72c0-4d97-98e6-19ca75f7254e'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:31.719296 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-6c7f747d-72c0-4d97-98e6-19ca75f7254e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afa47ad8a60b4cfca0f34dfe66516a4e', 'request_id': 'req-6c7f747d-72c0-4d97-98e6-19ca75f7254e'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:31.736293 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-6c7f747d-72c0-4d97-98e6-19ca75f7254e admin admin] The token cache is being invalidate because project afa47ad8a60b4cfca0f34dfe66516a4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:36:31.736598 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-6c7f747d-72c0-4d97-98e6-19ca75f7254e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:31.737242 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-6c7f747d-72c0-4d97-98e6-19ca75f7254e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:31.742071 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1320/2622] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:36:31 2022] DELETE /identity/v3/projects/afa47ad8a60b4cfca0f34dfe66516a4e => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:36:31.743088 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27060b7-9143-44df-80b8-24e76669eda5 service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:31.753459 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27060b7-9143-44df-80b8-24e76669eda5 service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:31.772444 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:36:31.824414 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b84a686-02ba-4a4e-9539-03d1fe19f62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:31.824988 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b84a686-02ba-4a4e-9539-03d1fe19f62c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:31.825260 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b84a686-02ba-4a4e-9539-03d1fe19f62c admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:31.825609 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b84a686-02ba-4a4e-9539-03d1fe19f62c admin admin] PATH_INFO: `/v3/users/5c1df28a75b245de8bd0666202a99a21` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:31.826836 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b84a686-02ba-4a4e-9539-03d1fe19f62c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c1df28a75b245de8bd0666202a99a21)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:31.828757 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b84a686-02ba-4a4e-9539-03d1fe19f62c admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:31.881304 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7b84a686-02ba-4a4e-9539-03d1fe19f62c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c1df28a75b245de8bd0666202a99a21'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:31.890232 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7b84a686-02ba-4a4e-9539-03d1fe19f62c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c1df28a75b245de8bd0666202a99a21'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:31.890882 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7b84a686-02ba-4a4e-9539-03d1fe19f62c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c1df28a75b245de8bd0666202a99a21'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:31.899478 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7b84a686-02ba-4a4e-9539-03d1fe19f62c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c1df28a75b245de8bd0666202a99a21'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:31.915642 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7b84a686-02ba-4a4e-9539-03d1fe19f62c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c1df28a75b245de8bd0666202a99a21'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:31.922654 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1303/2623] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:36:31 2022] DELETE /identity/v3/users/5c1df28a75b245de8bd0666202a99a21 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:36:32.212980 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7f747d-72c0-4d97-98e6-19ca75f7254e admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:32.214834 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-6c7f747d-72c0-4d97-98e6-19ca75f7254e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:32.228966 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7f747d-72c0-4d97-98e6-19ca75f7254e admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:32.296460 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e61a61-6864-4edf-bae9-38e2541c859b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:32.297141 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e61a61-6864-4edf-bae9-38e2541c859b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:32.297450 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e61a61-6864-4edf-bae9-38e2541c859b admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:32.297866 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e61a61-6864-4edf-bae9-38e2541c859b admin admin] PATH_INFO: `/v3/projects/1c4f910fd3a943f2a6da9d8b9660cdc7` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:32.299186 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e61a61-6864-4edf-bae9-38e2541c859b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c4f910fd3a943f2a6da9d8b9660cdc7)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:32.301264 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e61a61-6864-4edf-bae9-38e2541c859b admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:32.354230 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:36:32.375041 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-f3e61a61-6864-4edf-bae9-38e2541c859b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c4f910fd3a943f2a6da9d8b9660cdc7', 'request_id': 'req-f3e61a61-6864-4edf-bae9-38e2541c859b'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:32.384984 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-f3e61a61-6864-4edf-bae9-38e2541c859b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c4f910fd3a943f2a6da9d8b9660cdc7', 'request_id': 'req-f3e61a61-6864-4edf-bae9-38e2541c859b'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:32.394300 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-f3e61a61-6864-4edf-bae9-38e2541c859b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c4f910fd3a943f2a6da9d8b9660cdc7', 'request_id': 'req-f3e61a61-6864-4edf-bae9-38e2541c859b'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:32.411167 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-f3e61a61-6864-4edf-bae9-38e2541c859b admin admin] The token cache is being invalidate because project 1c4f910fd3a943f2a6da9d8b9660cdc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:36:32.411839 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-f3e61a61-6864-4edf-bae9-38e2541c859b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:32.412724 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-f3e61a61-6864-4edf-bae9-38e2541c859b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:32.418411 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1321/2624] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:36:32 2022] DELETE /identity/v3/projects/1c4f910fd3a943f2a6da9d8b9660cdc7 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:36:32.421549 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5763bb-e701-4a3d-8df9-af0f70d4997c None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:32.422046 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5763bb-e701-4a3d-8df9-af0f70d4997c None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:32.422326 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5763bb-e701-4a3d-8df9-af0f70d4997c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:32.446960 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-ca5763bb-e701-4a3d-8df9-af0f70d4997c None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:36:32.448267 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-ca5763bb-e701-4a3d-8df9-af0f70d4997c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:32.520002 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1304/2625] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:36:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:36:32.528188 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411b3a6-ead8-4f8e-8d14-4a942c28fddb None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:32.528853 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411b3a6-ead8-4f8e-8d14-4a942c28fddb None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:32.529145 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411b3a6-ead8-4f8e-8d14-4a942c28fddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:32.549807 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-9411b3a6-ead8-4f8e-8d14-4a942c28fddb None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:36:32.551088 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-9411b3a6-ead8-4f8e-8d14-4a942c28fddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:32.559739 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1322/2626] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:36:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:36:32.564119 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5763bb-e701-4a3d-8df9-af0f70d4997c None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:32.574033 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5763bb-e701-4a3d-8df9-af0f70d4997c None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:32.579384 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fabc1f-991d-4859-a87c-0c00f5deab26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:32.579763 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fabc1f-991d-4859-a87c-0c00f5deab26 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:32.580069 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fabc1f-991d-4859-a87c-0c00f5deab26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:32.580323 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fabc1f-991d-4859-a87c-0c00f5deab26 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:32.581013 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fabc1f-991d-4859-a87c-0c00f5deab26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:36:32.581366 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fabc1f-991d-4859-a87c-0c00f5deab26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:32.582981 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fabc1f-991d-4859-a87c-0c00f5deab26 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:32.596459 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1305/2627] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 01:36:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:36:32.600902 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9411b3a6-ead8-4f8e-8d14-4a942c28fddb None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:32.620435 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9411b3a6-ead8-4f8e-8d14-4a942c28fddb None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:32.625562 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28978ad1-9eb0-4e19-aa30-410018010323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:32.626211 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28978ad1-9eb0-4e19-aa30-410018010323 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:32.626487 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28978ad1-9eb0-4e19-aa30-410018010323 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:32.626755 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28978ad1-9eb0-4e19-aa30-410018010323 admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:32.627387 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28978ad1-9eb0-4e19-aa30-410018010323 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:32.629269 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28978ad1-9eb0-4e19-aa30-410018010323 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:32.673261 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1323/2628] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:36:32 2022] POST /identity/v3/projects => generated 365 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:36:32.687956 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fabc1f-991d-4859-a87c-0c00f5deab26 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:32.701812 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fabc1f-991d-4859-a87c-0c00f5deab26 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:32.747068 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:36:32.798045 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d589987-966e-4e59-8e1d-5bbfba2937f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:32.798844 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d589987-966e-4e59-8e1d-5bbfba2937f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:32.799189 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d589987-966e-4e59-8e1d-5bbfba2937f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:32.799562 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d589987-966e-4e59-8e1d-5bbfba2937f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:32.800475 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d589987-966e-4e59-8e1d-5bbfba2937f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:32.803378 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d589987-966e-4e59-8e1d-5bbfba2937f6 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:32.837821 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1306/2629] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:36:32 2022] POST /identity/v3/users => generated 283 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:36:32.841714 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28978ad1-9eb0-4e19-aa30-410018010323 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:32.855901 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28978ad1-9eb0-4e19-aa30-410018010323 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:32.861541 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b6d542-e275-4896-9eae-5515fbfae65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:32.862245 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b6d542-e275-4896-9eae-5515fbfae65f admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:32.862522 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b6d542-e275-4896-9eae-5515fbfae65f admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:32.862786 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b6d542-e275-4896-9eae-5515fbfae65f admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:32.863647 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b6d542-e275-4896-9eae-5515fbfae65f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:32.865328 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b6d542-e275-4896-9eae-5515fbfae65f admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:32.880610 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1324/2630] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:36:32 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 01:36:32.884943 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d589987-966e-4e59-8e1d-5bbfba2937f6 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:32.895039 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d589987-966e-4e59-8e1d-5bbfba2937f6 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:32.900405 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6ed0b2-e3f8-4aed-8c90-01fad7c5c9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:32.901152 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ed0b2-e3f8-4aed-8c90-01fad7c5c9d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:32.901389 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ed0b2-e3f8-4aed-8c90-01fad7c5c9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:32.901802 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ed0b2-e3f8-4aed-8c90-01fad7c5c9d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:32.902508 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6ed0b2-e3f8-4aed-8c90-01fad7c5c9d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:32.904511 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6ed0b2-e3f8-4aed-8c90-01fad7c5c9d4 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:32.920118 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1307/2631] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:36:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 01:36:32.924353 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b6d542-e275-4896-9eae-5515fbfae65f admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:32.935177 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b6d542-e275-4896-9eae-5515fbfae65f admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:32.940315 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb0bc2-f7de-4cd5-8ac2-0594968c323f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:32.940970 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb0bc2-f7de-4cd5-8ac2-0594968c323f admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:32.941243 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb0bc2-f7de-4cd5-8ac2-0594968c323f admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:32.941563 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb0bc2-f7de-4cd5-8ac2-0594968c323f admin admin] PATH_INFO: `/v3/projects/22011285c26a4383b3f7dc523fc2523a/users/d68495ca1f104373b0a757269c2ffcba/roles/13af81971c1c428eae0a571a22ea583d` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:32.956282 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbb0bc2-f7de-4cd5-8ac2-0594968c323f admin admin] RBAC: Authorizing `identity:create_grant(project_id=22011285c26a4383b3f7dc523fc2523a, user_id=d68495ca1f104373b0a757269c2ffcba, role_id=13af81971c1c428eae0a571a22ea583d)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:32.958933 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbb0bc2-f7de-4cd5-8ac2-0594968c323f admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:32.972465 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1325/2632] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:36:32 2022] PUT /identity/v3/projects/22011285c26a4383b3f7dc523fc2523a/users/d68495ca1f104373b0a757269c2ffcba/roles/13af81971c1c428eae0a571a22ea583d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:36:32.983385 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880adb2-fecc-4065-ae08-8ce273b312fe None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:32.983673 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880adb2-fecc-4065-ae08-8ce273b312fe None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:32.983973 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880adb2-fecc-4065-ae08-8ce273b312fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:33.020558 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-8880adb2-fecc-4065-ae08-8ce273b312fe None None] MFA Rules not processed for user `d68495ca1f104373b0a757269c2ffcba`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:36:33.021806 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-8880adb2-fecc-4065-ae08-8ce273b312fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:33.095965 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1308/2633] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:36:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:36:33.100512 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb0bc2-f7de-4cd5-8ac2-0594968c323f admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:33.175207 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb0bc2-f7de-4cd5-8ac2-0594968c323f admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:33.180783 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbde03d6-05dc-4210-9aea-20e2c00b6a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:33.181610 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde03d6-05dc-4210-9aea-20e2c00b6a45 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:33.181749 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde03d6-05dc-4210-9aea-20e2c00b6a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:33.182022 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde03d6-05dc-4210-9aea-20e2c00b6a45 admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:33.182724 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbde03d6-05dc-4210-9aea-20e2c00b6a45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:33.185304 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbde03d6-05dc-4210-9aea-20e2c00b6a45 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:33.222883 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1326/2634] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:36:33 2022] POST /identity/v3/projects => generated 365 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:36:33.227441 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8880adb2-fecc-4065-ae08-8ce273b312fe None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:33.241852 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8880adb2-fecc-4065-ae08-8ce273b312fe None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:33.307201 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c83436-a691-40dd-bde3-5e7c5bd00efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:33.307913 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c83436-a691-40dd-bde3-5e7c5bd00efb admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:33.308266 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c83436-a691-40dd-bde3-5e7c5bd00efb admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:33.308593 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c83436-a691-40dd-bde3-5e7c5bd00efb admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:33.309295 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c83436-a691-40dd-bde3-5e7c5bd00efb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:33.311453 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c83436-a691-40dd-bde3-5e7c5bd00efb admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:33.337575 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1309/2635] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:36:33 2022] POST /identity/v3/users => generated 289 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 01:36:33.341742 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbde03d6-05dc-4210-9aea-20e2c00b6a45 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:33.359491 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbde03d6-05dc-4210-9aea-20e2c00b6a45 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:33.365288 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8092c16-e800-41f6-973d-9dd35cfc25ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:33.365947 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8092c16-e800-41f6-973d-9dd35cfc25ad admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:33.366262 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8092c16-e800-41f6-973d-9dd35cfc25ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:33.366532 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8092c16-e800-41f6-973d-9dd35cfc25ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:33.367188 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8092c16-e800-41f6-973d-9dd35cfc25ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:33.368950 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8092c16-e800-41f6-973d-9dd35cfc25ad admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:33.392304 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1327/2636] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:36:33 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:36:33.393778 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c83436-a691-40dd-bde3-5e7c5bd00efb admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:33.404735 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c83436-a691-40dd-bde3-5e7c5bd00efb admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:33.410434 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b353340b-559d-45d1-b99a-a285b0bc9518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:33.411448 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353340b-559d-45d1-b99a-a285b0bc9518 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:33.411728 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353340b-559d-45d1-b99a-a285b0bc9518 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:33.411994 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353340b-559d-45d1-b99a-a285b0bc9518 admin admin] PATH_INFO: `/v3/projects/84f9e052df144769ab6aa66ba949170c/users/abb6c0ada31e41019448768af69a9988/roles/fb48693810be495fb4b1893a79429b78` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:33.430546 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b353340b-559d-45d1-b99a-a285b0bc9518 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84f9e052df144769ab6aa66ba949170c, user_id=abb6c0ada31e41019448768af69a9988, role_id=fb48693810be495fb4b1893a79429b78)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:33.433245 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b353340b-559d-45d1-b99a-a285b0bc9518 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:33.450943 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1310/2637] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:36:33 2022] PUT /identity/v3/projects/84f9e052df144769ab6aa66ba949170c/users/abb6c0ada31e41019448768af69a9988/roles/fb48693810be495fb4b1893a79429b78 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 01:36:33.455424 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8092c16-e800-41f6-973d-9dd35cfc25ad admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:33.465718 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8092c16-e800-41f6-973d-9dd35cfc25ad admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:33.494794 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:36:33.543615 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ca4876-dbaa-458a-a03a-3dfdfba4fe93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:33.543615 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca4876-dbaa-458a-a03a-3dfdfba4fe93 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:33.543615 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca4876-dbaa-458a-a03a-3dfdfba4fe93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:33.543615 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca4876-dbaa-458a-a03a-3dfdfba4fe93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:33.544730 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ca4876-dbaa-458a-a03a-3dfdfba4fe93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:33.544730 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ca4876-dbaa-458a-a03a-3dfdfba4fe93 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:33.561510 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1328/2638] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:36:33 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:36:33.564118 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b353340b-559d-45d1-b99a-a285b0bc9518 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:33.572534 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:36:33.578978 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b353340b-559d-45d1-b99a-a285b0bc9518 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:33.585357 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc248f11-9941-40f4-b89b-d42d58db01ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:33.586208 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc248f11-9941-40f4-b89b-d42d58db01ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:33.586568 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc248f11-9941-40f4-b89b-d42d58db01ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:33.586896 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc248f11-9941-40f4-b89b-d42d58db01ac admin admin] PATH_INFO: `/v3/projects/84f9e052df144769ab6aa66ba949170c/users/abb6c0ada31e41019448768af69a9988/roles/fb48693810be495fb4b1893a79429b78` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:33.589056 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc248f11-9941-40f4-b89b-d42d58db01ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=84f9e052df144769ab6aa66ba949170c, user_id=abb6c0ada31e41019448768af69a9988, role_id=fb48693810be495fb4b1893a79429b78)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:33.592455 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc248f11-9941-40f4-b89b-d42d58db01ac admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:33.607253 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1311/2639] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:36:33 2022] PUT /identity/v3/projects/84f9e052df144769ab6aa66ba949170c/users/abb6c0ada31e41019448768af69a9988/roles/fb48693810be495fb4b1893a79429b78 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:36:33.620036 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0095dd-3149-4d84-9bfe-0ddda0a94ddc None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:33.620036 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0095dd-3149-4d84-9bfe-0ddda0a94ddc None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:33.620036 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0095dd-3149-4d84-9bfe-0ddda0a94ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:33.656233 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-cb0095dd-3149-4d84-9bfe-0ddda0a94ddc None None] MFA Rules not processed for user `abb6c0ada31e41019448768af69a9988`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:36:33.658644 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-cb0095dd-3149-4d84-9bfe-0ddda0a94ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:33.767729 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1329/2640] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:36:33 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:36:33.780210 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc248f11-9941-40f4-b89b-d42d58db01ac admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:33.781932 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-dc248f11-9941-40f4-b89b-d42d58db01ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:33.849867 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc248f11-9941-40f4-b89b-d42d58db01ac admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:33.854747 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0642a23d-d87c-469b-8396-ecb5940b81ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7853d40c29af424c8d7913950d89750b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:33.855426 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0642a23d-d87c-469b-8396-ecb5940b81ec service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:33.855725 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0642a23d-d87c-469b-8396-ecb5940b81ec service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:33.855976 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0642a23d-d87c-469b-8396-ecb5940b81ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:33.867035 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0642a23d-d87c-469b-8396-ecb5940b81ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:33.868479 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0642a23d-d87c-469b-8396-ecb5940b81ec service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:33.879410 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1312/2641] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:36:33 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:36:33.970147 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0095dd-3149-4d84-9bfe-0ddda0a94ddc None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:33.979664 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0095dd-3149-4d84-9bfe-0ddda0a94ddc None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:33.983803 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314ece9e-dbc0-4a23-99c0-a331b827e8b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7853d40c29af424c8d7913950d89750b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:33.984407 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ece9e-dbc0-4a23-99c0-a331b827e8b1 service cinder] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:33.984683 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ece9e-dbc0-4a23-99c0-a331b827e8b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:33.984952 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ece9e-dbc0-4a23-99c0-a331b827e8b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:34.055610 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314ece9e-dbc0-4a23-99c0-a331b827e8b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:34.057390 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314ece9e-dbc0-4a23-99c0-a331b827e8b1 service cinder] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:34.066812 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1330/2642] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:36:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:36:36.921485 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0642a23d-d87c-469b-8396-ecb5940b81ec service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:36.923069 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-0642a23d-d87c-469b-8396-ecb5940b81ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:36.948482 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314ece9e-dbc0-4a23-99c0-a331b827e8b1 service cinder] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:36.984070 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0642a23d-d87c-469b-8396-ecb5940b81ec service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:36.987876 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a23c7-ca12-4f49-92ea-64df9787fd68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:36.988497 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a23c7-ca12-4f49-92ea-64df9787fd68 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:36.988769 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a23c7-ca12-4f49-92ea-64df9787fd68 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:36.989035 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a23c7-ca12-4f49-92ea-64df9787fd68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:36.990823 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-746a23c7-ca12-4f49-92ea-64df9787fd68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:36.997026 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:36:37.014992 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314ece9e-dbc0-4a23-99c0-a331b827e8b1 service cinder] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:37.019629 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab56b53-fa91-4525-befe-144f7c3a610f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:37.020246 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab56b53-fa91-4525-befe-144f7c3a610f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:37.020548 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab56b53-fa91-4525-befe-144f7c3a610f admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:37.020775 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab56b53-fa91-4525-befe-144f7c3a610f admin admin] PATH_INFO: `/v3/users/d68495ca1f104373b0a757269c2ffcba` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:37.021879 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab56b53-fa91-4525-befe-144f7c3a610f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d68495ca1f104373b0a757269c2ffcba)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:37.023762 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab56b53-fa91-4525-befe-144f7c3a610f admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:37.065606 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746a23c7-ca12-4f49-92ea-64df9787fd68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:37.067016 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746a23c7-ca12-4f49-92ea-64df9787fd68 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:37.077165 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1313/2643] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:36:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:36:37.079354 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-bab56b53-fa91-4525-befe-144f7c3a610f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd68495ca1f104373b0a757269c2ffcba'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:37.088556 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-bab56b53-fa91-4525-befe-144f7c3a610f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd68495ca1f104373b0a757269c2ffcba'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:37.089145 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-bab56b53-fa91-4525-befe-144f7c3a610f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd68495ca1f104373b0a757269c2ffcba'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:37.096471 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-bab56b53-fa91-4525-befe-144f7c3a610f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd68495ca1f104373b0a757269c2ffcba'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:37.112567 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-bab56b53-fa91-4525-befe-144f7c3a610f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd68495ca1f104373b0a757269c2ffcba'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:37.119332 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1331/2644] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:36:36 2022] DELETE /identity/v3/users/d68495ca1f104373b0a757269c2ffcba => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:36:37.123843 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f3963-7364-497d-8f30-5b037c9bd936 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:37.124128 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f3963-7364-497d-8f30-5b037c9bd936 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:37.124398 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f3963-7364-497d-8f30-5b037c9bd936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:37.145152 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-247f3963-7364-497d-8f30-5b037c9bd936 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:36:37.146410 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-247f3963-7364-497d-8f30-5b037c9bd936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:37.186426 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:36:37.217494 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1314/2645] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:36:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:36:37.227611 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab56b53-fa91-4525-befe-144f7c3a610f admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:37.229038 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-bab56b53-fa91-4525-befe-144f7c3a610f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:37.291548 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab56b53-fa91-4525-befe-144f7c3a610f admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:37.295308 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca06d102-dbe5-437b-a7e0-9be84350d1ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:37.295931 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca06d102-dbe5-437b-a7e0-9be84350d1ca service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:37.296210 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca06d102-dbe5-437b-a7e0-9be84350d1ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:37.296479 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca06d102-dbe5-437b-a7e0-9be84350d1ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:37.307213 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca06d102-dbe5-437b-a7e0-9be84350d1ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:37.308705 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca06d102-dbe5-437b-a7e0-9be84350d1ca service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:37.320070 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1332/2646] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:36:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:36:37.870233 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f3963-7364-497d-8f30-5b037c9bd936 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:37.871952 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-247f3963-7364-497d-8f30-5b037c9bd936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:37.885326 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f3963-7364-497d-8f30-5b037c9bd936 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:37.891258 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adc6289-1ba0-46f5-a229-7603cf48b413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:37.896870 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adc6289-1ba0-46f5-a229-7603cf48b413 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:37.897154 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adc6289-1ba0-46f5-a229-7603cf48b413 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:37.897415 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adc6289-1ba0-46f5-a229-7603cf48b413 admin admin] PATH_INFO: `/v3/projects/22011285c26a4383b3f7dc523fc2523a` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:37.899035 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adc6289-1ba0-46f5-a229-7603cf48b413 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22011285c26a4383b3f7dc523fc2523a)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:37.901017 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adc6289-1ba0-46f5-a229-7603cf48b413 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:37.960560 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7adc6289-1ba0-46f5-a229-7603cf48b413 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22011285c26a4383b3f7dc523fc2523a', 'request_id': 'req-7adc6289-1ba0-46f5-a229-7603cf48b413'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:37.972200 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7adc6289-1ba0-46f5-a229-7603cf48b413 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22011285c26a4383b3f7dc523fc2523a', 'request_id': 'req-7adc6289-1ba0-46f5-a229-7603cf48b413'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:37.979565 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7adc6289-1ba0-46f5-a229-7603cf48b413 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22011285c26a4383b3f7dc523fc2523a', 'request_id': 'req-7adc6289-1ba0-46f5-a229-7603cf48b413'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:37.993984 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7adc6289-1ba0-46f5-a229-7603cf48b413 admin admin] The token cache is being invalidate because project 22011285c26a4383b3f7dc523fc2523a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:36:37.994304 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7adc6289-1ba0-46f5-a229-7603cf48b413 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:37.994970 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7adc6289-1ba0-46f5-a229-7603cf48b413 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:37.996541 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1315/2647] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:36:37 2022] DELETE /identity/v3/projects/22011285c26a4383b3f7dc523fc2523a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:36:38.001316 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca06d102-dbe5-437b-a7e0-9be84350d1ca service neutron] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:38.011982 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca06d102-dbe5-437b-a7e0-9be84350d1ca service neutron] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:38.075448 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4ccd7c-c23d-4e71-a26c-6b18b5305bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:38.076095 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ccd7c-c23d-4e71-a26c-6b18b5305bab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:38.076386 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ccd7c-c23d-4e71-a26c-6b18b5305bab admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:38.076652 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ccd7c-c23d-4e71-a26c-6b18b5305bab admin admin] PATH_INFO: `/v3/users/abb6c0ada31e41019448768af69a9988` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:38.077933 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4ccd7c-c23d-4e71-a26c-6b18b5305bab admin admin] RBAC: Authorizing `identity:delete_user(user_id=abb6c0ada31e41019448768af69a9988)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:38.080005 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4ccd7c-c23d-4e71-a26c-6b18b5305bab admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:38.087341 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:36:38.139975 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-5f4ccd7c-c23d-4e71-a26c-6b18b5305bab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abb6c0ada31e41019448768af69a9988'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:38.150136 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-5f4ccd7c-c23d-4e71-a26c-6b18b5305bab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abb6c0ada31e41019448768af69a9988'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:38.150732 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-5f4ccd7c-c23d-4e71-a26c-6b18b5305bab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abb6c0ada31e41019448768af69a9988'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:38.160084 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-5f4ccd7c-c23d-4e71-a26c-6b18b5305bab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abb6c0ada31e41019448768af69a9988'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:38.173310 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-5f4ccd7c-c23d-4e71-a26c-6b18b5305bab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abb6c0ada31e41019448768af69a9988'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:38.180004 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1333/2648] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:36:37 2022] DELETE /identity/v3/users/abb6c0ada31e41019448768af69a9988 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:36:38.642931 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adc6289-1ba0-46f5-a229-7603cf48b413 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:38.646306 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-7adc6289-1ba0-46f5-a229-7603cf48b413 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:38.662543 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adc6289-1ba0-46f5-a229-7603cf48b413 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:38.757590 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319c32c9-277f-4d73-a2e9-b65653af9ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:38.758355 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c32c9-277f-4d73-a2e9-b65653af9ba7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:38.758698 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c32c9-277f-4d73-a2e9-b65653af9ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:38.759168 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c32c9-277f-4d73-a2e9-b65653af9ba7 admin admin] PATH_INFO: `/v3/projects/84f9e052df144769ab6aa66ba949170c` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:38.760394 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319c32c9-277f-4d73-a2e9-b65653af9ba7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84f9e052df144769ab6aa66ba949170c)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:38.762573 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319c32c9-277f-4d73-a2e9-b65653af9ba7 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:38.818564 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-319c32c9-277f-4d73-a2e9-b65653af9ba7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84f9e052df144769ab6aa66ba949170c', 'request_id': 'req-319c32c9-277f-4d73-a2e9-b65653af9ba7'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:38.829566 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-319c32c9-277f-4d73-a2e9-b65653af9ba7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84f9e052df144769ab6aa66ba949170c', 'request_id': 'req-319c32c9-277f-4d73-a2e9-b65653af9ba7'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:38.836803 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-319c32c9-277f-4d73-a2e9-b65653af9ba7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84f9e052df144769ab6aa66ba949170c', 'request_id': 'req-319c32c9-277f-4d73-a2e9-b65653af9ba7'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:38.839954 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:36:38.853811 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-319c32c9-277f-4d73-a2e9-b65653af9ba7 admin admin] The token cache is being invalidate because project 84f9e052df144769ab6aa66ba949170c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:36:38.855311 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-319c32c9-277f-4d73-a2e9-b65653af9ba7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:38.855653 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-319c32c9-277f-4d73-a2e9-b65653af9ba7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:38.860610 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1316/2649] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:36:38 2022] DELETE /identity/v3/projects/84f9e052df144769ab6aa66ba949170c => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:36:38.865913 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f50c95-78ff-477e-84d0-064b5d469bf9 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:38.866228 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f50c95-78ff-477e-84d0-064b5d469bf9 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:38.866498 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f50c95-78ff-477e-84d0-064b5d469bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:38.889215 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-e4f50c95-78ff-477e-84d0-064b5d469bf9 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:36:38.890461 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-e4f50c95-78ff-477e-84d0-064b5d469bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:38.952249 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1334/2650] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:36:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:36:38.960748 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a722ea-e66e-42d8-a40f-bea1952673a4 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:38.961270 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a722ea-e66e-42d8-a40f-bea1952673a4 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:38.961270 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a722ea-e66e-42d8-a40f-bea1952673a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:38.981069 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-09a722ea-e66e-42d8-a40f-bea1952673a4 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:36:38.982229 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-09a722ea-e66e-42d8-a40f-bea1952673a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:38.990898 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1317/2651] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:36:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:36:38.995083 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f50c95-78ff-477e-84d0-064b5d469bf9 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:39.004844 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f50c95-78ff-477e-84d0-064b5d469bf9 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:39.009378 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6439c44-e360-4a23-a3ce-8415f9878ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:39.010000 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6439c44-e360-4a23-a3ce-8415f9878ee9 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:39.010320 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6439c44-e360-4a23-a3ce-8415f9878ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:39.010590 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6439c44-e360-4a23-a3ce-8415f9878ee9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:39.011232 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6439c44-e360-4a23-a3ce-8415f9878ee9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:36:39.011533 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6439c44-e360-4a23-a3ce-8415f9878ee9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:39.013115 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6439c44-e360-4a23-a3ce-8415f9878ee9 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:39.025398 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1335/2652] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 01:36:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:36:39.030002 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a722ea-e66e-42d8-a40f-bea1952673a4 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:39.040292 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a722ea-e66e-42d8-a40f-bea1952673a4 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:39.046043 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eee7c2c-5cae-48ee-a827-8d1c0fd0aab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:39.046681 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee7c2c-5cae-48ee-a827-8d1c0fd0aab6 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:39.046986 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee7c2c-5cae-48ee-a827-8d1c0fd0aab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:39.047328 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee7c2c-5cae-48ee-a827-8d1c0fd0aab6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:39.047881 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eee7c2c-5cae-48ee-a827-8d1c0fd0aab6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:39.049818 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eee7c2c-5cae-48ee-a827-8d1c0fd0aab6 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:39.081850 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1318/2653] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:36:39 2022] POST /identity/v3/projects => generated 389 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 01:36:39.086314 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6439c44-e360-4a23-a3ce-8415f9878ee9 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:39.097279 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6439c44-e360-4a23-a3ce-8415f9878ee9 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:39.169030 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ef20d-2c1f-41e8-94fe-e1d6e0644431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:39.169670 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ef20d-2c1f-41e8-94fe-e1d6e0644431 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:39.169943 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ef20d-2c1f-41e8-94fe-e1d6e0644431 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:39.170375 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ef20d-2c1f-41e8-94fe-e1d6e0644431 admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:39.171008 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536ef20d-2c1f-41e8-94fe-e1d6e0644431 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:39.173172 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536ef20d-2c1f-41e8-94fe-e1d6e0644431 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:39.203957 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1336/2654] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:36:39 2022] POST /identity/v3/users => generated 295 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:36:39.208432 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eee7c2c-5cae-48ee-a827-8d1c0fd0aab6 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:39.219294 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eee7c2c-5cae-48ee-a827-8d1c0fd0aab6 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:39.223977 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c835a5-9b6f-46a5-8e41-ef88478f4df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:39.224583 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c835a5-9b6f-46a5-8e41-ef88478f4df3 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:39.224857 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c835a5-9b6f-46a5-8e41-ef88478f4df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:39.225204 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c835a5-9b6f-46a5-8e41-ef88478f4df3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:39.225757 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c835a5-9b6f-46a5-8e41-ef88478f4df3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:39.227433 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c835a5-9b6f-46a5-8e41-ef88478f4df3 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:39.239140 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1319/2655] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:36:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:36:39.243006 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ef20d-2c1f-41e8-94fe-e1d6e0644431 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:39.248324 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:36:39.254133 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ef20d-2c1f-41e8-94fe-e1d6e0644431 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:39.260665 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e0b2f3-de65-4aab-a999-69f85ed1ffd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:39.261615 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e0b2f3-de65-4aab-a999-69f85ed1ffd3 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:39.261950 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e0b2f3-de65-4aab-a999-69f85ed1ffd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:39.262333 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e0b2f3-de65-4aab-a999-69f85ed1ffd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:39.263313 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e0b2f3-de65-4aab-a999-69f85ed1ffd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:39.265454 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e0b2f3-de65-4aab-a999-69f85ed1ffd3 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:39.277415 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1337/2656] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:36:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:36:39.281724 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c835a5-9b6f-46a5-8e41-ef88478f4df3 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:39.295500 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c835a5-9b6f-46a5-8e41-ef88478f4df3 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:39.302579 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a043d4-e5c5-4dd8-81c0-9fd0f5557548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:39.303263 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a043d4-e5c5-4dd8-81c0-9fd0f5557548 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:39.303537 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a043d4-e5c5-4dd8-81c0-9fd0f5557548 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:39.304158 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a043d4-e5c5-4dd8-81c0-9fd0f5557548 admin admin] PATH_INFO: `/v3/projects/6e9beddff83e4e71a3da3293480b1105/users/c80654b47b8e41c58d48c51aeb30e228/roles/13af81971c1c428eae0a571a22ea583d` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:39.325790 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a043d4-e5c5-4dd8-81c0-9fd0f5557548 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e9beddff83e4e71a3da3293480b1105, user_id=c80654b47b8e41c58d48c51aeb30e228, role_id=13af81971c1c428eae0a571a22ea583d)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:39.328973 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a043d4-e5c5-4dd8-81c0-9fd0f5557548 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:39.345153 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1320/2657] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:36:39 2022] PUT /identity/v3/projects/6e9beddff83e4e71a3da3293480b1105/users/c80654b47b8e41c58d48c51aeb30e228/roles/13af81971c1c428eae0a571a22ea583d => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:36:39.356169 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc3d15-ce66-471b-ae7a-d111869e8ce5 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:39.356448 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc3d15-ce66-471b-ae7a-d111869e8ce5 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:39.356719 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc3d15-ce66-471b-ae7a-d111869e8ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:39.389850 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-c6cc3d15-ce66-471b-ae7a-d111869e8ce5 None None] MFA Rules not processed for user `c80654b47b8e41c58d48c51aeb30e228`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:36:39.391184 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-c6cc3d15-ce66-471b-ae7a-d111869e8ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:39.466816 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1338/2658] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:36:39 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:36:39.471436 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a043d4-e5c5-4dd8-81c0-9fd0f5557548 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:39.546096 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a043d4-e5c5-4dd8-81c0-9fd0f5557548 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:39.551065 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f3107e-50df-4128-803b-483d8260421c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:39.551789 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3107e-50df-4128-803b-483d8260421c admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:39.552123 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3107e-50df-4128-803b-483d8260421c admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:39.552455 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3107e-50df-4128-803b-483d8260421c admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:39.553208 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f3107e-50df-4128-803b-483d8260421c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:39.555567 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f3107e-50df-4128-803b-483d8260421c admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:39.589064 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1321/2659] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:36:39 2022] POST /identity/v3/projects => generated 387 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 01:36:39.590284 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cc3d15-ce66-471b-ae7a-d111869e8ce5 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:39.601026 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cc3d15-ce66-471b-ae7a-d111869e8ce5 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:39.668587 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d6b3bd-2253-4e5c-ab01-ea4f4322c2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:39.669225 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6b3bd-2253-4e5c-ab01-ea4f4322c2a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:39.669497 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6b3bd-2253-4e5c-ab01-ea4f4322c2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:39.669763 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6b3bd-2253-4e5c-ab01-ea4f4322c2a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:39.670416 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d6b3bd-2253-4e5c-ab01-ea4f4322c2a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:39.672498 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d6b3bd-2253-4e5c-ab01-ea4f4322c2a2 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:39.700390 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1339/2660] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:36:39 2022] POST /identity/v3/users => generated 300 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 01:36:39.701274 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f3107e-50df-4128-803b-483d8260421c admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:39.724454 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f3107e-50df-4128-803b-483d8260421c admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:39.729546 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45611852-524c-4cb6-b9c0-6aabaaeffc94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:39.730230 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45611852-524c-4cb6-b9c0-6aabaaeffc94 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:39.730504 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45611852-524c-4cb6-b9c0-6aabaaeffc94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:39.730778 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45611852-524c-4cb6-b9c0-6aabaaeffc94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:39.731443 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45611852-524c-4cb6-b9c0-6aabaaeffc94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:39.733088 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45611852-524c-4cb6-b9c0-6aabaaeffc94 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:39.745991 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1322/2661] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:36:39 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:36:39.751425 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d6b3bd-2253-4e5c-ab01-ea4f4322c2a2 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:39.774266 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d6b3bd-2253-4e5c-ab01-ea4f4322c2a2 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:39.779230 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b05837b-d886-4a70-9a3d-bf905c73e1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:39.779837 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b05837b-d886-4a70-9a3d-bf905c73e1ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:39.780137 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b05837b-d886-4a70-9a3d-bf905c73e1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:39.780414 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b05837b-d886-4a70-9a3d-bf905c73e1ac admin admin] PATH_INFO: `/v3/projects/802389af8fb04089a2bd094843d57ac6/users/b7b0602652384972b0432689317fa3a2/roles/fb48693810be495fb4b1893a79429b78` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:39.799839 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b05837b-d886-4a70-9a3d-bf905c73e1ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=802389af8fb04089a2bd094843d57ac6, user_id=b7b0602652384972b0432689317fa3a2, role_id=fb48693810be495fb4b1893a79429b78)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:39.802582 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b05837b-d886-4a70-9a3d-bf905c73e1ac admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:39.819342 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1340/2662] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:36:39 2022] PUT /identity/v3/projects/802389af8fb04089a2bd094843d57ac6/users/b7b0602652384972b0432689317fa3a2/roles/fb48693810be495fb4b1893a79429b78 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:36:39.823688 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45611852-524c-4cb6-b9c0-6aabaaeffc94 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:39.835027 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45611852-524c-4cb6-b9c0-6aabaaeffc94 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:39.898196 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a118def-72ff-4b73-96a2-517675d41f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:39.899147 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a118def-72ff-4b73-96a2-517675d41f52 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:39.899603 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a118def-72ff-4b73-96a2-517675d41f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:39.900105 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a118def-72ff-4b73-96a2-517675d41f52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:39.901731 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a118def-72ff-4b73-96a2-517675d41f52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:39.903524 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a118def-72ff-4b73-96a2-517675d41f52 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:39.914615 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1323/2663] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:36:39 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:36:39.918869 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b05837b-d886-4a70-9a3d-bf905c73e1ac admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:39.930143 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b05837b-d886-4a70-9a3d-bf905c73e1ac admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:39.934758 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcebe72-c683-405d-b815-955d596a16c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:39.935410 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcebe72-c683-405d-b815-955d596a16c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:39.935689 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcebe72-c683-405d-b815-955d596a16c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:39.935950 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcebe72-c683-405d-b815-955d596a16c5 admin admin] PATH_INFO: `/v3/projects/802389af8fb04089a2bd094843d57ac6/users/b7b0602652384972b0432689317fa3a2/roles/fb48693810be495fb4b1893a79429b78` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:39.937920 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcebe72-c683-405d-b815-955d596a16c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=802389af8fb04089a2bd094843d57ac6, user_id=b7b0602652384972b0432689317fa3a2, role_id=fb48693810be495fb4b1893a79429b78)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:39.940523 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcebe72-c683-405d-b815-955d596a16c5 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:39.953672 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1341/2664] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:36:39 2022] PUT /identity/v3/projects/802389af8fb04089a2bd094843d57ac6/users/b7b0602652384972b0432689317fa3a2/roles/fb48693810be495fb4b1893a79429b78 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 01:36:39.965809 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c7f5c-1bde-458d-a45d-cecc6773053f None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:39.966382 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c7f5c-1bde-458d-a45d-cecc6773053f None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:39.966472 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c7f5c-1bde-458d-a45d-cecc6773053f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:39.974684 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:36:40.000126 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-ff4c7f5c-1bde-458d-a45d-cecc6773053f None None] MFA Rules not processed for user `b7b0602652384972b0432689317fa3a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:36:40.001502 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-ff4c7f5c-1bde-458d-a45d-cecc6773053f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:40.084042 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1324/2665] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:36:39 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:36:40.095799 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcebe72-c683-405d-b815-955d596a16c5 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:40.098227 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-1dcebe72-c683-405d-b815-955d596a16c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:40.138044 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:36:40.165899 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcebe72-c683-405d-b815-955d596a16c5 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:40.171965 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1528ac19-6e57-432b-8a2a-e2daaad2dbfa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7853d40c29af424c8d7913950d89750b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:40.171965 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528ac19-6e57-432b-8a2a-e2daaad2dbfa service cinder] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:40.171965 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528ac19-6e57-432b-8a2a-e2daaad2dbfa service cinder] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:40.171965 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528ac19-6e57-432b-8a2a-e2daaad2dbfa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:40.186621 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1528ac19-6e57-432b-8a2a-e2daaad2dbfa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:40.188428 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1528ac19-6e57-432b-8a2a-e2daaad2dbfa service cinder] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:40.198184 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1342/2666] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:36:40 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:36:40.338029 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4c7f5c-1bde-458d-a45d-cecc6773053f None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:40.409965 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4c7f5c-1bde-458d-a45d-cecc6773053f None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:40.414996 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f841a5-4b5a-47d5-9e1d-4e0ffb4b37c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:40.415643 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f841a5-4b5a-47d5-9e1d-4e0ffb4b37c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:40.415930 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f841a5-4b5a-47d5-9e1d-4e0ffb4b37c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:40.416563 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f841a5-4b5a-47d5-9e1d-4e0ffb4b37c6 admin admin] PATH_INFO: `/v3/users/c80654b47b8e41c58d48c51aeb30e228` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:40.417476 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f841a5-4b5a-47d5-9e1d-4e0ffb4b37c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c80654b47b8e41c58d48c51aeb30e228)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:40.419436 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f841a5-4b5a-47d5-9e1d-4e0ffb4b37c6 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:40.485651 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-23f841a5-4b5a-47d5-9e1d-4e0ffb4b37c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c80654b47b8e41c58d48c51aeb30e228'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:40.496619 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-23f841a5-4b5a-47d5-9e1d-4e0ffb4b37c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c80654b47b8e41c58d48c51aeb30e228'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:40.497585 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-23f841a5-4b5a-47d5-9e1d-4e0ffb4b37c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c80654b47b8e41c58d48c51aeb30e228'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:40.523211 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-23f841a5-4b5a-47d5-9e1d-4e0ffb4b37c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c80654b47b8e41c58d48c51aeb30e228'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:40.537683 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-23f841a5-4b5a-47d5-9e1d-4e0ffb4b37c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c80654b47b8e41c58d48c51aeb30e228'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:40.548425 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1325/2667] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:36:40 2022] DELETE /identity/v3/users/c80654b47b8e41c58d48c51aeb30e228 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:36:40.554495 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c40a0b0-5f5a-4705-bf02-56dbd05aec10 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:40.554789 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c40a0b0-5f5a-4705-bf02-56dbd05aec10 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:40.555067 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c40a0b0-5f5a-4705-bf02-56dbd05aec10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:40.587515 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-9c40a0b0-5f5a-4705-bf02-56dbd05aec10 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:36:40.591122 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-9c40a0b0-5f5a-4705-bf02-56dbd05aec10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:40.690284 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1343/2668] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:36:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:36:40.698952 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f841a5-4b5a-47d5-9e1d-4e0ffb4b37c6 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:40.700532 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-23f841a5-4b5a-47d5-9e1d-4e0ffb4b37c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:40.715895 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:36:40.809387 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f841a5-4b5a-47d5-9e1d-4e0ffb4b37c6 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:40.823656 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdce522d-122c-48ea-9dbc-4ecaec79a1f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:40.824297 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce522d-122c-48ea-9dbc-4ecaec79a1f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:40.824575 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce522d-122c-48ea-9dbc-4ecaec79a1f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:40.824842 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce522d-122c-48ea-9dbc-4ecaec79a1f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:40.851698 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdce522d-122c-48ea-9dbc-4ecaec79a1f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:40.853261 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdce522d-122c-48ea-9dbc-4ecaec79a1f7 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:40.868032 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1326/2669] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:36:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:36:40.928896 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c40a0b0-5f5a-4705-bf02-56dbd05aec10 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:40.930372 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-9c40a0b0-5f5a-4705-bf02-56dbd05aec10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:41.005588 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdce522d-122c-48ea-9dbc-4ecaec79a1f7 service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:41.007382 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-cdce522d-122c-48ea-9dbc-4ecaec79a1f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:41.024678 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdce522d-122c-48ea-9dbc-4ecaec79a1f7 service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:41.031936 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfd1b85-6e7e-4e7e-9871-93e3bbcf3357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:41.032871 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd1b85-6e7e-4e7e-9871-93e3bbcf3357 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:41.033394 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd1b85-6e7e-4e7e-9871-93e3bbcf3357 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:41.033874 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd1b85-6e7e-4e7e-9871-93e3bbcf3357 admin admin] PATH_INFO: `/v3/users/04bb1a772b004b1394c19d9dbd306cb0` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:41.036292 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfd1b85-6e7e-4e7e-9871-93e3bbcf3357 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04bb1a772b004b1394c19d9dbd306cb0)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:41.039196 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfd1b85-6e7e-4e7e-9871-93e3bbcf3357 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:41.058026 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c40a0b0-5f5a-4705-bf02-56dbd05aec10 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:41.065771 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf34b488-7dc4-41ca-ad2c-1525ac1839c8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06dccf61c686414d904bdf1ecf19d53d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:41.066052 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34b488-7dc4-41ca-ad2c-1525ac1839c8 service placement] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:41.066251 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34b488-7dc4-41ca-ad2c-1525ac1839c8 service placement] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:41.066574 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34b488-7dc4-41ca-ad2c-1525ac1839c8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:41.068680 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-bf34b488-7dc4-41ca-ad2c-1525ac1839c8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:41.082996 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf34b488-7dc4-41ca-ad2c-1525ac1839c8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:41.084938 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf34b488-7dc4-41ca-ad2c-1525ac1839c8 service placement] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:41.114606 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1344/2670] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:36:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:36:41.127366 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7cfd1b85-6e7e-4e7e-9871-93e3bbcf3357 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04bb1a772b004b1394c19d9dbd306cb0'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:41.140379 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7cfd1b85-6e7e-4e7e-9871-93e3bbcf3357 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04bb1a772b004b1394c19d9dbd306cb0'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:41.141423 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7cfd1b85-6e7e-4e7e-9871-93e3bbcf3357 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04bb1a772b004b1394c19d9dbd306cb0'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:41.156747 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7cfd1b85-6e7e-4e7e-9871-93e3bbcf3357 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04bb1a772b004b1394c19d9dbd306cb0'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:41.171537 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7cfd1b85-6e7e-4e7e-9871-93e3bbcf3357 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04bb1a772b004b1394c19d9dbd306cb0'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:41.177692 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1327/2671] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:36:41 2022] DELETE /identity/v3/users/04bb1a772b004b1394c19d9dbd306cb0 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:36:41.243505 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf34b488-7dc4-41ca-ad2c-1525ac1839c8 service placement] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:41.245063 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-bf34b488-7dc4-41ca-ad2c-1525ac1839c8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:41.259241 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf34b488-7dc4-41ca-ad2c-1525ac1839c8 service placement] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:41.331173 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45cf19f-0638-4703-a333-67f6c05a1bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:41.331812 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45cf19f-0638-4703-a333-67f6c05a1bfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:41.332087 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45cf19f-0638-4703-a333-67f6c05a1bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:41.332355 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45cf19f-0638-4703-a333-67f6c05a1bfa admin admin] PATH_INFO: `/v3/projects/6e9beddff83e4e71a3da3293480b1105` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:41.333492 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45cf19f-0638-4703-a333-67f6c05a1bfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e9beddff83e4e71a3da3293480b1105)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:41.335512 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45cf19f-0638-4703-a333-67f6c05a1bfa admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:41.344407 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:36:41.376335 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfd1b85-6e7e-4e7e-9871-93e3bbcf3357 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:41.377751 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-7cfd1b85-6e7e-4e7e-9871-93e3bbcf3357 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:41.387117 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-e45cf19f-0638-4703-a333-67f6c05a1bfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e9beddff83e4e71a3da3293480b1105', 'request_id': 'req-e45cf19f-0638-4703-a333-67f6c05a1bfa'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:41.392784 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-e45cf19f-0638-4703-a333-67f6c05a1bfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e9beddff83e4e71a3da3293480b1105', 'request_id': 'req-e45cf19f-0638-4703-a333-67f6c05a1bfa'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:41.399177 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-e45cf19f-0638-4703-a333-67f6c05a1bfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e9beddff83e4e71a3da3293480b1105', 'request_id': 'req-e45cf19f-0638-4703-a333-67f6c05a1bfa'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:41.415007 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-e45cf19f-0638-4703-a333-67f6c05a1bfa admin admin] The token cache is being invalidate because project 6e9beddff83e4e71a3da3293480b1105 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:36:41.415309 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-e45cf19f-0638-4703-a333-67f6c05a1bfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:41.415968 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-e45cf19f-0638-4703-a333-67f6c05a1bfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:41.417443 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfd1b85-6e7e-4e7e-9871-93e3bbcf3357 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:41.417673 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1345/2672] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:36:41 2022] DELETE /identity/v3/projects/6e9beddff83e4e71a3da3293480b1105 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:36:41.421672 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45cf19f-0638-4703-a333-67f6c05a1bfa admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:41.423114 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-e45cf19f-0638-4703-a333-67f6c05a1bfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:41.479274 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608c6b43-f15c-41d3-a629-f145729c981c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:41.480185 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c6b43-f15c-41d3-a629-f145729c981c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:41.480657 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c6b43-f15c-41d3-a629-f145729c981c admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:41.481098 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c6b43-f15c-41d3-a629-f145729c981c admin admin] PATH_INFO: `/v3/projects/f6a9d9afe84e45189dcd44fb58fd3436` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:41.482543 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608c6b43-f15c-41d3-a629-f145729c981c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6a9d9afe84e45189dcd44fb58fd3436)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:41.485151 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608c6b43-f15c-41d3-a629-f145729c981c admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:41.492302 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45cf19f-0638-4703-a333-67f6c05a1bfa admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:41.497266 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32721233-ac0a-404e-80b2-318d573beee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:41.497903 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32721233-ac0a-404e-80b2-318d573beee1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:41.498202 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32721233-ac0a-404e-80b2-318d573beee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:41.498469 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32721233-ac0a-404e-80b2-318d573beee1 admin admin] PATH_INFO: `/v3/users/b7b0602652384972b0432689317fa3a2` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:41.499607 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32721233-ac0a-404e-80b2-318d573beee1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7b0602652384972b0432689317fa3a2)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:41.501791 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32721233-ac0a-404e-80b2-318d573beee1 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:41.510539 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:36:41.539180 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-608c6b43-f15c-41d3-a629-f145729c981c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6a9d9afe84e45189dcd44fb58fd3436', 'request_id': 'req-608c6b43-f15c-41d3-a629-f145729c981c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:41.547689 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-608c6b43-f15c-41d3-a629-f145729c981c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6a9d9afe84e45189dcd44fb58fd3436', 'request_id': 'req-608c6b43-f15c-41d3-a629-f145729c981c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:41.550772 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-32721233-ac0a-404e-80b2-318d573beee1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7b0602652384972b0432689317fa3a2'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:41.553690 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-608c6b43-f15c-41d3-a629-f145729c981c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6a9d9afe84e45189dcd44fb58fd3436', 'request_id': 'req-608c6b43-f15c-41d3-a629-f145729c981c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:41.558859 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-32721233-ac0a-404e-80b2-318d573beee1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7b0602652384972b0432689317fa3a2'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:41.559511 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-32721233-ac0a-404e-80b2-318d573beee1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7b0602652384972b0432689317fa3a2'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:41.565847 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-608c6b43-f15c-41d3-a629-f145729c981c admin admin] The token cache is being invalidate because project f6a9d9afe84e45189dcd44fb58fd3436 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:36:41.566178 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-608c6b43-f15c-41d3-a629-f145729c981c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:41.566565 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-32721233-ac0a-404e-80b2-318d573beee1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7b0602652384972b0432689317fa3a2'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:41.566819 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-608c6b43-f15c-41d3-a629-f145729c981c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:41.568434 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1328/2673] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:36:41 2022] DELETE /identity/v3/projects/f6a9d9afe84e45189dcd44fb58fd3436 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 01:36:41.573523 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80dffdf-442b-4d46-9551-fe87c6f8976e None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:41.573743 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80dffdf-442b-4d46-9551-fe87c6f8976e None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:41.574027 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80dffdf-442b-4d46-9551-fe87c6f8976e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:41.579511 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-32721233-ac0a-404e-80b2-318d573beee1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7b0602652384972b0432689317fa3a2'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:41.585579 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1346/2674] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:36:41 2022] DELETE /identity/v3/users/b7b0602652384972b0432689317fa3a2 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 01:36:41.596436 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-f80dffdf-442b-4d46-9551-fe87c6f8976e None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:36:41.597649 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f80dffdf-442b-4d46-9551-fe87c6f8976e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:41.660697 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1329/2675] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:36:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:36:41.669042 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922aff9d-95da-47ba-8112-1cb888c41d80 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:41.669387 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922aff9d-95da-47ba-8112-1cb888c41d80 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:41.669855 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922aff9d-95da-47ba-8112-1cb888c41d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:41.691950 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-922aff9d-95da-47ba-8112-1cb888c41d80 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:36:41.693452 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-922aff9d-95da-47ba-8112-1cb888c41d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:41.702550 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1347/2676] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:36:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:36:41.707132 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80dffdf-442b-4d46-9551-fe87c6f8976e None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:41.717477 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80dffdf-442b-4d46-9551-fe87c6f8976e None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:41.722918 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25b3391-ac7f-42f6-8e1a-3ecc914dbae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:41.723623 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25b3391-ac7f-42f6-8e1a-3ecc914dbae0 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:41.723945 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25b3391-ac7f-42f6-8e1a-3ecc914dbae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:41.724339 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25b3391-ac7f-42f6-8e1a-3ecc914dbae0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:41.725081 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25b3391-ac7f-42f6-8e1a-3ecc914dbae0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:36:41.725437 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25b3391-ac7f-42f6-8e1a-3ecc914dbae0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:41.727188 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25b3391-ac7f-42f6-8e1a-3ecc914dbae0 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:41.746100 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1330/2677] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 01:36:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:36:41.757993 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922aff9d-95da-47ba-8112-1cb888c41d80 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:41.768439 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922aff9d-95da-47ba-8112-1cb888c41d80 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:41.773310 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd2e9a1-dbee-4863-b6cb-a9cab1824128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:41.773925 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd2e9a1-dbee-4863-b6cb-a9cab1824128 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:41.774234 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd2e9a1-dbee-4863-b6cb-a9cab1824128 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:41.774507 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd2e9a1-dbee-4863-b6cb-a9cab1824128 admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:41.775135 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd2e9a1-dbee-4863-b6cb-a9cab1824128 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:41.777033 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd2e9a1-dbee-4863-b6cb-a9cab1824128 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:41.783697 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:36:41.809841 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1348/2678] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:36:41 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:36:41.814745 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25b3391-ac7f-42f6-8e1a-3ecc914dbae0 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:41.824638 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25b3391-ac7f-42f6-8e1a-3ecc914dbae0 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:41.874623 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd2e9a1-dbee-4863-b6cb-a9cab1824128 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:41.877781 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-3bd2e9a1-dbee-4863-b6cb-a9cab1824128 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:41.889590 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c256eff-7e23-4c1e-9358-36747253fc1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:41.890775 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c256eff-7e23-4c1e-9358-36747253fc1c admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:41.891042 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c256eff-7e23-4c1e-9358-36747253fc1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:41.891366 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c256eff-7e23-4c1e-9358-36747253fc1c admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:41.892071 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c256eff-7e23-4c1e-9358-36747253fc1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:41.894455 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c256eff-7e23-4c1e-9358-36747253fc1c admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:41.924158 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1331/2679] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:36:41 2022] POST /identity/v3/users => generated 289 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 01:36:41.925713 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c256eff-7e23-4c1e-9358-36747253fc1c admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:41.937166 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c256eff-7e23-4c1e-9358-36747253fc1c admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:41.953722 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5919c4d8-19e6-4041-b304-4e697453d858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:41.954392 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5919c4d8-19e6-4041-b304-4e697453d858 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:41.955097 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5919c4d8-19e6-4041-b304-4e697453d858 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:41.955097 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5919c4d8-19e6-4041-b304-4e697453d858 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:41.955637 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5919c4d8-19e6-4041-b304-4e697453d858 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:41.957748 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5919c4d8-19e6-4041-b304-4e697453d858 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:41.962819 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd2e9a1-dbee-4863-b6cb-a9cab1824128 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:41.968652 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffca45a-599f-496c-9890-c722b72d88ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:41.969406 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffca45a-599f-496c-9890-c722b72d88ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:41.969743 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffca45a-599f-496c-9890-c722b72d88ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:41.970073 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffca45a-599f-496c-9890-c722b72d88ff admin admin] PATH_INFO: `/v3/projects/802389af8fb04089a2bd094843d57ac6` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:41.971398 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffca45a-599f-496c-9890-c722b72d88ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=802389af8fb04089a2bd094843d57ac6)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:41.973377 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffca45a-599f-496c-9890-c722b72d88ff admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:41.978292 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1332/2680] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:36:41.982558 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5919c4d8-19e6-4041-b304-4e697453d858 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:41.993307 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5919c4d8-19e6-4041-b304-4e697453d858 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:42.006957 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24578cf9-b8ee-4742-9220-3d4ec7d6f678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:42.007957 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24578cf9-b8ee-4742-9220-3d4ec7d6f678 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:42.008204 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24578cf9-b8ee-4742-9220-3d4ec7d6f678 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:42.008561 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24578cf9-b8ee-4742-9220-3d4ec7d6f678 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:42.009302 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24578cf9-b8ee-4742-9220-3d4ec7d6f678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:42.010997 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24578cf9-b8ee-4742-9220-3d4ec7d6f678 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:42.022545 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1333/2681] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 01:36:42.026821 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24578cf9-b8ee-4742-9220-3d4ec7d6f678 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:42.032274 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-6ffca45a-599f-496c-9890-c722b72d88ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '802389af8fb04089a2bd094843d57ac6', 'request_id': 'req-6ffca45a-599f-496c-9890-c722b72d88ff'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:42.037416 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24578cf9-b8ee-4742-9220-3d4ec7d6f678 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:42.039743 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-6ffca45a-599f-496c-9890-c722b72d88ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '802389af8fb04089a2bd094843d57ac6', 'request_id': 'req-6ffca45a-599f-496c-9890-c722b72d88ff'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:42.043027 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:36:42.047516 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-6ffca45a-599f-496c-9890-c722b72d88ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '802389af8fb04089a2bd094843d57ac6', 'request_id': 'req-6ffca45a-599f-496c-9890-c722b72d88ff'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:42.070768 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-6ffca45a-599f-496c-9890-c722b72d88ff admin admin] The token cache is being invalidate because project 802389af8fb04089a2bd094843d57ac6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:36:42.071056 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-6ffca45a-599f-496c-9890-c722b72d88ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:42.071709 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-6ffca45a-599f-496c-9890-c722b72d88ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:42.073653 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1349/2682] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:36:41 2022] DELETE /identity/v3/projects/802389af8fb04089a2bd094843d57ac6 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 01:36:42.079437 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f90a1-b25b-4c66-8d63-695610010fb2 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:42.079646 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f90a1-b25b-4c66-8d63-695610010fb2 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:42.079922 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f90a1-b25b-4c66-8d63-695610010fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:42.102975 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-ce1f90a1-b25b-4c66-8d63-695610010fb2 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:36:42.104228 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-ce1f90a1-b25b-4c66-8d63-695610010fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:42.116271 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aa50f5-bedb-4a4d-9e59-6fc1f7b6f188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:42.116952 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa50f5-bedb-4a4d-9e59-6fc1f7b6f188 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:42.117227 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa50f5-bedb-4a4d-9e59-6fc1f7b6f188 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:42.117500 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa50f5-bedb-4a4d-9e59-6fc1f7b6f188 admin admin] PATH_INFO: `/v3/projects/dc819bad329149839672804271ed7ab9/users/2b594ca9853f402bb0353616db2ae4c8/roles/13af81971c1c428eae0a571a22ea583d` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:42.134398 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aa50f5-bedb-4a4d-9e59-6fc1f7b6f188 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc819bad329149839672804271ed7ab9, user_id=2b594ca9853f402bb0353616db2ae4c8, role_id=13af81971c1c428eae0a571a22ea583d)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:42.137069 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aa50f5-bedb-4a4d-9e59-6fc1f7b6f188 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:42.156688 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1334/2683] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:36:42 2022] PUT /identity/v3/projects/dc819bad329149839672804271ed7ab9/users/2b594ca9853f402bb0353616db2ae4c8/roles/13af81971c1c428eae0a571a22ea583d => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 01:36:42.161765 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745da3f-2aab-4d82-9150-1f32108f8891 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:42.162195 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745da3f-2aab-4d82-9150-1f32108f8891 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:42.162541 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745da3f-2aab-4d82-9150-1f32108f8891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:42.175658 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1350/2684] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:36:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:36:42.184055 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad58ab3-352e-42b9-bfe7-a6c0c7b148e5 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:42.184302 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad58ab3-352e-42b9-bfe7-a6c0c7b148e5 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:42.184661 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad58ab3-352e-42b9-bfe7-a6c0c7b148e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:42.184807 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-3745da3f-2aab-4d82-9150-1f32108f8891 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:36:42.186003 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-3745da3f-2aab-4d82-9150-1f32108f8891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:42.217990 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-8ad58ab3-352e-42b9-bfe7-a6c0c7b148e5 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:36:42.217990 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-8ad58ab3-352e-42b9-bfe7-a6c0c7b148e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:42.230220 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:36:42.255978 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1335/2685] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:36:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 01:36:42.275721 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3745da3f-2aab-4d82-9150-1f32108f8891 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:42.278257 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-3745da3f-2aab-4d82-9150-1f32108f8891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:42.295173 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1351/2686] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:36:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:36:42.299532 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad58ab3-352e-42b9-bfe7-a6c0c7b148e5 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:42.309814 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad58ab3-352e-42b9-bfe7-a6c0c7b148e5 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:42.316907 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c69e2bd-6536-4880-b751-e549420564d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:42.317702 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69e2bd-6536-4880-b751-e549420564d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:42.318039 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69e2bd-6536-4880-b751-e549420564d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:42.318491 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69e2bd-6536-4880-b751-e549420564d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:42.319314 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c69e2bd-6536-4880-b751-e549420564d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:36:42.319680 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c69e2bd-6536-4880-b751-e549420564d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:42.321811 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c69e2bd-6536-4880-b751-e549420564d1 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:42.341604 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1352/2687] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 01:36:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:36:42.342719 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c69e2bd-6536-4880-b751-e549420564d1 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:42.346615 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3745da3f-2aab-4d82-9150-1f32108f8891 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:42.350417 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da907b16-7b66-4c75-9965-4fae6506f49d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:42.350935 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da907b16-7b66-4c75-9965-4fae6506f49d service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:42.351474 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da907b16-7b66-4c75-9965-4fae6506f49d service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:42.351474 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da907b16-7b66-4c75-9965-4fae6506f49d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:42.354246 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c69e2bd-6536-4880-b751-e549420564d1 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:42.360038 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0caf4c-a940-47eb-83c2-c0aa942cbd00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:42.360826 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0caf4c-a940-47eb-83c2-c0aa942cbd00 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:42.361104 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0caf4c-a940-47eb-83c2-c0aa942cbd00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:42.361498 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0caf4c-a940-47eb-83c2-c0aa942cbd00 admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:42.361835 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da907b16-7b66-4c75-9965-4fae6506f49d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:42.362402 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0caf4c-a940-47eb-83c2-c0aa942cbd00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:42.363584 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da907b16-7b66-4c75-9965-4fae6506f49d service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:42.364439 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0caf4c-a940-47eb-83c2-c0aa942cbd00 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:42.373673 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1336/2688] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:36:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:36:42.402158 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1353/2689] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:36:42 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:36:42.403917 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da907b16-7b66-4c75-9965-4fae6506f49d service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:42.414567 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da907b16-7b66-4c75-9965-4fae6506f49d service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:42.451929 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:36:42.511922 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315e215d-2b5a-4468-9992-c19bb2b16095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:42.512543 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e215d-2b5a-4468-9992-c19bb2b16095 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:42.512892 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e215d-2b5a-4468-9992-c19bb2b16095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:42.513141 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e215d-2b5a-4468-9992-c19bb2b16095 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:42.513817 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315e215d-2b5a-4468-9992-c19bb2b16095 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:42.516176 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315e215d-2b5a-4468-9992-c19bb2b16095 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:42.549769 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1337/2690] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:36:42 2022] POST /identity/v3/users => generated 287 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:36:42.554403 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0caf4c-a940-47eb-83c2-c0aa942cbd00 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:42.573695 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0caf4c-a940-47eb-83c2-c0aa942cbd00 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:42.580153 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed50445-15c5-41bd-9434-a1a7f2d23530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:42.581100 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed50445-15c5-41bd-9434-a1a7f2d23530 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:42.581301 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed50445-15c5-41bd-9434-a1a7f2d23530 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:42.581740 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed50445-15c5-41bd-9434-a1a7f2d23530 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:42.582261 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed50445-15c5-41bd-9434-a1a7f2d23530 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:42.583906 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed50445-15c5-41bd-9434-a1a7f2d23530 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:42.597107 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1354/2691] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:36:42 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 01:36:42.601993 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315e215d-2b5a-4468-9992-c19bb2b16095 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:42.612676 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315e215d-2b5a-4468-9992-c19bb2b16095 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:42.617726 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dffdc45-4cdf-47f6-8823-08e65f5e759e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:42.618408 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dffdc45-4cdf-47f6-8823-08e65f5e759e admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:42.618726 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dffdc45-4cdf-47f6-8823-08e65f5e759e admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:42.619177 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dffdc45-4cdf-47f6-8823-08e65f5e759e admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:42.619840 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dffdc45-4cdf-47f6-8823-08e65f5e759e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:42.621496 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dffdc45-4cdf-47f6-8823-08e65f5e759e admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:42.632879 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1338/2692] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:36:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 01:36:42.637022 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed50445-15c5-41bd-9434-a1a7f2d23530 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:42.648373 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed50445-15c5-41bd-9434-a1a7f2d23530 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:42.653470 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b96bf-003a-471f-9104-5ca894bf4347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:42.654449 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b96bf-003a-471f-9104-5ca894bf4347 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:42.654788 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b96bf-003a-471f-9104-5ca894bf4347 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:42.655123 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b96bf-003a-471f-9104-5ca894bf4347 admin admin] PATH_INFO: `/v3/projects/a1da52c54e804adf90db9a56e4290a07/users/a8716ed93ca248028f87d01d5ff8bf30/roles/13af81971c1c428eae0a571a22ea583d` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:42.672830 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480b96bf-003a-471f-9104-5ca894bf4347 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1da52c54e804adf90db9a56e4290a07, user_id=a8716ed93ca248028f87d01d5ff8bf30, role_id=13af81971c1c428eae0a571a22ea583d)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:42.675593 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480b96bf-003a-471f-9104-5ca894bf4347 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:42.690398 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1355/2693] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:36:42 2022] PUT /identity/v3/projects/a1da52c54e804adf90db9a56e4290a07/users/a8716ed93ca248028f87d01d5ff8bf30/roles/13af81971c1c428eae0a571a22ea583d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 01:36:42.701574 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eba10f-3939-4647-87ac-653685adfec2 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:42.701851 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eba10f-3939-4647-87ac-653685adfec2 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:42.702234 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eba10f-3939-4647-87ac-653685adfec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:42.736407 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-47eba10f-3939-4647-87ac-653685adfec2 None None] MFA Rules not processed for user `a8716ed93ca248028f87d01d5ff8bf30`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:36:42.738261 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-47eba10f-3939-4647-87ac-653685adfec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:42.823995 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1339/2694] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:36:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 01:36:42.835371 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b96bf-003a-471f-9104-5ca894bf4347 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:42.837024 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-480b96bf-003a-471f-9104-5ca894bf4347 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:42.896821 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b96bf-003a-471f-9104-5ca894bf4347 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:42.901020 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab73ad2-7800-404b-805f-967f7ca2bd61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7853d40c29af424c8d7913950d89750b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:42.901723 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab73ad2-7800-404b-805f-967f7ca2bd61 service cinder] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:42.902001 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab73ad2-7800-404b-805f-967f7ca2bd61 service cinder] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:42.902345 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab73ad2-7800-404b-805f-967f7ca2bd61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:42.911766 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab73ad2-7800-404b-805f-967f7ca2bd61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:42.913181 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab73ad2-7800-404b-805f-967f7ca2bd61 service cinder] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:42.922301 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1356/2695] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:36:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:36:46.167998 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eba10f-3939-4647-87ac-653685adfec2 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:46.262418 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eba10f-3939-4647-87ac-653685adfec2 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:46.270353 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c37c274-c0c1-4afe-a713-81113f19dfc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:46.272042 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37c274-c0c1-4afe-a713-81113f19dfc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:46.272415 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37c274-c0c1-4afe-a713-81113f19dfc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:46.272773 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37c274-c0c1-4afe-a713-81113f19dfc6 admin admin] PATH_INFO: `/v3/users/a8716ed93ca248028f87d01d5ff8bf30` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:46.275296 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c37c274-c0c1-4afe-a713-81113f19dfc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8716ed93ca248028f87d01d5ff8bf30)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:46.277400 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c37c274-c0c1-4afe-a713-81113f19dfc6 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:46.345194 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:36:46.348588 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-3c37c274-c0c1-4afe-a713-81113f19dfc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8716ed93ca248028f87d01d5ff8bf30'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:46.360804 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-3c37c274-c0c1-4afe-a713-81113f19dfc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8716ed93ca248028f87d01d5ff8bf30'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:46.361938 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-3c37c274-c0c1-4afe-a713-81113f19dfc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8716ed93ca248028f87d01d5ff8bf30'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:46.371622 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-3c37c274-c0c1-4afe-a713-81113f19dfc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8716ed93ca248028f87d01d5ff8bf30'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:46.387051 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-3c37c274-c0c1-4afe-a713-81113f19dfc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8716ed93ca248028f87d01d5ff8bf30'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:46.398726 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1340/2696] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:36:46 2022] DELETE /identity/v3/users/a8716ed93ca248028f87d01d5ff8bf30 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:36:46.400484 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b8c1f-9318-4cb7-b1b9-e3c54321abc7 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:46.400967 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b8c1f-9318-4cb7-b1b9-e3c54321abc7 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:46.401065 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b8c1f-9318-4cb7-b1b9-e3c54321abc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:46.419779 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-651b8c1f-9318-4cb7-b1b9-e3c54321abc7 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:36:46.421016 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-651b8c1f-9318-4cb7-b1b9-e3c54321abc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:46.470869 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:36:46.495973 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1357/2697] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:36:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:36:46.511138 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c37c274-c0c1-4afe-a713-81113f19dfc6 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:46.513363 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-3c37c274-c0c1-4afe-a713-81113f19dfc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:46.598348 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c37c274-c0c1-4afe-a713-81113f19dfc6 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:46.603119 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c52db7-e0af-43d0-8d9d-e413416e517c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:46.603910 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c52db7-e0af-43d0-8d9d-e413416e517c service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:46.604287 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c52db7-e0af-43d0-8d9d-e413416e517c service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:46.604782 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c52db7-e0af-43d0-8d9d-e413416e517c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:46.617589 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c52db7-e0af-43d0-8d9d-e413416e517c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:46.621606 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c52db7-e0af-43d0-8d9d-e413416e517c service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:46.636129 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1341/2698] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:36:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:36:46.762087 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f1adca-dc52-4ed1-9a9b-bed6292dec83 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:46.762450 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f1adca-dc52-4ed1-9a9b-bed6292dec83 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:46.762694 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f1adca-dc52-4ed1-9a9b-bed6292dec83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:46.793609 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-19f1adca-dc52-4ed1-9a9b-bed6292dec83 None None] MFA Rules not processed for user `2b594ca9853f402bb0353616db2ae4c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:36:46.794964 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-19f1adca-dc52-4ed1-9a9b-bed6292dec83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:46.902734 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1358/2699] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:36:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:36:46.919142 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c52db7-e0af-43d0-8d9d-e413416e517c service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:46.920831 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-a0c52db7-e0af-43d0-8d9d-e413416e517c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:47.001719 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c52db7-e0af-43d0-8d9d-e413416e517c service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:47.010712 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432f903c-2567-4ea8-a37e-87c12f1f0edf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd5e95467b44175be2478c2c7c89926', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:47.011638 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f903c-2567-4ea8-a37e-87c12f1f0edf service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:47.011924 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f903c-2567-4ea8-a37e-87c12f1f0edf service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:47.012172 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f903c-2567-4ea8-a37e-87c12f1f0edf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:47.021608 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432f903c-2567-4ea8-a37e-87c12f1f0edf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:47.023801 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432f903c-2567-4ea8-a37e-87c12f1f0edf service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:47.025359 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f1adca-dc52-4ed1-9a9b-bed6292dec83 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:47.027096 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-19f1adca-dc52-4ed1-9a9b-bed6292dec83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:47.036212 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1342/2700] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:36:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:36:47.086318 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f1adca-dc52-4ed1-9a9b-bed6292dec83 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:47.092214 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af9652f-3cdd-4bf6-95b8-f48d913ba3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:47.092957 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af9652f-3cdd-4bf6-95b8-f48d913ba3fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:47.093237 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af9652f-3cdd-4bf6-95b8-f48d913ba3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:47.093575 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af9652f-3cdd-4bf6-95b8-f48d913ba3fc admin admin] PATH_INFO: `/v3/projects/a1da52c54e804adf90db9a56e4290a07` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:47.094951 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af9652f-3cdd-4bf6-95b8-f48d913ba3fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1da52c54e804adf90db9a56e4290a07)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:47.102921 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af9652f-3cdd-4bf6-95b8-f48d913ba3fc admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:47.179295 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432f903c-2567-4ea8-a37e-87c12f1f0edf service nova] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:47.180977 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-432f903c-2567-4ea8-a37e-87c12f1f0edf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:47.192247 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-4af9652f-3cdd-4bf6-95b8-f48d913ba3fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1da52c54e804adf90db9a56e4290a07', 'request_id': 'req-4af9652f-3cdd-4bf6-95b8-f48d913ba3fc'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:47.212397 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432f903c-2567-4ea8-a37e-87c12f1f0edf service nova] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:47.218342 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-4af9652f-3cdd-4bf6-95b8-f48d913ba3fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1da52c54e804adf90db9a56e4290a07', 'request_id': 'req-4af9652f-3cdd-4bf6-95b8-f48d913ba3fc'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:47.227023 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-4af9652f-3cdd-4bf6-95b8-f48d913ba3fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1da52c54e804adf90db9a56e4290a07', 'request_id': 'req-4af9652f-3cdd-4bf6-95b8-f48d913ba3fc'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:47.245954 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-4af9652f-3cdd-4bf6-95b8-f48d913ba3fc admin admin] The token cache is being invalidate because project a1da52c54e804adf90db9a56e4290a07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:36:47.246690 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-4af9652f-3cdd-4bf6-95b8-f48d913ba3fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:47.247565 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-4af9652f-3cdd-4bf6-95b8-f48d913ba3fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:47.250229 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1359/2701] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:36:47 2022] DELETE /identity/v3/projects/a1da52c54e804adf90db9a56e4290a07 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 01:36:47.255459 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81597062-1dc1-4eb8-b86a-385e83c019fb None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:47.255852 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81597062-1dc1-4eb8-b86a-385e83c019fb None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:47.256175 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81597062-1dc1-4eb8-b86a-385e83c019fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:47.279632 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-81597062-1dc1-4eb8-b86a-385e83c019fb None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:36:47.280949 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-81597062-1dc1-4eb8-b86a-385e83c019fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:47.283615 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:36:47.301385 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4196f0-8a4e-449d-ae24-e3bded31ec19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:47.314978 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4196f0-8a4e-449d-ae24-e3bded31ec19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:47.315618 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4196f0-8a4e-449d-ae24-e3bded31ec19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:47.316180 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4196f0-8a4e-449d-ae24-e3bded31ec19 admin admin] PATH_INFO: `/v3/users/aae5fe967a6748c4aa4bba59cdbe34f4` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:47.317782 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4196f0-8a4e-449d-ae24-e3bded31ec19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aae5fe967a6748c4aa4bba59cdbe34f4)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:47.319807 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4196f0-8a4e-449d-ae24-e3bded31ec19 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:47.370669 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1360/2702] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:36:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 01:36:47.374795 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a3665-5239-428e-84a6-ad66a6ed6558 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:47.375006 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a3665-5239-428e-84a6-ad66a6ed6558 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:47.375139 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a3665-5239-428e-84a6-ad66a6ed6558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:47.388267 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:36:47.405222 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-2d4196f0-8a4e-449d-ae24-e3bded31ec19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aae5fe967a6748c4aa4bba59cdbe34f4'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:47.405817 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-be1a3665-5239-428e-84a6-ad66a6ed6558 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:36:47.408554 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-be1a3665-5239-428e-84a6-ad66a6ed6558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:47.417464 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-2d4196f0-8a4e-449d-ae24-e3bded31ec19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aae5fe967a6748c4aa4bba59cdbe34f4'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:47.418450 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-2d4196f0-8a4e-449d-ae24-e3bded31ec19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aae5fe967a6748c4aa4bba59cdbe34f4'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:47.422158 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1361/2703] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:36:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:36:47.425161 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1a3665-5239-428e-84a6-ad66a6ed6558 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:47.431235 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-2d4196f0-8a4e-449d-ae24-e3bded31ec19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aae5fe967a6748c4aa4bba59cdbe34f4'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:47.437719 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1a3665-5239-428e-84a6-ad66a6ed6558 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:47.445132 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82362a0-8699-40f3-b223-5f37ebe74461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:47.445528 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-2d4196f0-8a4e-449d-ae24-e3bded31ec19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aae5fe967a6748c4aa4bba59cdbe34f4'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:47.445884 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82362a0-8699-40f3-b223-5f37ebe74461 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:47.446097 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82362a0-8699-40f3-b223-5f37ebe74461 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:47.446519 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82362a0-8699-40f3-b223-5f37ebe74461 admin admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:47.447258 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82362a0-8699-40f3-b223-5f37ebe74461 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:36:47.447652 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82362a0-8699-40f3-b223-5f37ebe74461 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:47.449918 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82362a0-8699-40f3-b223-5f37ebe74461 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:47.469458 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1362/2705] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 01:36:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:36:47.471271 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82362a0-8699-40f3-b223-5f37ebe74461 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:47.472002 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1343/2705] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:36:47 2022] DELETE /identity/v3/users/aae5fe967a6748c4aa4bba59cdbe34f4 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 01:36:47.473133 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-f82362a0-8699-40f3-b223-5f37ebe74461 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:47.475533 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f90ece-c873-4864-adec-98c4c6fd4122 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:47.476016 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f90ece-c873-4864-adec-98c4c6fd4122 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:47.476484 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f90ece-c873-4864-adec-98c4c6fd4122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:47.489340 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82362a0-8699-40f3-b223-5f37ebe74461 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:47.505161 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-25f90ece-c873-4864-adec-98c4c6fd4122 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:36:47.507205 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-25f90ece-c873-4864-adec-98c4c6fd4122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:47.583664 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccc4110-65bd-4f5f-a49a-fdbddd4cf773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:47.584503 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc4110-65bd-4f5f-a49a-fdbddd4cf773 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:47.584717 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc4110-65bd-4f5f-a49a-fdbddd4cf773 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:47.584992 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc4110-65bd-4f5f-a49a-fdbddd4cf773 admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:47.586957 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccc4110-65bd-4f5f-a49a-fdbddd4cf773 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:47.589378 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccc4110-65bd-4f5f-a49a-fdbddd4cf773 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:47.595492 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1344/2706] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:36:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:36:47.608542 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f90ece-c873-4864-adec-98c4c6fd4122 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:47.612251 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-25f90ece-c873-4864-adec-98c4c6fd4122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:47.643656 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1363/2707] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:36:47 2022] POST /identity/v3/projects => generated 369 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:36:47.648047 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccc4110-65bd-4f5f-a49a-fdbddd4cf773 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:47.721654 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f90ece-c873-4864-adec-98c4c6fd4122 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:47.745488 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:36:47.764177 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccc4110-65bd-4f5f-a49a-fdbddd4cf773 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:47.770307 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5630c15-f849-41ad-8606-221bd9a4fa9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:47.770977 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5630c15-f849-41ad-8606-221bd9a4fa9e admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:47.771301 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5630c15-f849-41ad-8606-221bd9a4fa9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:47.771574 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5630c15-f849-41ad-8606-221bd9a4fa9e admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:47.772585 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5630c15-f849-41ad-8606-221bd9a4fa9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:47.775117 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5630c15-f849-41ad-8606-221bd9a4fa9e admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:47.785123 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2864be18-5839-4acd-bc0a-52f8e92527de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:47.785907 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2864be18-5839-4acd-bc0a-52f8e92527de service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:47.786448 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2864be18-5839-4acd-bc0a-52f8e92527de service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:47.786795 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2864be18-5839-4acd-bc0a-52f8e92527de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:47.805995 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2864be18-5839-4acd-bc0a-52f8e92527de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:47.811852 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2864be18-5839-4acd-bc0a-52f8e92527de service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:47.824462 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1364/2708] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:36:47 2022] POST /identity/v3/users => generated 285 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:36:47.825948 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5630c15-f849-41ad-8606-221bd9a4fa9e admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:47.827870 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1345/2709] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:36:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 12 01:36:47.837814 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5630c15-f849-41ad-8606-221bd9a4fa9e admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:47.844167 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181862d3-8a9f-4d68-99eb-851e681108ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:47.844797 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181862d3-8a9f-4d68-99eb-851e681108ae admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:47.845072 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181862d3-8a9f-4d68-99eb-851e681108ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:47.845342 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181862d3-8a9f-4d68-99eb-851e681108ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:47.846053 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181862d3-8a9f-4d68-99eb-851e681108ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:47.847786 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181862d3-8a9f-4d68-99eb-851e681108ae admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:47.859323 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1365/2710] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:36:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:36:47.864643 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2864be18-5839-4acd-bc0a-52f8e92527de service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:47.877379 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2864be18-5839-4acd-bc0a-52f8e92527de service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:47.882687 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbaf85a-49df-401c-9255-f4618443f5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:47.883400 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbaf85a-49df-401c-9255-f4618443f5bf admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:47.883676 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbaf85a-49df-401c-9255-f4618443f5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:47.883938 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbaf85a-49df-401c-9255-f4618443f5bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:47.884582 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbaf85a-49df-401c-9255-f4618443f5bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:47.886479 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbaf85a-49df-401c-9255-f4618443f5bf admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:47.902951 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1346/2711] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:36:47 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:36:47.904194 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181862d3-8a9f-4d68-99eb-851e681108ae admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:47.915975 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181862d3-8a9f-4d68-99eb-851e681108ae admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:47.920996 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0292c4-23bf-4a2e-bc0b-df6119a6e684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:47.921703 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0292c4-23bf-4a2e-bc0b-df6119a6e684 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:47.921976 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0292c4-23bf-4a2e-bc0b-df6119a6e684 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:47.922377 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0292c4-23bf-4a2e-bc0b-df6119a6e684 admin admin] PATH_INFO: `/v3/projects/9471ec05c6ab4880930a4b1a51cbdfd8/users/84dd45fbc4f14463855008381eb478b1/roles/13af81971c1c428eae0a571a22ea583d` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:47.942050 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0292c4-23bf-4a2e-bc0b-df6119a6e684 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9471ec05c6ab4880930a4b1a51cbdfd8, user_id=84dd45fbc4f14463855008381eb478b1, role_id=13af81971c1c428eae0a571a22ea583d)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:47.944816 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0292c4-23bf-4a2e-bc0b-df6119a6e684 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:47.966228 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1366/2712] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:36:47 2022] PUT /identity/v3/projects/9471ec05c6ab4880930a4b1a51cbdfd8/users/84dd45fbc4f14463855008381eb478b1/roles/13af81971c1c428eae0a571a22ea583d => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 01:36:47.968279 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b14c6-9152-4307-964b-c8833996eb76 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:47.968825 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b14c6-9152-4307-964b-c8833996eb76 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:47.969327 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b14c6-9152-4307-964b-c8833996eb76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:47.990048 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-466b14c6-9152-4307-964b-c8833996eb76 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:36:47.991460 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-466b14c6-9152-4307-964b-c8833996eb76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:48.062661 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1347/2713] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:36:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:36:48.068463 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0292c4-23bf-4a2e-bc0b-df6119a6e684 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:48.070383 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-2b0292c4-23bf-4a2e-bc0b-df6119a6e684 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:48.105795 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:36:48.143470 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0292c4-23bf-4a2e-bc0b-df6119a6e684 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:48.148077 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501196aa-7a80-437f-ad46-8c3a60025bd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:48.148703 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501196aa-7a80-437f-ad46-8c3a60025bd6 service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:48.148984 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501196aa-7a80-437f-ad46-8c3a60025bd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:48.149260 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501196aa-7a80-437f-ad46-8c3a60025bd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:48.160835 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501196aa-7a80-437f-ad46-8c3a60025bd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:48.162953 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501196aa-7a80-437f-ad46-8c3a60025bd6 service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:48.174845 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1367/2714] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:36:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:36:48.496493 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466b14c6-9152-4307-964b-c8833996eb76 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:48.498969 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-466b14c6-9152-4307-964b-c8833996eb76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:48.515346 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466b14c6-9152-4307-964b-c8833996eb76 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:48.536357 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f231b69-af23-4a24-9a86-0808eda4f70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:48.537088 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f231b69-af23-4a24-9a86-0808eda4f70a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:48.537371 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f231b69-af23-4a24-9a86-0808eda4f70a admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:48.537711 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f231b69-af23-4a24-9a86-0808eda4f70a admin admin] PATH_INFO: `/v3/projects/07deee95d6034915bfb0d54914035278` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:48.539100 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f231b69-af23-4a24-9a86-0808eda4f70a admin admin] RBAC: Authorizing `identity:delete_project(project_id=07deee95d6034915bfb0d54914035278)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:48.541259 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f231b69-af23-4a24-9a86-0808eda4f70a admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:48.669239 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-2f231b69-af23-4a24-9a86-0808eda4f70a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07deee95d6034915bfb0d54914035278', 'request_id': 'req-2f231b69-af23-4a24-9a86-0808eda4f70a'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:48.683700 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-2f231b69-af23-4a24-9a86-0808eda4f70a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07deee95d6034915bfb0d54914035278', 'request_id': 'req-2f231b69-af23-4a24-9a86-0808eda4f70a'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:48.692182 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-2f231b69-af23-4a24-9a86-0808eda4f70a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07deee95d6034915bfb0d54914035278', 'request_id': 'req-2f231b69-af23-4a24-9a86-0808eda4f70a'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:48.705795 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-2f231b69-af23-4a24-9a86-0808eda4f70a admin admin] The token cache is being invalidate because project 07deee95d6034915bfb0d54914035278 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:36:48.706082 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-2f231b69-af23-4a24-9a86-0808eda4f70a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:48.706762 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-2f231b69-af23-4a24-9a86-0808eda4f70a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:36:48.708530 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1348/2715] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:36:48 2022] DELETE /identity/v3/projects/07deee95d6034915bfb0d54914035278 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:36:48.713659 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfefcb37-2e5a-4ccc-8a36-066f842f33b7 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:48.714664 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfefcb37-2e5a-4ccc-8a36-066f842f33b7 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:48.715125 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfefcb37-2e5a-4ccc-8a36-066f842f33b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:48.749242 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-bfefcb37-2e5a-4ccc-8a36-066f842f33b7 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:36:48.750909 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-bfefcb37-2e5a-4ccc-8a36-066f842f33b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:48.829706 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1368/2716] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:36:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:36:48.838867 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c9522-0e5d-4432-86bd-76ef7db88e14 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:48.839354 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c9522-0e5d-4432-86bd-76ef7db88e14 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:48.839720 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c9522-0e5d-4432-86bd-76ef7db88e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:48.863036 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-f96c9522-0e5d-4432-86bd-76ef7db88e14 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:36:48.864439 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f96c9522-0e5d-4432-86bd-76ef7db88e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:48.877876 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1349/2717] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:36:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:36:48.879944 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfefcb37-2e5a-4ccc-8a36-066f842f33b7 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:48.890923 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfefcb37-2e5a-4ccc-8a36-066f842f33b7 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:48.898527 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efe006f-0010-4260-8ea2-905da4855bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:48.899231 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe006f-0010-4260-8ea2-905da4855bf1 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:48.899626 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe006f-0010-4260-8ea2-905da4855bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:48.899990 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe006f-0010-4260-8ea2-905da4855bf1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:48.901010 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efe006f-0010-4260-8ea2-905da4855bf1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:36:48.901559 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efe006f-0010-4260-8ea2-905da4855bf1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:48.903928 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efe006f-0010-4260-8ea2-905da4855bf1 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:48.919030 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1369/2718] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 01:36:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:36:48.923233 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c9522-0e5d-4432-86bd-76ef7db88e14 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:48.949267 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c9522-0e5d-4432-86bd-76ef7db88e14 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:48.950765 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2032c1-b432-4969-8da4-facc3515a61d None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:48.951128 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2032c1-b432-4969-8da4-facc3515a61d None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:48.951419 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2032c1-b432-4969-8da4-facc3515a61d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:48.956237 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87349656-7e39-4dbe-9e37-c84145eeb2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:48.957459 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87349656-7e39-4dbe-9e37-c84145eeb2c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:48.957935 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87349656-7e39-4dbe-9e37-c84145eeb2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:48.958474 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87349656-7e39-4dbe-9e37-c84145eeb2c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:48.959584 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87349656-7e39-4dbe-9e37-c84145eeb2c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:48.962299 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87349656-7e39-4dbe-9e37-c84145eeb2c0 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:48.980223 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-9e2032c1-b432-4969-8da4-facc3515a61d None None] MFA Rules not processed for user `2b594ca9853f402bb0353616db2ae4c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:36:48.981559 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-9e2032c1-b432-4969-8da4-facc3515a61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:49.009024 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1350/2719] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:36:48 2022] POST /identity/v3/projects => generated 385 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 01:36:49.010415 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87349656-7e39-4dbe-9e37-c84145eeb2c0 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:49.028814 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:36:49.068355 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1370/2720] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:36:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:36:49.097117 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87349656-7e39-4dbe-9e37-c84145eeb2c0 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:49.102217 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491d1067-af39-4d6e-bc5f-5a887e0a8f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:49.103129 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d1067-af39-4d6e-bc5f-5a887e0a8f65 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:49.103404 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d1067-af39-4d6e-bc5f-5a887e0a8f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:49.103672 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d1067-af39-4d6e-bc5f-5a887e0a8f65 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:49.104325 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491d1067-af39-4d6e-bc5f-5a887e0a8f65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:49.106298 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491d1067-af39-4d6e-bc5f-5a887e0a8f65 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:49.166700 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1351/2721] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:36:49 2022] POST /identity/v3/users => generated 293 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:36:49.168304 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2032c1-b432-4969-8da4-facc3515a61d None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:49.181274 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2032c1-b432-4969-8da4-facc3515a61d None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:49.185969 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e973bab-aa5b-4e88-81fa-198a05c55b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:49.186748 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e973bab-aa5b-4e88-81fa-198a05c55b11 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:49.187023 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e973bab-aa5b-4e88-81fa-198a05c55b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:49.187390 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e973bab-aa5b-4e88-81fa-198a05c55b11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:49.188131 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e973bab-aa5b-4e88-81fa-198a05c55b11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:49.189802 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e973bab-aa5b-4e88-81fa-198a05c55b11 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:49.205614 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1371/2722] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:36:49 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:36:49.210089 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491d1067-af39-4d6e-bc5f-5a887e0a8f65 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:49.222275 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491d1067-af39-4d6e-bc5f-5a887e0a8f65 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:49.228133 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9e678c-806b-4720-a108-b947537408ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:49.228877 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e678c-806b-4720-a108-b947537408ae admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:49.229284 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e678c-806b-4720-a108-b947537408ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:49.229617 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e678c-806b-4720-a108-b947537408ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:49.230499 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9e678c-806b-4720-a108-b947537408ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:49.232392 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9e678c-806b-4720-a108-b947537408ae admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:49.246146 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1352/2723] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:36:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:36:49.248407 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e973bab-aa5b-4e88-81fa-198a05c55b11 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:49.260347 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e973bab-aa5b-4e88-81fa-198a05c55b11 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:49.266260 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c2b32f-4748-4698-b862-d1602b72d0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:49.267461 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2b32f-4748-4698-b862-d1602b72d0e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:49.267812 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2b32f-4748-4698-b862-d1602b72d0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:49.268143 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2b32f-4748-4698-b862-d1602b72d0e7 admin admin] PATH_INFO: `/v3/projects/e93a6388627f4bfe91d44f8d9c08b1ef/users/f63bc724a7004e7e8569875309434d9b/roles/13af81971c1c428eae0a571a22ea583d` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:49.302981 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c2b32f-4748-4698-b862-d1602b72d0e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e93a6388627f4bfe91d44f8d9c08b1ef, user_id=f63bc724a7004e7e8569875309434d9b, role_id=13af81971c1c428eae0a571a22ea583d)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:49.305907 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c2b32f-4748-4698-b862-d1602b72d0e7 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:49.343889 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18994eb8-76bb-444e-9a09-f438db0d733f None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:49.344342 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18994eb8-76bb-444e-9a09-f438db0d733f None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:49.344724 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18994eb8-76bb-444e-9a09-f438db0d733f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:49.349170 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1372/2724] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:36:49 2022] PUT /identity/v3/projects/e93a6388627f4bfe91d44f8d9c08b1ef/users/f63bc724a7004e7e8569875309434d9b/roles/13af81971c1c428eae0a571a22ea583d => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 01:36:49.369869 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-18994eb8-76bb-444e-9a09-f438db0d733f None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:36:49.371385 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-18994eb8-76bb-444e-9a09-f438db0d733f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:49.496436 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1353/2725] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:36:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:36:49.510864 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c2b32f-4748-4698-b862-d1602b72d0e7 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:49.513138 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-31c2b32f-4748-4698-b862-d1602b72d0e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:49.550931 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:36:49.598787 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c2b32f-4748-4698-b862-d1602b72d0e7 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:49.603957 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505a04b8-f5dd-4e69-869d-ade3bbd60cb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:49.604923 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a04b8-f5dd-4e69-869d-ade3bbd60cb4 service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:49.605320 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a04b8-f5dd-4e69-869d-ade3bbd60cb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:49.605685 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a04b8-f5dd-4e69-869d-ade3bbd60cb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:49.623703 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505a04b8-f5dd-4e69-869d-ade3bbd60cb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:49.626036 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505a04b8-f5dd-4e69-869d-ade3bbd60cb4 service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:49.642702 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1373/2726] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:36:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:36:49.761499 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18994eb8-76bb-444e-9a09-f438db0d733f None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:49.766516 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-18994eb8-76bb-444e-9a09-f438db0d733f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:49.789599 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18994eb8-76bb-444e-9a09-f438db0d733f None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:49.798100 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffdcea4-d31d-4269-9f45-27e105f22e04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:49.799068 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffdcea4-d31d-4269-9f45-27e105f22e04 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:49.799492 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffdcea4-d31d-4269-9f45-27e105f22e04 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:49.799966 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffdcea4-d31d-4269-9f45-27e105f22e04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:49.803820 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-7ffdcea4-d31d-4269-9f45-27e105f22e04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:49.821063 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffdcea4-d31d-4269-9f45-27e105f22e04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:49.822948 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffdcea4-d31d-4269-9f45-27e105f22e04 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:49.837195 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1354/2727] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:36:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:36:49.888348 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0391d84-b372-40c3-b84a-7eafdb36ef2a None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:49.888860 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0391d84-b372-40c3-b84a-7eafdb36ef2a None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:49.888959 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0391d84-b372-40c3-b84a-7eafdb36ef2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:49.955334 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-b0391d84-b372-40c3-b84a-7eafdb36ef2a None None] MFA Rules not processed for user `84dd45fbc4f14463855008381eb478b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:36:49.956835 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-b0391d84-b372-40c3-b84a-7eafdb36ef2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:50.106556 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1374/2728] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:36:49 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:36:50.116319 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffdcea4-d31d-4269-9f45-27e105f22e04 service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:50.117888 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-7ffdcea4-d31d-4269-9f45-27e105f22e04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:50.251101 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffdcea4-d31d-4269-9f45-27e105f22e04 service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:50.256702 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac045e4c-954a-450a-b1b6-3c35d4f4b8cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7853d40c29af424c8d7913950d89750b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:50.257733 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac045e4c-954a-450a-b1b6-3c35d4f4b8cf service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:50.258438 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac045e4c-954a-450a-b1b6-3c35d4f4b8cf service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:50.259110 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac045e4c-954a-450a-b1b6-3c35d4f4b8cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:50.278801 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac045e4c-954a-450a-b1b6-3c35d4f4b8cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:50.282817 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac045e4c-954a-450a-b1b6-3c35d4f4b8cf service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:50.338842 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1355/2729] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:36:50 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:36:50.418903 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0391d84-b372-40c3-b84a-7eafdb36ef2a None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:50.422911 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-b0391d84-b372-40c3-b84a-7eafdb36ef2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:50.641278 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0391d84-b372-40c3-b84a-7eafdb36ef2a None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:50.651382 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d40402-3616-4ae0-b816-65bb2984b5ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd5e95467b44175be2478c2c7c89926', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:50.652013 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d40402-3616-4ae0-b816-65bb2984b5ef service nova] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:50.652291 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d40402-3616-4ae0-b816-65bb2984b5ef service nova] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:50.652602 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d40402-3616-4ae0-b816-65bb2984b5ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:50.655449 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-08d40402-3616-4ae0-b816-65bb2984b5ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:50.688308 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d40402-3616-4ae0-b816-65bb2984b5ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:50.691098 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d40402-3616-4ae0-b816-65bb2984b5ef service nova] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:50.746780 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1375/2730] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:36:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:36:52.163782 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f6225-9023-434a-93df-01e5ae94cc0a None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:52.164366 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f6225-9023-434a-93df-01e5ae94cc0a None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:52.164366 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f6225-9023-434a-93df-01e5ae94cc0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:52.195349 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-2e3f6225-9023-434a-93df-01e5ae94cc0a None None] MFA Rules not processed for user `84dd45fbc4f14463855008381eb478b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:36:52.200574 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2e3f6225-9023-434a-93df-01e5ae94cc0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:52.211340 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1356/2731] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:36:52 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:36:56.617678 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d40402-3616-4ae0-b816-65bb2984b5ef service nova] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:56.628616 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d40402-3616-4ae0-b816-65bb2984b5ef service nova] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:56.634751 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c3a9ad-b1ae-40ee-9b24-83977f03ef64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:56.635627 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c3a9ad-b1ae-40ee-9b24-83977f03ef64 service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:56.636057 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c3a9ad-b1ae-40ee-9b24-83977f03ef64 service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:56.636865 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c3a9ad-b1ae-40ee-9b24-83977f03ef64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:56.639423 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-53c3a9ad-b1ae-40ee-9b24-83977f03ef64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:56.659890 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c3a9ad-b1ae-40ee-9b24-83977f03ef64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:56.661936 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c3a9ad-b1ae-40ee-9b24-83977f03ef64 service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:56.678821 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1376/2732] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:36:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:36:58.342714 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21f389d-9eea-4072-912f-38f1e86cbcf5 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:58.343286 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21f389d-9eea-4072-912f-38f1e86cbcf5 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:58.343391 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21f389d-9eea-4072-912f-38f1e86cbcf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:58.378602 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:36:58.382551 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-e21f389d-9eea-4072-912f-38f1e86cbcf5 None None] MFA Rules not processed for user `f63bc724a7004e7e8569875309434d9b`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:36:58.384089 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-e21f389d-9eea-4072-912f-38f1e86cbcf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:36:58.482837 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1357/2733] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:36:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:36:58.487697 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c3a9ad-b1ae-40ee-9b24-83977f03ef64 service neutron] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:58.500175 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c3a9ad-b1ae-40ee-9b24-83977f03ef64 service neutron] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:58.507768 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d020bade-893d-4362-ac00-62a52b243522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:58.508407 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020bade-893d-4362-ac00-62a52b243522 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:58.508685 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020bade-893d-4362-ac00-62a52b243522 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:58.508954 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020bade-893d-4362-ac00-62a52b243522 admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:58.509648 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d020bade-893d-4362-ac00-62a52b243522 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:58.511629 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d020bade-893d-4362-ac00-62a52b243522 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:58.546139 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1377/2734] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:36:58 2022] POST /identity/v3/projects => generated 383 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:36:58.547097 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21f389d-9eea-4072-912f-38f1e86cbcf5 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:58.560696 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21f389d-9eea-4072-912f-38f1e86cbcf5 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:58.647812 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529364cc-6f38-46cf-91a8-286df40143f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:58.648604 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529364cc-6f38-46cf-91a8-286df40143f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:58.648880 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529364cc-6f38-46cf-91a8-286df40143f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:58.649150 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529364cc-6f38-46cf-91a8-286df40143f3 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:58.650008 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529364cc-6f38-46cf-91a8-286df40143f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:58.652540 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529364cc-6f38-46cf-91a8-286df40143f3 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:58.686741 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1358/2735] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:36:58 2022] POST /identity/v3/users => generated 298 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 01:36:58.691693 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d020bade-893d-4362-ac00-62a52b243522 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:58.716086 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d020bade-893d-4362-ac00-62a52b243522 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:58.723054 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0663b13f-e62e-429c-a49a-cd5959016e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:58.724386 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0663b13f-e62e-429c-a49a-cd5959016e06 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:58.724984 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0663b13f-e62e-429c-a49a-cd5959016e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:58.725554 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0663b13f-e62e-429c-a49a-cd5959016e06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:58.726496 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0663b13f-e62e-429c-a49a-cd5959016e06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:58.728584 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0663b13f-e62e-429c-a49a-cd5959016e06 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:58.730689 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:36:58.747545 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1378/2736] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:36:58 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:36:58.752014 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529364cc-6f38-46cf-91a8-286df40143f3 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:58.764287 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529364cc-6f38-46cf-91a8-286df40143f3 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:58.770692 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c13bf-ecfc-4ee9-ada9-9c4cc166d504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:58.771639 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c13bf-ecfc-4ee9-ada9-9c4cc166d504 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:58.772196 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c13bf-ecfc-4ee9-ada9-9c4cc166d504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:58.772539 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c13bf-ecfc-4ee9-ada9-9c4cc166d504 admin admin] PATH_INFO: `/v3/projects/dca10f6630614d2f9b7723fedad14fd8/users/7e46893dc252473f9cbf2aabc0fd9c90/roles/fb48693810be495fb4b1893a79429b78` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:58.789381 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5c13bf-ecfc-4ee9-ada9-9c4cc166d504 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dca10f6630614d2f9b7723fedad14fd8, user_id=7e46893dc252473f9cbf2aabc0fd9c90, role_id=fb48693810be495fb4b1893a79429b78)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:58.792400 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5c13bf-ecfc-4ee9-ada9-9c4cc166d504 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:58.814843 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0663b13f-e62e-429c-a49a-cd5959016e06 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:58.825724 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1359/2737] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:36:58 2022] PUT /identity/v3/projects/dca10f6630614d2f9b7723fedad14fd8/users/7e46893dc252473f9cbf2aabc0fd9c90/roles/fb48693810be495fb4b1893a79429b78 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:36:58.831366 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0663b13f-e62e-429c-a49a-cd5959016e06 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:58.904232 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df6a2be-ffac-40d7-84d1-1abeda813e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:58.904966 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6a2be-ffac-40d7-84d1-1abeda813e96 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:58.905251 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6a2be-ffac-40d7-84d1-1abeda813e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:58.905527 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6a2be-ffac-40d7-84d1-1abeda813e96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:58.906232 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df6a2be-ffac-40d7-84d1-1abeda813e96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:58.907890 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df6a2be-ffac-40d7-84d1-1abeda813e96 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:58.925041 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1379/2738] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:36:58 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:36:58.926424 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c13bf-ecfc-4ee9-ada9-9c4cc166d504 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:36:58.939271 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c13bf-ecfc-4ee9-ada9-9c4cc166d504 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:36:58.945073 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262d2896-cf3d-4846-82a7-479a6bae6836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:36:58.945815 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d2896-cf3d-4846-82a7-479a6bae6836 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:36:58.946254 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d2896-cf3d-4846-82a7-479a6bae6836 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:36:58.946744 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d2896-cf3d-4846-82a7-479a6bae6836 admin admin] PATH_INFO: `/v3/projects/dca10f6630614d2f9b7723fedad14fd8/users/7e46893dc252473f9cbf2aabc0fd9c90/roles/fb48693810be495fb4b1893a79429b78` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:36:58.950050 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262d2896-cf3d-4846-82a7-479a6bae6836 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dca10f6630614d2f9b7723fedad14fd8, user_id=7e46893dc252473f9cbf2aabc0fd9c90, role_id=fb48693810be495fb4b1893a79429b78)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:36:58.953338 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262d2896-cf3d-4846-82a7-479a6bae6836 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:36:58.968070 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1360/2739] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:36:58 2022] PUT /identity/v3/projects/dca10f6630614d2f9b7723fedad14fd8/users/7e46893dc252473f9cbf2aabc0fd9c90/roles/fb48693810be495fb4b1893a79429b78 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:37:07.293451 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3b0013-f403-4bf3-a288-901df5bc4661 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:37:07.294061 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3b0013-f403-4bf3-a288-901df5bc4661 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:37:07.294061 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3b0013-f403-4bf3-a288-901df5bc4661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:37:07.350680 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-4d3b0013-f403-4bf3-a288-901df5bc4661 None None] MFA Rules not processed for user `7e46893dc252473f9cbf2aabc0fd9c90`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:37:07.352204 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-4d3b0013-f403-4bf3-a288-901df5bc4661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:37:07.452384 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1380/2740] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:37:07 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:37:07.473214 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262d2896-cf3d-4846-82a7-479a6bae6836 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:37:07.476177 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-262d2896-cf3d-4846-82a7-479a6bae6836 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:37:07.667433 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262d2896-cf3d-4846-82a7-479a6bae6836 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:37:07.678854 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b3ee7-340d-4f89-9d24-fed5410fe15a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd73d9b9b63a499d909fec034bf9a259', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:37:07.684415 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b3ee7-340d-4f89-9d24-fed5410fe15a service glance] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:37:07.685025 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b3ee7-340d-4f89-9d24-fed5410fe15a service glance] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:37:07.685471 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b3ee7-340d-4f89-9d24-fed5410fe15a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:37:07.724646 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:37:07.865527 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66b3ee7-340d-4f89-9d24-fed5410fe15a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:37:07.867084 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66b3ee7-340d-4f89-9d24-fed5410fe15a service glance] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:37:07.878744 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1361/2741] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:37:07 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:37:08.076334 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aeaa28-6e58-4712-9dbf-171a9e194d9a None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:37:08.076728 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aeaa28-6e58-4712-9dbf-171a9e194d9a None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:37:08.076958 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aeaa28-6e58-4712-9dbf-171a9e194d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:37:08.103979 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-08aeaa28-6e58-4712-9dbf-171a9e194d9a None None] MFA Rules not processed for user `f3643631cf2d4a9592d465bdeba99669`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:37:08.105925 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-08aeaa28-6e58-4712-9dbf-171a9e194d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:37:08.241568 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1381/2742] 10.222.0.26 () {58 vars in 1009 bytes} [Fri Aug 12 01:37:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:37:08.321262 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b3ee7-340d-4f89-9d24-fed5410fe15a service glance] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:37:08.323820 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-a66b3ee7-340d-4f89-9d24-fed5410fe15a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:37:08.510333 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b3ee7-340d-4f89-9d24-fed5410fe15a service glance] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:37:08.516886 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5598f9b-5ffd-4938-84de-afcbf27f2076 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32c1ba237f864b5d9699cb817e42e647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:37:08.517753 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5598f9b-5ffd-4938-84de-afcbf27f2076 service swift] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:37:08.518407 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5598f9b-5ffd-4938-84de-afcbf27f2076 service swift] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:37:08.518856 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5598f9b-5ffd-4938-84de-afcbf27f2076 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:37:08.532812 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5598f9b-5ffd-4938-84de-afcbf27f2076 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:37:08.534910 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5598f9b-5ffd-4938-84de-afcbf27f2076 service swift] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:37:08.560746 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1362/2743] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Aug 12 01:37:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 12 01:37:09.377189 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aeaa28-6e58-4712-9dbf-171a9e194d9a None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:37:09.381766 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-08aeaa28-6e58-4712-9dbf-171a9e194d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:37:09.471516 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:37:09.539124 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aeaa28-6e58-4712-9dbf-171a9e194d9a None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:37:09.544621 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5221bf2b-781b-49d9-a466-cd6b0251baf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:37:09.545595 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5221bf2b-781b-49d9-a466-cd6b0251baf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:37:09.546106 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5221bf2b-781b-49d9-a466-cd6b0251baf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:37:09.546687 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5221bf2b-781b-49d9-a466-cd6b0251baf6 admin admin] PATH_INFO: `/v3/users/fc190e9f188a4d8d99e58e06e5557391` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:37:09.548034 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5221bf2b-781b-49d9-a466-cd6b0251baf6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc190e9f188a4d8d99e58e06e5557391)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:37:09.550236 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5221bf2b-781b-49d9-a466-cd6b0251baf6 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:37:09.635103 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-5221bf2b-781b-49d9-a466-cd6b0251baf6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc190e9f188a4d8d99e58e06e5557391'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:37:09.646134 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-5221bf2b-781b-49d9-a466-cd6b0251baf6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc190e9f188a4d8d99e58e06e5557391'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:37:09.646845 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-5221bf2b-781b-49d9-a466-cd6b0251baf6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc190e9f188a4d8d99e58e06e5557391'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:37:09.657786 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-5221bf2b-781b-49d9-a466-cd6b0251baf6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc190e9f188a4d8d99e58e06e5557391'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:37:09.672949 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-5221bf2b-781b-49d9-a466-cd6b0251baf6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc190e9f188a4d8d99e58e06e5557391'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:37:09.681917 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1382/2744] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:37:09 2022] DELETE /identity/v3/users/fc190e9f188a4d8d99e58e06e5557391 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:37:09.917460 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5598f9b-5ffd-4938-84de-afcbf27f2076 service swift] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:37:09.931513 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5598f9b-5ffd-4938-84de-afcbf27f2076 service swift] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:37:10.022920 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef54ecb-d3b7-407a-832f-fd3f60659c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:37:10.024586 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef54ecb-d3b7-407a-832f-fd3f60659c4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:37:10.025140 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef54ecb-d3b7-407a-832f-fd3f60659c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:37:10.025569 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef54ecb-d3b7-407a-832f-fd3f60659c4c admin admin] PATH_INFO: `/v3/projects/0aac8eeb70174f9386bd57fc38644de1` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:37:10.026923 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef54ecb-d3b7-407a-832f-fd3f60659c4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0aac8eeb70174f9386bd57fc38644de1)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:37:10.030092 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef54ecb-d3b7-407a-832f-fd3f60659c4c admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:37:10.119580 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:37:10.133359 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7ef54ecb-d3b7-407a-832f-fd3f60659c4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0aac8eeb70174f9386bd57fc38644de1', 'request_id': 'req-7ef54ecb-d3b7-407a-832f-fd3f60659c4c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:37:10.158979 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7ef54ecb-d3b7-407a-832f-fd3f60659c4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0aac8eeb70174f9386bd57fc38644de1', 'request_id': 'req-7ef54ecb-d3b7-407a-832f-fd3f60659c4c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:37:10.166795 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7ef54ecb-d3b7-407a-832f-fd3f60659c4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0aac8eeb70174f9386bd57fc38644de1', 'request_id': 'req-7ef54ecb-d3b7-407a-832f-fd3f60659c4c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:37:10.184813 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7ef54ecb-d3b7-407a-832f-fd3f60659c4c admin admin] The token cache is being invalidate because project 0aac8eeb70174f9386bd57fc38644de1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:37:10.187772 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7ef54ecb-d3b7-407a-832f-fd3f60659c4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:37:10.187772 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7ef54ecb-d3b7-407a-832f-fd3f60659c4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:37:10.194264 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1363/2745] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:37:09 2022] DELETE /identity/v3/projects/0aac8eeb70174f9386bd57fc38644de1 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:37:10.195279 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5221bf2b-781b-49d9-a466-cd6b0251baf6 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:37:10.196757 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-5221bf2b-781b-49d9-a466-cd6b0251baf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:37:10.219891 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5221bf2b-781b-49d9-a466-cd6b0251baf6 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:37:10.339346 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d7c509-223f-4abd-9fb2-f176ba7b9182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:37:10.340102 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d7c509-223f-4abd-9fb2-f176ba7b9182 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:37:10.340382 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d7c509-223f-4abd-9fb2-f176ba7b9182 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:37:10.340680 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d7c509-223f-4abd-9fb2-f176ba7b9182 admin admin] PATH_INFO: `/v3/users/fac008855aa74358b2f1a78601446257` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:37:10.342810 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d7c509-223f-4abd-9fb2-f176ba7b9182 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fac008855aa74358b2f1a78601446257)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:37:10.344762 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d7c509-223f-4abd-9fb2-f176ba7b9182 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:37:10.427008 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:37:10.434795 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-97d7c509-223f-4abd-9fb2-f176ba7b9182 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fac008855aa74358b2f1a78601446257'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:37:10.449193 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-97d7c509-223f-4abd-9fb2-f176ba7b9182 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fac008855aa74358b2f1a78601446257'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:37:10.450521 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-97d7c509-223f-4abd-9fb2-f176ba7b9182 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fac008855aa74358b2f1a78601446257'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:37:10.468257 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-97d7c509-223f-4abd-9fb2-f176ba7b9182 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fac008855aa74358b2f1a78601446257'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:37:10.483396 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-97d7c509-223f-4abd-9fb2-f176ba7b9182 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fac008855aa74358b2f1a78601446257'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:37:10.490877 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1383/2746] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:37:10 2022] DELETE /identity/v3/users/fac008855aa74358b2f1a78601446257 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:37:10.801507 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef54ecb-d3b7-407a-832f-fd3f60659c4c admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:37:10.803971 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-7ef54ecb-d3b7-407a-832f-fd3f60659c4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:37:10.833778 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef54ecb-d3b7-407a-832f-fd3f60659c4c admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:37:10.916520 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567ff4ca-8c4c-4097-a9be-7b42cfefa380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:37:10.917360 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ff4ca-8c4c-4097-a9be-7b42cfefa380 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:37:10.917890 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ff4ca-8c4c-4097-a9be-7b42cfefa380 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:37:10.918513 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ff4ca-8c4c-4097-a9be-7b42cfefa380 admin admin] PATH_INFO: `/v3/projects/157cb42c62154049b2409a9d9a19d437` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:37:10.922364 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567ff4ca-8c4c-4097-a9be-7b42cfefa380 admin admin] RBAC: Authorizing `identity:delete_project(project_id=157cb42c62154049b2409a9d9a19d437)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:37:10.925174 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567ff4ca-8c4c-4097-a9be-7b42cfefa380 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:37:10.995350 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-567ff4ca-8c4c-4097-a9be-7b42cfefa380 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '157cb42c62154049b2409a9d9a19d437', 'request_id': 'req-567ff4ca-8c4c-4097-a9be-7b42cfefa380'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:37:11.006382 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-567ff4ca-8c4c-4097-a9be-7b42cfefa380 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '157cb42c62154049b2409a9d9a19d437', 'request_id': 'req-567ff4ca-8c4c-4097-a9be-7b42cfefa380'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:37:11.016333 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-567ff4ca-8c4c-4097-a9be-7b42cfefa380 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '157cb42c62154049b2409a9d9a19d437', 'request_id': 'req-567ff4ca-8c4c-4097-a9be-7b42cfefa380'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:37:11.050189 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-567ff4ca-8c4c-4097-a9be-7b42cfefa380 admin admin] The token cache is being invalidate because project 157cb42c62154049b2409a9d9a19d437 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:37:11.051264 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-567ff4ca-8c4c-4097-a9be-7b42cfefa380 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:37:11.052132 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-567ff4ca-8c4c-4097-a9be-7b42cfefa380 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:37:11.062027 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1364/2747] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:37:10 2022] DELETE /identity/v3/projects/157cb42c62154049b2409a9d9a19d437 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:37:13.033790 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dadc05-52cc-48fe-a756-432257feec05 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:37:13.034399 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dadc05-52cc-48fe-a756-432257feec05 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:37:13.034668 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dadc05-52cc-48fe-a756-432257feec05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:37:13.057955 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-19dadc05-52cc-48fe-a756-432257feec05 None None] MFA Rules not processed for user `84dd45fbc4f14463855008381eb478b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:37:13.059584 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-19dadc05-52cc-48fe-a756-432257feec05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:37:13.125458 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1384/2748] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:37:13 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:37:13.402271 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567ff4ca-8c4c-4097-a9be-7b42cfefa380 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:37:13.403773 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-567ff4ca-8c4c-4097-a9be-7b42cfefa380 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:37:13.469646 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567ff4ca-8c4c-4097-a9be-7b42cfefa380 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:37:13.473677 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1490fc-5d64-4218-a07c-f83929cd18a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:37:13.474335 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1490fc-5d64-4218-a07c-f83929cd18a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:37:13.474621 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1490fc-5d64-4218-a07c-f83929cd18a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:37:13.474882 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1490fc-5d64-4218-a07c-f83929cd18a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:37:13.490522 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2b1490fc-5d64-4218-a07c-f83929cd18a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:37:13.502389 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1490fc-5d64-4218-a07c-f83929cd18a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:37:13.503899 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1490fc-5d64-4218-a07c-f83929cd18a4 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:37:13.516959 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1365/2749] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:37:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:37:18.871777 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c9f3b-5d54-4d83-8d2d-29b5b28cc353 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:37:18.872357 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c9f3b-5d54-4d83-8d2d-29b5b28cc353 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:37:18.872357 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c9f3b-5d54-4d83-8d2d-29b5b28cc353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:37:18.891701 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-c43c9f3b-5d54-4d83-8d2d-29b5b28cc353 None None] MFA Rules not processed for user `f63bc724a7004e7e8569875309434d9b`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:37:18.892932 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-c43c9f3b-5d54-4d83-8d2d-29b5b28cc353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:37:18.947766 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1385/2750] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:37:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 01:37:20.907375 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e03691a-9016-4844-8be4-96601a31f6e3 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:37:20.907871 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e03691a-9016-4844-8be4-96601a31f6e3 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:37:20.907970 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e03691a-9016-4844-8be4-96601a31f6e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:37:20.915792 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:37:20.930651 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-0e03691a-9016-4844-8be4-96601a31f6e3 None None] MFA Rules not processed for user `f3643631cf2d4a9592d465bdeba99669`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:37:20.932874 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-0e03691a-9016-4844-8be4-96601a31f6e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:37:20.988636 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1366/2751] 10.222.0.26 () {58 vars in 1009 bytes} [Fri Aug 12 01:37:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:37:21.003689 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43c9f3b-5d54-4d83-8d2d-29b5b28cc353 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:37:21.005229 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-c43c9f3b-5d54-4d83-8d2d-29b5b28cc353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:37:21.080588 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43c9f3b-5d54-4d83-8d2d-29b5b28cc353 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:37:21.085564 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc25ac-b26d-461a-8dc5-f639488d469f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32c1ba237f864b5d9699cb817e42e647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:37:21.086207 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc25ac-b26d-461a-8dc5-f639488d469f service swift] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:37:21.086481 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc25ac-b26d-461a-8dc5-f639488d469f service swift] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:37:21.086747 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc25ac-b26d-461a-8dc5-f639488d469f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:37:21.095087 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bc25ac-b26d-461a-8dc5-f639488d469f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:37:21.096662 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bc25ac-b26d-461a-8dc5-f639488d469f service swift] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:37:21.101132 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:37:21.105894 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1386/2752] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Aug 12 01:37:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 12 01:37:30.989716 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=24 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:37:37.648161 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f9667-6c80-4def-9ed0-e4ee3b65dbea None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:37:37.648984 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f9667-6c80-4def-9ed0-e4ee3b65dbea None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:37:37.648984 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f9667-6c80-4def-9ed0-e4ee3b65dbea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:37:37.670109 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-913f9667-6c80-4def-9ed0-e4ee3b65dbea None None] MFA Rules not processed for user `f3643631cf2d4a9592d465bdeba99669`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:37:37.671331 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-913f9667-6c80-4def-9ed0-e4ee3b65dbea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:37:37.679607 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1367/2753] 10.222.0.26 () {58 vars in 1009 bytes} [Fri Aug 12 01:37:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:37:37.692477 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc25ac-b26d-461a-8dc5-f639488d469f service swift] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:37:37.703512 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc25ac-b26d-461a-8dc5-f639488d469f service swift] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:37:37.709937 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acb7797-04c6-4874-8c44-ac785a2fb76a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32c1ba237f864b5d9699cb817e42e647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:37:37.710603 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb7797-04c6-4874-8c44-ac785a2fb76a service swift] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:37:37.710878 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb7797-04c6-4874-8c44-ac785a2fb76a service swift] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:37:37.711146 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb7797-04c6-4874-8c44-ac785a2fb76a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:37:37.720133 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acb7797-04c6-4874-8c44-ac785a2fb76a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:37:37.721695 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acb7797-04c6-4874-8c44-ac785a2fb76a service swift] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:37:37.730892 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1387/2754] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Aug 12 01:37:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 12 01:37:42.817238 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f9667-6c80-4def-9ed0-e4ee3b65dbea None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:37:42.819734 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-913f9667-6c80-4def-9ed0-e4ee3b65dbea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:37:42.834061 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f9667-6c80-4def-9ed0-e4ee3b65dbea None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:37:42.838503 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af08f74b-e95f-429f-b82e-df98b34a6365 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:37:42.839352 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af08f74b-e95f-429f-b82e-df98b34a6365 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:37:42.839801 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af08f74b-e95f-429f-b82e-df98b34a6365 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:37:42.840063 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af08f74b-e95f-429f-b82e-df98b34a6365 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:37:42.841964 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-af08f74b-e95f-429f-b82e-df98b34a6365 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:37:42.912041 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af08f74b-e95f-429f-b82e-df98b34a6365 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:37:42.913711 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af08f74b-e95f-429f-b82e-df98b34a6365 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:37:42.925196 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1368/2755] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:37:42 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:37:47.729094 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=6 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:37:52.920668 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=33 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:37:54.460616 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42567ad0-52cd-4ac7-b85e-7887fe0d9d1a None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:37:54.461134 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42567ad0-52cd-4ac7-b85e-7887fe0d9d1a None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:37:54.461134 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42567ad0-52cd-4ac7-b85e-7887fe0d9d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:37:54.480172 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-42567ad0-52cd-4ac7-b85e-7887fe0d9d1a None None] MFA Rules not processed for user `f3643631cf2d4a9592d465bdeba99669`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:37:54.481370 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-42567ad0-52cd-4ac7-b85e-7887fe0d9d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:37:54.488905 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1388/2756] 10.222.0.26 () {58 vars in 967 bytes} [Fri Aug 12 01:37:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:37:54.502002 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af08f74b-e95f-429f-b82e-df98b34a6365 service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:37:54.513263 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af08f74b-e95f-429f-b82e-df98b34a6365 service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:37:54.518194 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84de767-42e1-4cfc-9bdd-40ca5f1e3f50 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32c1ba237f864b5d9699cb817e42e647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:37:54.518783 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84de767-42e1-4cfc-9bdd-40ca5f1e3f50 service swift] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:37:54.519055 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84de767-42e1-4cfc-9bdd-40ca5f1e3f50 service swift] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:37:54.519320 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84de767-42e1-4cfc-9bdd-40ca5f1e3f50 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:37:54.527711 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84de767-42e1-4cfc-9bdd-40ca5f1e3f50 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:37:54.529287 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84de767-42e1-4cfc-9bdd-40ca5f1e3f50 service swift] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:37:54.538190 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1369/2757] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Aug 12 01:37:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 12 01:37:56.505348 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42567ad0-52cd-4ac7-b85e-7887fe0d9d1a None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:37:56.507438 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-42567ad0-52cd-4ac7-b85e-7887fe0d9d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:37:56.580713 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42567ad0-52cd-4ac7-b85e-7887fe0d9d1a None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:37:56.585913 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68537a89-3b86-4f51-a398-0e655767b2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:37:56.586609 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68537a89-3b86-4f51-a398-0e655767b2d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:37:56.586878 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68537a89-3b86-4f51-a398-0e655767b2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:37:56.587137 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68537a89-3b86-4f51-a398-0e655767b2d1 admin admin] PATH_INFO: `/v3/users/84dd45fbc4f14463855008381eb478b1` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:37:56.588382 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68537a89-3b86-4f51-a398-0e655767b2d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84dd45fbc4f14463855008381eb478b1)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:37:56.590531 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68537a89-3b86-4f51-a398-0e655767b2d1 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:37:56.643433 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-68537a89-3b86-4f51-a398-0e655767b2d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84dd45fbc4f14463855008381eb478b1'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:37:56.652020 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-68537a89-3b86-4f51-a398-0e655767b2d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84dd45fbc4f14463855008381eb478b1'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:37:56.652712 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-68537a89-3b86-4f51-a398-0e655767b2d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84dd45fbc4f14463855008381eb478b1'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:37:56.659871 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-68537a89-3b86-4f51-a398-0e655767b2d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84dd45fbc4f14463855008381eb478b1'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:37:56.672542 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-68537a89-3b86-4f51-a398-0e655767b2d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84dd45fbc4f14463855008381eb478b1'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:37:56.678983 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1389/2758] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:37:56 2022] DELETE /identity/v3/users/84dd45fbc4f14463855008381eb478b1 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:37:56.940039 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84de767-42e1-4cfc-9bdd-40ca5f1e3f50 service swift] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:37:56.957307 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84de767-42e1-4cfc-9bdd-40ca5f1e3f50 service swift] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:37:57.008333 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6651c4-5aed-466f-9311-cd017328f0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:37:57.008964 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6651c4-5aed-466f-9311-cd017328f0b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:37:57.009244 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6651c4-5aed-466f-9311-cd017328f0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:37:57.009515 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6651c4-5aed-466f-9311-cd017328f0b1 admin admin] PATH_INFO: `/v3/projects/9471ec05c6ab4880930a4b1a51cbdfd8` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:37:57.010748 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6651c4-5aed-466f-9311-cd017328f0b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9471ec05c6ab4880930a4b1a51cbdfd8)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:37:57.012644 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6651c4-5aed-466f-9311-cd017328f0b1 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:37:57.063951 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-bb6651c4-5aed-466f-9311-cd017328f0b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9471ec05c6ab4880930a4b1a51cbdfd8', 'request_id': 'req-bb6651c4-5aed-466f-9311-cd017328f0b1'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:37:57.071513 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-bb6651c4-5aed-466f-9311-cd017328f0b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9471ec05c6ab4880930a4b1a51cbdfd8', 'request_id': 'req-bb6651c4-5aed-466f-9311-cd017328f0b1'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:37:57.077064 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-bb6651c4-5aed-466f-9311-cd017328f0b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9471ec05c6ab4880930a4b1a51cbdfd8', 'request_id': 'req-bb6651c4-5aed-466f-9311-cd017328f0b1'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:37:57.088338 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-bb6651c4-5aed-466f-9311-cd017328f0b1 admin admin] The token cache is being invalidate because project 9471ec05c6ab4880930a4b1a51cbdfd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:37:57.088619 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-bb6651c4-5aed-466f-9311-cd017328f0b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:37:57.089325 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-bb6651c4-5aed-466f-9311-cd017328f0b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:37:57.090943 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1370/2759] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:37:56 2022] DELETE /identity/v3/projects/9471ec05c6ab4880930a4b1a51cbdfd8 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:38:06.675353 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=56,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:38:07.085306 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:39:17.281176 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68537a89-3b86-4f51-a398-0e655767b2d1 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:39:17.282758 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-68537a89-3b86-4f51-a398-0e655767b2d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:39:17.429476 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68537a89-3b86-4f51-a398-0e655767b2d1 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:39:17.498220 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af90b7a-7fbd-44c2-a8da-0f8e43b0ff56 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06dccf61c686414d904bdf1ecf19d53d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:39:17.498862 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af90b7a-7fbd-44c2-a8da-0f8e43b0ff56 service placement] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:39:17.499393 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af90b7a-7fbd-44c2-a8da-0f8e43b0ff56 service placement] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:39:17.499603 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af90b7a-7fbd-44c2-a8da-0f8e43b0ff56 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:39:17.501876 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-7af90b7a-7fbd-44c2-a8da-0f8e43b0ff56 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:39:17.513610 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af90b7a-7fbd-44c2-a8da-0f8e43b0ff56 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:39:17.515259 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af90b7a-7fbd-44c2-a8da-0f8e43b0ff56 service placement] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:39:17.526249 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1390/2760] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:39:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:39:19.801645 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c20a4-68b2-4d27-89ad-57250b8e67e8 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:39:19.802188 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c20a4-68b2-4d27-89ad-57250b8e67e8 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:39:19.802295 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c20a4-68b2-4d27-89ad-57250b8e67e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:39:19.833496 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-7f6c20a4-68b2-4d27-89ad-57250b8e67e8 None None] MFA Rules not processed for user `f3643631cf2d4a9592d465bdeba99669`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:39:19.834728 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-7f6c20a4-68b2-4d27-89ad-57250b8e67e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:39:19.896930 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1371/2761] 10.222.0.26 () {58 vars in 967 bytes} [Fri Aug 12 01:39:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:39:19.947579 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af90b7a-7fbd-44c2-a8da-0f8e43b0ff56 service placement] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:39:19.949194 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-7af90b7a-7fbd-44c2-a8da-0f8e43b0ff56 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:39:19.978500 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:39:20.019588 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af90b7a-7fbd-44c2-a8da-0f8e43b0ff56 service placement] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:39:20.025344 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aa2f2e-6926-4013-af26-1f56ca0a8586 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32c1ba237f864b5d9699cb817e42e647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:39:20.025939 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa2f2e-6926-4013-af26-1f56ca0a8586 service swift] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:39:20.026247 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa2f2e-6926-4013-af26-1f56ca0a8586 service swift] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:39:20.026477 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa2f2e-6926-4013-af26-1f56ca0a8586 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:39:20.034792 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aa2f2e-6926-4013-af26-1f56ca0a8586 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:39:20.036356 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aa2f2e-6926-4013-af26-1f56ca0a8586 service swift] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:39:20.046206 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1391/2762] 10.222.0.26 () {60 vars in 1384 bytes} [Fri Aug 12 01:39:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 12 01:39:26.753386 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c20a4-68b2-4d27-89ad-57250b8e67e8 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:39:26.754927 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-7f6c20a4-68b2-4d27-89ad-57250b8e67e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:39:26.867023 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c20a4-68b2-4d27-89ad-57250b8e67e8 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:39:26.871634 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c13f56e-3707-48dd-bfe9-18f9356afd89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:39:26.872189 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13f56e-3707-48dd-bfe9-18f9356afd89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:39:26.872474 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13f56e-3707-48dd-bfe9-18f9356afd89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:39:26.872741 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13f56e-3707-48dd-bfe9-18f9356afd89 admin admin] PATH_INFO: `/v3/users/f63bc724a7004e7e8569875309434d9b` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:39:26.873989 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c13f56e-3707-48dd-bfe9-18f9356afd89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f63bc724a7004e7e8569875309434d9b)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:39:26.876018 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c13f56e-3707-48dd-bfe9-18f9356afd89 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:39:26.935136 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7c13f56e-3707-48dd-bfe9-18f9356afd89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f63bc724a7004e7e8569875309434d9b'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:39:26.944756 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7c13f56e-3707-48dd-bfe9-18f9356afd89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f63bc724a7004e7e8569875309434d9b'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:39:26.945555 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7c13f56e-3707-48dd-bfe9-18f9356afd89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f63bc724a7004e7e8569875309434d9b'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:39:26.953625 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7c13f56e-3707-48dd-bfe9-18f9356afd89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f63bc724a7004e7e8569875309434d9b'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:39:26.954891 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:39:26.967931 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7c13f56e-3707-48dd-bfe9-18f9356afd89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f63bc724a7004e7e8569875309434d9b'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:39:26.974078 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1372/2763] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:39:26 2022] DELETE /identity/v3/users/f63bc724a7004e7e8569875309434d9b => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:39:27.211250 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aa2f2e-6926-4013-af26-1f56ca0a8586 service swift] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:39:27.222732 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aa2f2e-6926-4013-af26-1f56ca0a8586 service swift] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:39:27.315534 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d4e1de-8dbd-4e16-b9e1-9c886e65f238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:39:27.316888 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d4e1de-8dbd-4e16-b9e1-9c886e65f238 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:39:27.316888 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d4e1de-8dbd-4e16-b9e1-9c886e65f238 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:39:27.317136 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d4e1de-8dbd-4e16-b9e1-9c886e65f238 admin admin] PATH_INFO: `/v3/projects/e93a6388627f4bfe91d44f8d9c08b1ef` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:39:27.318388 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d4e1de-8dbd-4e16-b9e1-9c886e65f238 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e93a6388627f4bfe91d44f8d9c08b1ef)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:39:27.320678 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d4e1de-8dbd-4e16-b9e1-9c886e65f238 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:39:27.372363 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-c2d4e1de-8dbd-4e16-b9e1-9c886e65f238 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e93a6388627f4bfe91d44f8d9c08b1ef', 'request_id': 'req-c2d4e1de-8dbd-4e16-b9e1-9c886e65f238'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:39:27.378292 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-c2d4e1de-8dbd-4e16-b9e1-9c886e65f238 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e93a6388627f4bfe91d44f8d9c08b1ef', 'request_id': 'req-c2d4e1de-8dbd-4e16-b9e1-9c886e65f238'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:39:27.384425 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-c2d4e1de-8dbd-4e16-b9e1-9c886e65f238 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e93a6388627f4bfe91d44f8d9c08b1ef', 'request_id': 'req-c2d4e1de-8dbd-4e16-b9e1-9c886e65f238'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:39:27.397673 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-c2d4e1de-8dbd-4e16-b9e1-9c886e65f238 admin admin] The token cache is being invalidate because project e93a6388627f4bfe91d44f8d9c08b1ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:39:27.397883 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-c2d4e1de-8dbd-4e16-b9e1-9c886e65f238 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:39:27.398503 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-c2d4e1de-8dbd-4e16-b9e1-9c886e65f238 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:39:27.400023 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1392/2764] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:39:27 2022] DELETE /identity/v3/projects/e93a6388627f4bfe91d44f8d9c08b1ef => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:39:27.404165 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c13f56e-3707-48dd-bfe9-18f9356afd89 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:39:27.405971 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-7c13f56e-3707-48dd-bfe9-18f9356afd89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:39:27.418953 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c13f56e-3707-48dd-bfe9-18f9356afd89 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:39:27.475510 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d48ada-ec65-4c36-97d7-5a1fb28a92c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:39:27.476148 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d48ada-ec65-4c36-97d7-5a1fb28a92c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:39:27.476410 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d48ada-ec65-4c36-97d7-5a1fb28a92c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:39:27.476678 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d48ada-ec65-4c36-97d7-5a1fb28a92c8 admin admin] PATH_INFO: `/v3/users/7e46893dc252473f9cbf2aabc0fd9c90` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:39:27.477843 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d48ada-ec65-4c36-97d7-5a1fb28a92c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e46893dc252473f9cbf2aabc0fd9c90)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:39:27.479798 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d48ada-ec65-4c36-97d7-5a1fb28a92c8 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:39:27.537297 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-74d48ada-ec65-4c36-97d7-5a1fb28a92c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e46893dc252473f9cbf2aabc0fd9c90'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:39:27.548545 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-74d48ada-ec65-4c36-97d7-5a1fb28a92c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e46893dc252473f9cbf2aabc0fd9c90'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:39:27.549383 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-74d48ada-ec65-4c36-97d7-5a1fb28a92c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e46893dc252473f9cbf2aabc0fd9c90'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:39:27.558749 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-74d48ada-ec65-4c36-97d7-5a1fb28a92c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e46893dc252473f9cbf2aabc0fd9c90'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:39:27.577678 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-74d48ada-ec65-4c36-97d7-5a1fb28a92c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e46893dc252473f9cbf2aabc0fd9c90'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:39:27.588580 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1373/2765] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:39:27 2022] DELETE /identity/v3/users/7e46893dc252473f9cbf2aabc0fd9c90 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:39:27.816018 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d4e1de-8dbd-4e16-b9e1-9c886e65f238 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:39:27.818560 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-c2d4e1de-8dbd-4e16-b9e1-9c886e65f238 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:39:27.835955 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d4e1de-8dbd-4e16-b9e1-9c886e65f238 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:39:27.889683 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:39:27.907238 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba4f9e6-4c9f-40e0-a61e-ae1adf256e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:39:27.908115 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba4f9e6-4c9f-40e0-a61e-ae1adf256e25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:39:27.908566 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba4f9e6-4c9f-40e0-a61e-ae1adf256e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:39:27.908872 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba4f9e6-4c9f-40e0-a61e-ae1adf256e25 admin admin] PATH_INFO: `/v3/projects/dca10f6630614d2f9b7723fedad14fd8` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:39:27.910042 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba4f9e6-4c9f-40e0-a61e-ae1adf256e25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dca10f6630614d2f9b7723fedad14fd8)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:39:27.912004 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba4f9e6-4c9f-40e0-a61e-ae1adf256e25 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:39:27.960636 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-8ba4f9e6-4c9f-40e0-a61e-ae1adf256e25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dca10f6630614d2f9b7723fedad14fd8', 'request_id': 'req-8ba4f9e6-4c9f-40e0-a61e-ae1adf256e25'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:39:27.965889 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-8ba4f9e6-4c9f-40e0-a61e-ae1adf256e25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dca10f6630614d2f9b7723fedad14fd8', 'request_id': 'req-8ba4f9e6-4c9f-40e0-a61e-ae1adf256e25'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:39:27.972187 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-8ba4f9e6-4c9f-40e0-a61e-ae1adf256e25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dca10f6630614d2f9b7723fedad14fd8', 'request_id': 'req-8ba4f9e6-4c9f-40e0-a61e-ae1adf256e25'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:39:27.988288 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-8ba4f9e6-4c9f-40e0-a61e-ae1adf256e25 admin admin] The token cache is being invalidate because project dca10f6630614d2f9b7723fedad14fd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:39:27.988584 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-8ba4f9e6-4c9f-40e0-a61e-ae1adf256e25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:39:27.990210 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-8ba4f9e6-4c9f-40e0-a61e-ae1adf256e25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:39:27.992356 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1393/2766] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:39:27 2022] DELETE /identity/v3/projects/dca10f6630614d2f9b7723fedad14fd8 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:39:30.541724 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4840b83-0eeb-41fa-979c-a3164a9dac4e None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:39:30.542267 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4840b83-0eeb-41fa-979c-a3164a9dac4e None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:39:30.542267 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4840b83-0eeb-41fa-979c-a3164a9dac4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:39:30.562445 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-b4840b83-0eeb-41fa-979c-a3164a9dac4e None None] MFA Rules not processed for user `2b594ca9853f402bb0353616db2ae4c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:39:30.563661 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-b4840b83-0eeb-41fa-979c-a3164a9dac4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:39:30.623458 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1374/2767] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:39:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:39:37.984853 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=31,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:39:40.614142 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:40:20.519490 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba4f9e6-4c9f-40e0-a61e-ae1adf256e25 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:40:20.521171 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-8ba4f9e6-4c9f-40e0-a61e-ae1adf256e25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:40:20.602879 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba4f9e6-4c9f-40e0-a61e-ae1adf256e25 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:40:20.606714 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df109da-c588-4b74-8535-e01eef220bd5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7853d40c29af424c8d7913950d89750b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:40:20.607307 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df109da-c588-4b74-8535-e01eef220bd5 service cinder] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:20.607580 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df109da-c588-4b74-8535-e01eef220bd5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:20.607843 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df109da-c588-4b74-8535-e01eef220bd5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:20.609855 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-4df109da-c588-4b74-8535-e01eef220bd5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:40:20.699059 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df109da-c588-4b74-8535-e01eef220bd5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:40:20.700475 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df109da-c588-4b74-8535-e01eef220bd5 service cinder] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:40:20.721180 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1394/2768] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:40:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:40:23.688699 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4840b83-0eeb-41fa-979c-a3164a9dac4e None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:40:23.690392 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-b4840b83-0eeb-41fa-979c-a3164a9dac4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:40:23.703953 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4840b83-0eeb-41fa-979c-a3164a9dac4e None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:40:23.708635 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5268ddde-e267-4c5b-9bbf-ca6d1118d29f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7853d40c29af424c8d7913950d89750b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:40:23.709283 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268ddde-e267-4c5b-9bbf-ca6d1118d29f service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:23.709593 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268ddde-e267-4c5b-9bbf-ca6d1118d29f service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:23.709911 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268ddde-e267-4c5b-9bbf-ca6d1118d29f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:23.712074 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-5268ddde-e267-4c5b-9bbf-ca6d1118d29f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:40:23.732575 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5268ddde-e267-4c5b-9bbf-ca6d1118d29f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:40:23.734042 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5268ddde-e267-4c5b-9bbf-ca6d1118d29f service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:40:23.746848 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1375/2769] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:40:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:40:30.718811 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=72 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:40:33.740521 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=6 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:40:40.679589 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df109da-c588-4b74-8535-e01eef220bd5 service cinder] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:40:40.681915 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-4df109da-c588-4b74-8535-e01eef220bd5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:40:40.762958 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5268ddde-e267-4c5b-9bbf-ca6d1118d29f service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:40:40.765319 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-5268ddde-e267-4c5b-9bbf-ca6d1118d29f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:40:40.824583 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df109da-c588-4b74-8535-e01eef220bd5 service cinder] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:40:40.830179 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d189767-ff67-4847-bf97-49085a47836b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06dccf61c686414d904bdf1ecf19d53d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:40:40.830860 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d189767-ff67-4847-bf97-49085a47836b service placement] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:40.832070 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d189767-ff67-4847-bf97-49085a47836b service placement] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:40.832070 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d189767-ff67-4847-bf97-49085a47836b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:40.833284 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-2d189767-ff67-4847-bf97-49085a47836b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:40:40.846209 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d189767-ff67-4847-bf97-49085a47836b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:40:40.847817 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d189767-ff67-4847-bf97-49085a47836b service placement] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:40:40.859374 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1395/2770] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:40:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:40:40.861136 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5268ddde-e267-4c5b-9bbf-ca6d1118d29f service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:40:40.865596 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414bf8e2-ff33-4b8e-87cc-ac104f0523ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:40:40.866299 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414bf8e2-ff33-4b8e-87cc-ac104f0523ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:40.866574 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414bf8e2-ff33-4b8e-87cc-ac104f0523ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:40.866840 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414bf8e2-ff33-4b8e-87cc-ac104f0523ac admin admin] PATH_INFO: `/v3/users/2b594ca9853f402bb0353616db2ae4c8` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:40.867965 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414bf8e2-ff33-4b8e-87cc-ac104f0523ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b594ca9853f402bb0353616db2ae4c8)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:40:40.869898 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414bf8e2-ff33-4b8e-87cc-ac104f0523ac admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:40:40.925691 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-414bf8e2-ff33-4b8e-87cc-ac104f0523ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b594ca9853f402bb0353616db2ae4c8'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:40:40.935335 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-414bf8e2-ff33-4b8e-87cc-ac104f0523ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b594ca9853f402bb0353616db2ae4c8'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:40:40.935901 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-414bf8e2-ff33-4b8e-87cc-ac104f0523ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b594ca9853f402bb0353616db2ae4c8'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:40:40.943181 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-414bf8e2-ff33-4b8e-87cc-ac104f0523ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b594ca9853f402bb0353616db2ae4c8'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:40:40.957262 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-414bf8e2-ff33-4b8e-87cc-ac104f0523ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b594ca9853f402bb0353616db2ae4c8'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:40:40.969109 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1376/2771] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:40:40 2022] DELETE /identity/v3/users/2b594ca9853f402bb0353616db2ae4c8 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:40:41.193910 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d189767-ff67-4847-bf97-49085a47836b service placement] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:40:41.207266 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d189767-ff67-4847-bf97-49085a47836b service placement] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:40:41.296570 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b049a755-6225-4cc6-b6b0-e89cf2d99a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:40:41.297255 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049a755-6225-4cc6-b6b0-e89cf2d99a96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:41.297560 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049a755-6225-4cc6-b6b0-e89cf2d99a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:41.297813 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049a755-6225-4cc6-b6b0-e89cf2d99a96 admin admin] PATH_INFO: `/v3/projects/dc819bad329149839672804271ed7ab9` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:41.299124 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b049a755-6225-4cc6-b6b0-e89cf2d99a96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc819bad329149839672804271ed7ab9)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:40:41.301307 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b049a755-6225-4cc6-b6b0-e89cf2d99a96 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:40:41.375428 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-b049a755-6225-4cc6-b6b0-e89cf2d99a96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc819bad329149839672804271ed7ab9', 'request_id': 'req-b049a755-6225-4cc6-b6b0-e89cf2d99a96'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:40:41.382604 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-b049a755-6225-4cc6-b6b0-e89cf2d99a96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc819bad329149839672804271ed7ab9', 'request_id': 'req-b049a755-6225-4cc6-b6b0-e89cf2d99a96'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:40:41.391823 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-b049a755-6225-4cc6-b6b0-e89cf2d99a96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc819bad329149839672804271ed7ab9', 'request_id': 'req-b049a755-6225-4cc6-b6b0-e89cf2d99a96'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:40:41.413865 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-b049a755-6225-4cc6-b6b0-e89cf2d99a96 admin admin] The token cache is being invalidate because project dc819bad329149839672804271ed7ab9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:40:41.414416 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-b049a755-6225-4cc6-b6b0-e89cf2d99a96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:40:41.415572 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-b049a755-6225-4cc6-b6b0-e89cf2d99a96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:40:41.418153 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1396/2772] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:40:41 2022] DELETE /identity/v3/projects/dc819bad329149839672804271ed7ab9 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:40:41.425276 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0629038-ece5-4b13-9ead-711a1c30d423 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:41.425553 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0629038-ece5-4b13-9ead-711a1c30d423 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:41.425822 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0629038-ece5-4b13-9ead-711a1c30d423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:41.498357 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-c0629038-ece5-4b13-9ead-711a1c30d423 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:40:41.499657 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c0629038-ece5-4b13-9ead-711a1c30d423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:40:41.553573 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:40:41.569130 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1377/2773] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:40:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:40:41.578214 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c212209-708a-4d2c-8431-a975f90875a5 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:41.578494 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c212209-708a-4d2c-8431-a975f90875a5 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:41.578766 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c212209-708a-4d2c-8431-a975f90875a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:41.604658 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-4c212209-708a-4d2c-8431-a975f90875a5 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:40:41.605877 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-4c212209-708a-4d2c-8431-a975f90875a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:40:41.615338 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1397/2774] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:40:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:40:41.619690 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0629038-ece5-4b13-9ead-711a1c30d423 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:40:41.630580 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0629038-ece5-4b13-9ead-711a1c30d423 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:40:41.635808 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9544e8-4534-45f8-ae96-bfca9ba49dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:40:41.636411 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9544e8-4534-45f8-ae96-bfca9ba49dbb admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:41.636684 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9544e8-4534-45f8-ae96-bfca9ba49dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:41.636949 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9544e8-4534-45f8-ae96-bfca9ba49dbb admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:41.637605 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9544e8-4534-45f8-ae96-bfca9ba49dbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:40:41.637903 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9544e8-4534-45f8-ae96-bfca9ba49dbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:40:41.639715 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9544e8-4534-45f8-ae96-bfca9ba49dbb admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:40:41.651859 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1378/2775] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 01:40:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 12 01:40:41.656318 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c212209-708a-4d2c-8431-a975f90875a5 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:40:41.666610 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c212209-708a-4d2c-8431-a975f90875a5 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:40:41.672350 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e8d94d-871f-4426-bebf-2644a8b8fc70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:40:41.673017 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8d94d-871f-4426-bebf-2644a8b8fc70 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:41.673308 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8d94d-871f-4426-bebf-2644a8b8fc70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:41.673568 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8d94d-871f-4426-bebf-2644a8b8fc70 admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:41.674244 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e8d94d-871f-4426-bebf-2644a8b8fc70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:40:41.676137 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e8d94d-871f-4426-bebf-2644a8b8fc70 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:40:41.689057 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:40:41.727028 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1398/2776] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:40:41 2022] POST /identity/v3/projects => generated 379 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:40:41.731942 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9544e8-4534-45f8-ae96-bfca9ba49dbb admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:40:41.747257 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9544e8-4534-45f8-ae96-bfca9ba49dbb admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:40:41.806833 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cc19e9-0cc2-47b5-9408-f17946690f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:40:41.807502 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc19e9-0cc2-47b5-9408-f17946690f8b admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:41.807697 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc19e9-0cc2-47b5-9408-f17946690f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:41.808064 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc19e9-0cc2-47b5-9408-f17946690f8b admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:41.808708 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cc19e9-0cc2-47b5-9408-f17946690f8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:40:41.810685 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cc19e9-0cc2-47b5-9408-f17946690f8b admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:40:41.837218 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1379/2777] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:40:41 2022] POST /identity/v3/users => generated 290 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:40:41.841870 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e8d94d-871f-4426-bebf-2644a8b8fc70 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:40:41.858045 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e8d94d-871f-4426-bebf-2644a8b8fc70 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:40:41.864002 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337641a9-602f-463f-ba98-228ce6f5bf22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:40:41.864608 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337641a9-602f-463f-ba98-228ce6f5bf22 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:41.864881 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337641a9-602f-463f-ba98-228ce6f5bf22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:41.865141 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337641a9-602f-463f-ba98-228ce6f5bf22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:41.865777 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337641a9-602f-463f-ba98-228ce6f5bf22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:40:41.867401 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337641a9-602f-463f-ba98-228ce6f5bf22 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:40:41.883365 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1399/2778] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:40:41 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:40:41.889225 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cc19e9-0cc2-47b5-9408-f17946690f8b admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:40:41.905601 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cc19e9-0cc2-47b5-9408-f17946690f8b admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:40:41.913099 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cb8f26-e426-425b-b5fb-68c05f8a0c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:40:41.913706 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb8f26-e426-425b-b5fb-68c05f8a0c76 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:41.913979 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb8f26-e426-425b-b5fb-68c05f8a0c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:41.914280 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb8f26-e426-425b-b5fb-68c05f8a0c76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:41.914930 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cb8f26-e426-425b-b5fb-68c05f8a0c76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:40:41.916612 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cb8f26-e426-425b-b5fb-68c05f8a0c76 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:40:41.928352 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1380/2779] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:40:41 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:40:41.932831 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337641a9-602f-463f-ba98-228ce6f5bf22 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:40:41.946161 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337641a9-602f-463f-ba98-228ce6f5bf22 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:40:41.953532 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc733765-de8c-42b7-80c7-c7029c37058e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:40:41.954208 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc733765-de8c-42b7-80c7-c7029c37058e admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:41.954489 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc733765-de8c-42b7-80c7-c7029c37058e admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:41.954760 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc733765-de8c-42b7-80c7-c7029c37058e admin admin] PATH_INFO: `/v3/projects/95a003d777a0442db3e33e86dd37bcc6/users/e73aa0f5778f43cbbe90fb4291f9ec27/roles/13af81971c1c428eae0a571a22ea583d` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:41.973675 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc733765-de8c-42b7-80c7-c7029c37058e admin admin] RBAC: Authorizing `identity:create_grant(project_id=95a003d777a0442db3e33e86dd37bcc6, user_id=e73aa0f5778f43cbbe90fb4291f9ec27, role_id=13af81971c1c428eae0a571a22ea583d)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:40:41.977938 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc733765-de8c-42b7-80c7-c7029c37058e admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:40:41.997022 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1400/2780] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:40:41 2022] PUT /identity/v3/projects/95a003d777a0442db3e33e86dd37bcc6/users/e73aa0f5778f43cbbe90fb4291f9ec27/roles/13af81971c1c428eae0a571a22ea583d => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:40:42.008609 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58681af8-a19e-4b5f-889f-8256f5f9f11e None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:42.008797 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58681af8-a19e-4b5f-889f-8256f5f9f11e None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:42.009112 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58681af8-a19e-4b5f-889f-8256f5f9f11e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:42.038478 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-58681af8-a19e-4b5f-889f-8256f5f9f11e None None] MFA Rules not processed for user `e73aa0f5778f43cbbe90fb4291f9ec27`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:40:42.039706 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-58681af8-a19e-4b5f-889f-8256f5f9f11e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:40:42.112582 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1381/2781] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:40:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:40:42.117468 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc733765-de8c-42b7-80c7-c7029c37058e admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:40:42.190965 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc733765-de8c-42b7-80c7-c7029c37058e admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:40:42.196108 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a68d781-dfad-4d1a-9583-270abf4cdfd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:40:42.196704 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68d781-dfad-4d1a-9583-270abf4cdfd7 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:42.196979 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68d781-dfad-4d1a-9583-270abf4cdfd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:42.197246 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68d781-dfad-4d1a-9583-270abf4cdfd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:42.197863 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a68d781-dfad-4d1a-9583-270abf4cdfd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:40:42.199846 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a68d781-dfad-4d1a-9583-270abf4cdfd7 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:40:42.231605 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1401/2782] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:40:42 2022] POST /identity/v3/projects => generated 381 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:40:42.237007 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58681af8-a19e-4b5f-889f-8256f5f9f11e None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:40:42.248987 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58681af8-a19e-4b5f-889f-8256f5f9f11e None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:40:42.291790 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:40:42.307991 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46449632-50ce-4081-ad41-3a5a94263b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:40:42.308583 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46449632-50ce-4081-ad41-3a5a94263b42 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:42.308885 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46449632-50ce-4081-ad41-3a5a94263b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:42.309151 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46449632-50ce-4081-ad41-3a5a94263b42 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:42.309788 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46449632-50ce-4081-ad41-3a5a94263b42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:40:42.311744 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46449632-50ce-4081-ad41-3a5a94263b42 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:40:42.335222 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1382/2783] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:40:42 2022] POST /identity/v3/users => generated 297 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:40:42.339409 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a68d781-dfad-4d1a-9583-270abf4cdfd7 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:40:42.350524 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a68d781-dfad-4d1a-9583-270abf4cdfd7 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:40:42.355979 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8440f877-e768-456c-9f2f-5648dd147f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:40:42.356588 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440f877-e768-456c-9f2f-5648dd147f98 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:42.356862 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440f877-e768-456c-9f2f-5648dd147f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:42.357140 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440f877-e768-456c-9f2f-5648dd147f98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:42.357786 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8440f877-e768-456c-9f2f-5648dd147f98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:40:42.359620 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8440f877-e768-456c-9f2f-5648dd147f98 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:40:42.370730 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1402/2784] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:40:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:40:42.375118 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46449632-50ce-4081-ad41-3a5a94263b42 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:40:42.385732 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46449632-50ce-4081-ad41-3a5a94263b42 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:40:42.391007 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b25f0f-4c70-4ba7-b909-425455a8d3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:40:42.391649 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b25f0f-4c70-4ba7-b909-425455a8d3a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:42.391926 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b25f0f-4c70-4ba7-b909-425455a8d3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:42.392310 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b25f0f-4c70-4ba7-b909-425455a8d3a0 admin admin] PATH_INFO: `/v3/projects/56def4a836e34766a5ff9a221b8446be/users/31ffc337fc69401ea173f5dce05d04c0/roles/fb48693810be495fb4b1893a79429b78` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:42.407849 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b25f0f-4c70-4ba7-b909-425455a8d3a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56def4a836e34766a5ff9a221b8446be, user_id=31ffc337fc69401ea173f5dce05d04c0, role_id=fb48693810be495fb4b1893a79429b78)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:40:42.410565 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b25f0f-4c70-4ba7-b909-425455a8d3a0 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:40:42.426035 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1383/2785] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:40:42 2022] PUT /identity/v3/projects/56def4a836e34766a5ff9a221b8446be/users/31ffc337fc69401ea173f5dce05d04c0/roles/fb48693810be495fb4b1893a79429b78 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:40:42.430101 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8440f877-e768-456c-9f2f-5648dd147f98 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:40:42.440203 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8440f877-e768-456c-9f2f-5648dd147f98 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:40:42.499473 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad76eb27-aaf2-4162-ba9c-0eb294b95479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:40:42.500111 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad76eb27-aaf2-4162-ba9c-0eb294b95479 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:42.500399 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad76eb27-aaf2-4162-ba9c-0eb294b95479 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:42.500668 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad76eb27-aaf2-4162-ba9c-0eb294b95479 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:42.501359 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad76eb27-aaf2-4162-ba9c-0eb294b95479 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:40:42.502979 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad76eb27-aaf2-4162-ba9c-0eb294b95479 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:40:42.513334 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1403/2786] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:40:42 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:40:42.518459 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b25f0f-4c70-4ba7-b909-425455a8d3a0 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:40:42.534305 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b25f0f-4c70-4ba7-b909-425455a8d3a0 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:40:42.540232 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb4eb9-c321-41d9-8fc7-a1da1ddf5c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:40:42.540882 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb4eb9-c321-41d9-8fc7-a1da1ddf5c5c admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:42.541195 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb4eb9-c321-41d9-8fc7-a1da1ddf5c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:42.541446 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb4eb9-c321-41d9-8fc7-a1da1ddf5c5c admin admin] PATH_INFO: `/v3/projects/56def4a836e34766a5ff9a221b8446be/users/31ffc337fc69401ea173f5dce05d04c0/roles/fb48693810be495fb4b1893a79429b78` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:42.543832 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bb4eb9-c321-41d9-8fc7-a1da1ddf5c5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=56def4a836e34766a5ff9a221b8446be, user_id=31ffc337fc69401ea173f5dce05d04c0, role_id=fb48693810be495fb4b1893a79429b78)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:40:42.546498 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bb4eb9-c321-41d9-8fc7-a1da1ddf5c5c admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:40:42.563104 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1384/2787] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:40:42 2022] PUT /identity/v3/projects/56def4a836e34766a5ff9a221b8446be/users/31ffc337fc69401ea173f5dce05d04c0/roles/fb48693810be495fb4b1893a79429b78 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:40:42.575329 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e7b96-fbb8-4fc2-8106-196cbdc8bb56 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:42.575609 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e7b96-fbb8-4fc2-8106-196cbdc8bb56 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:42.575877 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e7b96-fbb8-4fc2-8106-196cbdc8bb56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:42.607413 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-0b9e7b96-fbb8-4fc2-8106-196cbdc8bb56 None None] MFA Rules not processed for user `31ffc337fc69401ea173f5dce05d04c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:40:42.608662 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-0b9e7b96-fbb8-4fc2-8106-196cbdc8bb56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:40:42.614133 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:40:42.684720 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1404/2788] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:40:42 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:40:42.696800 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb4eb9-c321-41d9-8fc7-a1da1ddf5c5c admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:40:42.698757 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d0bb4eb9-c321-41d9-8fc7-a1da1ddf5c5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:40:42.761032 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb4eb9-c321-41d9-8fc7-a1da1ddf5c5c admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:40:42.765091 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d506ddd-3977-41e2-9bbd-dead09aca58b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7853d40c29af424c8d7913950d89750b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:40:42.765730 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d506ddd-3977-41e2-9bbd-dead09aca58b service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:42.766452 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d506ddd-3977-41e2-9bbd-dead09aca58b service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:42.766734 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d506ddd-3977-41e2-9bbd-dead09aca58b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:42.775904 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d506ddd-3977-41e2-9bbd-dead09aca58b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:40:42.777338 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d506ddd-3977-41e2-9bbd-dead09aca58b service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:40:42.786837 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1385/2789] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:40:42 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:40:42.868932 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9e7b96-fbb8-4fc2-8106-196cbdc8bb56 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:40:42.879821 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9e7b96-fbb8-4fc2-8106-196cbdc8bb56 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:40:42.883576 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e851889d-b425-4534-a76f-f3e2ba75e180 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7853d40c29af424c8d7913950d89750b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:40:42.884173 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851889d-b425-4534-a76f-f3e2ba75e180 service cinder] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:42.884444 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851889d-b425-4534-a76f-f3e2ba75e180 service cinder] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:42.884710 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851889d-b425-4534-a76f-f3e2ba75e180 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:42.941999 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e851889d-b425-4534-a76f-f3e2ba75e180 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:40:42.943475 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e851889d-b425-4534-a76f-f3e2ba75e180 service cinder] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:40:42.952290 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1405/2790] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:40:42 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:40:49.904068 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d506ddd-3977-41e2-9bbd-dead09aca58b service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:40:49.966997 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d506ddd-3977-41e2-9bbd-dead09aca58b service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:40:49.972534 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b910be-3ffa-43d1-af04-e9db7870bf8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:40:49.973119 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b910be-3ffa-43d1-af04-e9db7870bf8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:49.973355 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b910be-3ffa-43d1-af04-e9db7870bf8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:49.973588 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b910be-3ffa-43d1-af04-e9db7870bf8e admin admin] PATH_INFO: `/v3/users/e73aa0f5778f43cbbe90fb4291f9ec27` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:49.974800 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b910be-3ffa-43d1-af04-e9db7870bf8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e73aa0f5778f43cbbe90fb4291f9ec27)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:40:49.978243 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b910be-3ffa-43d1-af04-e9db7870bf8e admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:40:50.032123 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:40:50.038368 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-33b910be-3ffa-43d1-af04-e9db7870bf8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e73aa0f5778f43cbbe90fb4291f9ec27'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:40:50.047328 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-33b910be-3ffa-43d1-af04-e9db7870bf8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e73aa0f5778f43cbbe90fb4291f9ec27'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:40:50.047919 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-33b910be-3ffa-43d1-af04-e9db7870bf8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e73aa0f5778f43cbbe90fb4291f9ec27'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:40:50.054723 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-33b910be-3ffa-43d1-af04-e9db7870bf8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e73aa0f5778f43cbbe90fb4291f9ec27'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:40:50.067116 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-33b910be-3ffa-43d1-af04-e9db7870bf8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e73aa0f5778f43cbbe90fb4291f9ec27'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:40:50.073347 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1386/2791] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:40:49 2022] DELETE /identity/v3/users/e73aa0f5778f43cbbe90fb4291f9ec27 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:40:50.078030 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb4fc36-db24-486e-96f8-4f1b5ed8067d None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:50.078556 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb4fc36-db24-486e-96f8-4f1b5ed8067d None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:50.078556 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb4fc36-db24-486e-96f8-4f1b5ed8067d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:50.098408 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-bdb4fc36-db24-486e-96f8-4f1b5ed8067d None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:40:50.099615 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-bdb4fc36-db24-486e-96f8-4f1b5ed8067d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:40:50.161789 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1406/2792] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:40:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:40:50.172050 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b910be-3ffa-43d1-af04-e9db7870bf8e admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:40:50.173539 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-33b910be-3ffa-43d1-af04-e9db7870bf8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:40:50.254153 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b910be-3ffa-43d1-af04-e9db7870bf8e admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:40:50.258645 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ccea96-b1b3-4df3-b43a-c91da523da07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:40:50.259242 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ccea96-b1b3-4df3-b43a-c91da523da07 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:50.259513 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ccea96-b1b3-4df3-b43a-c91da523da07 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:50.259777 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ccea96-b1b3-4df3-b43a-c91da523da07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:50.269221 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ccea96-b1b3-4df3-b43a-c91da523da07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:40:50.270709 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ccea96-b1b3-4df3-b43a-c91da523da07 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:40:50.280687 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1387/2793] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:40:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:40:50.579103 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb4fc36-db24-486e-96f8-4f1b5ed8067d None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:40:50.580585 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-bdb4fc36-db24-486e-96f8-4f1b5ed8067d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:40:50.592826 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb4fc36-db24-486e-96f8-4f1b5ed8067d None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:40:50.598018 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c61a7d-76db-4c2a-884d-a410ed8ebe43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:40:50.598756 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c61a7d-76db-4c2a-884d-a410ed8ebe43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:50.599036 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c61a7d-76db-4c2a-884d-a410ed8ebe43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:50.599326 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c61a7d-76db-4c2a-884d-a410ed8ebe43 admin admin] PATH_INFO: `/v3/projects/95a003d777a0442db3e33e86dd37bcc6` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:50.600481 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c61a7d-76db-4c2a-884d-a410ed8ebe43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95a003d777a0442db3e33e86dd37bcc6)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:40:50.603860 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c61a7d-76db-4c2a-884d-a410ed8ebe43 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:40:50.644748 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:40:50.654594 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-56c61a7d-76db-4c2a-884d-a410ed8ebe43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95a003d777a0442db3e33e86dd37bcc6', 'request_id': 'req-56c61a7d-76db-4c2a-884d-a410ed8ebe43'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:40:50.660386 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-56c61a7d-76db-4c2a-884d-a410ed8ebe43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95a003d777a0442db3e33e86dd37bcc6', 'request_id': 'req-56c61a7d-76db-4c2a-884d-a410ed8ebe43'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:40:50.667264 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-56c61a7d-76db-4c2a-884d-a410ed8ebe43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95a003d777a0442db3e33e86dd37bcc6', 'request_id': 'req-56c61a7d-76db-4c2a-884d-a410ed8ebe43'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:40:50.681871 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-56c61a7d-76db-4c2a-884d-a410ed8ebe43 admin admin] The token cache is being invalidate because project 95a003d777a0442db3e33e86dd37bcc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:40:50.682210 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-56c61a7d-76db-4c2a-884d-a410ed8ebe43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:40:50.682851 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-56c61a7d-76db-4c2a-884d-a410ed8ebe43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:40:50.684355 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1407/2794] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:40:50 2022] DELETE /identity/v3/projects/95a003d777a0442db3e33e86dd37bcc6 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:40:50.688603 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ccea96-b1b3-4df3-b43a-c91da523da07 service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:40:50.698467 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ccea96-b1b3-4df3-b43a-c91da523da07 service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:40:50.756344 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab527190-aa78-48bb-8911-af174caaa4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:40:50.757008 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab527190-aa78-48bb-8911-af174caaa4be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:50.757824 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab527190-aa78-48bb-8911-af174caaa4be admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:50.758128 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab527190-aa78-48bb-8911-af174caaa4be admin admin] PATH_INFO: `/v3/users/31ffc337fc69401ea173f5dce05d04c0` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:50.759730 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab527190-aa78-48bb-8911-af174caaa4be admin admin] RBAC: Authorizing `identity:delete_user(user_id=31ffc337fc69401ea173f5dce05d04c0)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:40:50.761670 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab527190-aa78-48bb-8911-af174caaa4be admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:40:50.811247 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:40:50.814409 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ab527190-aa78-48bb-8911-af174caaa4be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31ffc337fc69401ea173f5dce05d04c0'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:40:50.824711 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ab527190-aa78-48bb-8911-af174caaa4be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31ffc337fc69401ea173f5dce05d04c0'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:40:50.825779 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ab527190-aa78-48bb-8911-af174caaa4be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31ffc337fc69401ea173f5dce05d04c0'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:40:50.832882 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ab527190-aa78-48bb-8911-af174caaa4be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31ffc337fc69401ea173f5dce05d04c0'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:40:50.844683 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ab527190-aa78-48bb-8911-af174caaa4be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31ffc337fc69401ea173f5dce05d04c0'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:40:50.850672 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1388/2795] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:40:50 2022] DELETE /identity/v3/users/31ffc337fc69401ea173f5dce05d04c0 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:40:51.150415 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c61a7d-76db-4c2a-884d-a410ed8ebe43 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:40:51.152202 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-56c61a7d-76db-4c2a-884d-a410ed8ebe43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:40:51.167857 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c61a7d-76db-4c2a-884d-a410ed8ebe43 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:40:51.227234 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a3014c-436e-4a57-83e4-12fa74ad7ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:40:51.227873 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3014c-436e-4a57-83e4-12fa74ad7ecb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:51.228147 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3014c-436e-4a57-83e4-12fa74ad7ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:51.228411 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3014c-436e-4a57-83e4-12fa74ad7ecb admin admin] PATH_INFO: `/v3/projects/56def4a836e34766a5ff9a221b8446be` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:51.229658 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a3014c-436e-4a57-83e4-12fa74ad7ecb admin admin] RBAC: Authorizing `identity:delete_project(project_id=56def4a836e34766a5ff9a221b8446be)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:40:51.231599 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a3014c-436e-4a57-83e4-12fa74ad7ecb admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:40:51.280145 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-65a3014c-436e-4a57-83e4-12fa74ad7ecb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56def4a836e34766a5ff9a221b8446be', 'request_id': 'req-65a3014c-436e-4a57-83e4-12fa74ad7ecb'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:40:51.285725 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-65a3014c-436e-4a57-83e4-12fa74ad7ecb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56def4a836e34766a5ff9a221b8446be', 'request_id': 'req-65a3014c-436e-4a57-83e4-12fa74ad7ecb'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:40:51.291821 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-65a3014c-436e-4a57-83e4-12fa74ad7ecb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56def4a836e34766a5ff9a221b8446be', 'request_id': 'req-65a3014c-436e-4a57-83e4-12fa74ad7ecb'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:40:51.306243 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-65a3014c-436e-4a57-83e4-12fa74ad7ecb admin admin] The token cache is being invalidate because project 56def4a836e34766a5ff9a221b8446be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:40:51.306523 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-65a3014c-436e-4a57-83e4-12fa74ad7ecb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:40:51.307148 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-65a3014c-436e-4a57-83e4-12fa74ad7ecb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:40:51.308618 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1408/2796] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:40:51 2022] DELETE /identity/v3/projects/56def4a836e34766a5ff9a221b8446be => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:40:51.313697 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607658fb-c4c2-4636-894c-033277a0668b None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:51.314202 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607658fb-c4c2-4636-894c-033277a0668b None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:51.314317 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607658fb-c4c2-4636-894c-033277a0668b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:51.337131 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-607658fb-c4c2-4636-894c-033277a0668b None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:40:51.338310 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-607658fb-c4c2-4636-894c-033277a0668b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:40:51.406108 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1389/2797] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:40:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:40:51.414324 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ac63f-84c6-4b9a-a902-3c73d1e2cb2a None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:51.414618 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ac63f-84c6-4b9a-a902-3c73d1e2cb2a None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:51.414887 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ac63f-84c6-4b9a-a902-3c73d1e2cb2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:51.439704 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-653ac63f-84c6-4b9a-a902-3c73d1e2cb2a None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:40:51.441255 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-653ac63f-84c6-4b9a-a902-3c73d1e2cb2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:40:51.452053 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1409/2798] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:40:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:40:51.456354 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607658fb-c4c2-4636-894c-033277a0668b None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:40:51.466723 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607658fb-c4c2-4636-894c-033277a0668b None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:40:51.472518 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae75356-f8bc-467c-a899-71e532ed2eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:40:51.473125 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae75356-f8bc-467c-a899-71e532ed2eb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:51.473404 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae75356-f8bc-467c-a899-71e532ed2eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:51.473670 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae75356-f8bc-467c-a899-71e532ed2eb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:51.474358 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae75356-f8bc-467c-a899-71e532ed2eb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:40:51.474660 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae75356-f8bc-467c-a899-71e532ed2eb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:40:51.476456 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae75356-f8bc-467c-a899-71e532ed2eb4 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:40:51.490900 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1390/2799] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 01:40:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:40:51.495455 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653ac63f-84c6-4b9a-a902-3c73d1e2cb2a None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:40:51.505235 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653ac63f-84c6-4b9a-a902-3c73d1e2cb2a None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:40:51.511151 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c14861-1af4-4587-bce7-95b01dd3e3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:40:51.511753 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c14861-1af4-4587-bce7-95b01dd3e3dc admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:51.512029 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c14861-1af4-4587-bce7-95b01dd3e3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:51.512293 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c14861-1af4-4587-bce7-95b01dd3e3dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:51.512916 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c14861-1af4-4587-bce7-95b01dd3e3dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:40:51.514921 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c14861-1af4-4587-bce7-95b01dd3e3dc admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:40:51.545240 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1410/2800] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:40:51 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:40:51.550181 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae75356-f8bc-467c-a899-71e532ed2eb4 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:40:51.562265 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae75356-f8bc-467c-a899-71e532ed2eb4 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:40:51.626713 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c93af8-cc89-4888-89b0-c167dcb5f7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:40:51.627242 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c93af8-cc89-4888-89b0-c167dcb5f7ce admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:51.627512 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c93af8-cc89-4888-89b0-c167dcb5f7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:51.627776 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c93af8-cc89-4888-89b0-c167dcb5f7ce admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:51.628379 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c93af8-cc89-4888-89b0-c167dcb5f7ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:40:51.630361 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c93af8-cc89-4888-89b0-c167dcb5f7ce admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:40:51.652808 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1391/2801] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:40:51 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:40:51.657039 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c14861-1af4-4587-bce7-95b01dd3e3dc admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:40:51.668111 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c14861-1af4-4587-bce7-95b01dd3e3dc admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:40:51.673406 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f841a00e-1492-4814-b1c6-e8f1e991aab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:40:51.674006 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841a00e-1492-4814-b1c6-e8f1e991aab5 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:51.674309 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841a00e-1492-4814-b1c6-e8f1e991aab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:51.674578 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841a00e-1492-4814-b1c6-e8f1e991aab5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:51.675222 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f841a00e-1492-4814-b1c6-e8f1e991aab5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:40:51.676822 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f841a00e-1492-4814-b1c6-e8f1e991aab5 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:40:51.687451 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1411/2802] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:40:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:40:51.691559 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c93af8-cc89-4888-89b0-c167dcb5f7ce admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:40:51.702156 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c93af8-cc89-4888-89b0-c167dcb5f7ce admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:40:51.707873 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afed951-8d33-4d1a-b40a-203574b595ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:40:51.708498 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afed951-8d33-4d1a-b40a-203574b595ec admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:51.708771 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afed951-8d33-4d1a-b40a-203574b595ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:51.709040 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afed951-8d33-4d1a-b40a-203574b595ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:51.709681 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afed951-8d33-4d1a-b40a-203574b595ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:40:51.711526 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afed951-8d33-4d1a-b40a-203574b595ec admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:40:51.722440 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1392/2803] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:40:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:40:51.727637 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f841a00e-1492-4814-b1c6-e8f1e991aab5 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:40:51.743154 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f841a00e-1492-4814-b1c6-e8f1e991aab5 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:40:51.748457 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfded10-3f5d-453c-9eb5-84503bde4486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:40:51.749102 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfded10-3f5d-453c-9eb5-84503bde4486 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:51.749376 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfded10-3f5d-453c-9eb5-84503bde4486 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:51.749649 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfded10-3f5d-453c-9eb5-84503bde4486 admin admin] PATH_INFO: `/v3/projects/8339b9f6e25a434b805f40f20feda4be/users/3e9d239e41f94de98f2bdee6faf57848/roles/13af81971c1c428eae0a571a22ea583d` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:51.762478 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:40:51.766032 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfded10-3f5d-453c-9eb5-84503bde4486 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8339b9f6e25a434b805f40f20feda4be, user_id=3e9d239e41f94de98f2bdee6faf57848, role_id=13af81971c1c428eae0a571a22ea583d)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:40:51.769214 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfded10-3f5d-453c-9eb5-84503bde4486 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:40:51.788786 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1412/2804] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:40:51 2022] PUT /identity/v3/projects/8339b9f6e25a434b805f40f20feda4be/users/3e9d239e41f94de98f2bdee6faf57848/roles/13af81971c1c428eae0a571a22ea583d => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:40:51.799589 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf92b3-9f28-474f-9e83-8279c0279a66 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:51.799866 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf92b3-9f28-474f-9e83-8279c0279a66 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:51.800132 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf92b3-9f28-474f-9e83-8279c0279a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:51.828947 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-3baf92b3-9f28-474f-9e83-8279c0279a66 None None] MFA Rules not processed for user `3e9d239e41f94de98f2bdee6faf57848`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:40:51.830179 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-3baf92b3-9f28-474f-9e83-8279c0279a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:40:51.842967 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:40:51.896011 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1393/2805] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:40:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:40:51.900789 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfded10-3f5d-453c-9eb5-84503bde4486 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:40:51.964859 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfded10-3f5d-453c-9eb5-84503bde4486 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:40:51.969946 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db004336-d237-422d-ac7e-ba37bf02bb64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:40:51.970594 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db004336-d237-422d-ac7e-ba37bf02bb64 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:51.970871 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db004336-d237-422d-ac7e-ba37bf02bb64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:51.971141 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db004336-d237-422d-ac7e-ba37bf02bb64 admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:51.971769 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db004336-d237-422d-ac7e-ba37bf02bb64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:40:51.973682 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db004336-d237-422d-ac7e-ba37bf02bb64 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:40:52.007975 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1413/2806] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:40:51 2022] POST /identity/v3/projects => generated 387 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:40:52.012366 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baf92b3-9f28-474f-9e83-8279c0279a66 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:40:52.023953 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baf92b3-9f28-474f-9e83-8279c0279a66 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:40:52.083858 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51d5460-cb28-4d77-b267-9c2897c7f5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:40:52.084714 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d5460-cb28-4d77-b267-9c2897c7f5a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:52.085050 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d5460-cb28-4d77-b267-9c2897c7f5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:52.085392 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d5460-cb28-4d77-b267-9c2897c7f5a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:52.087501 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51d5460-cb28-4d77-b267-9c2897c7f5a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:40:52.092702 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51d5460-cb28-4d77-b267-9c2897c7f5a4 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:40:52.119968 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1394/2807] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:40:52 2022] POST /identity/v3/users => generated 300 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:40:52.124244 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db004336-d237-422d-ac7e-ba37bf02bb64 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:40:52.135492 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db004336-d237-422d-ac7e-ba37bf02bb64 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:40:52.140376 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93204702-2a55-48b9-8158-e236dda457a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:40:52.140990 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93204702-2a55-48b9-8158-e236dda457a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:52.141267 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93204702-2a55-48b9-8158-e236dda457a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:52.141536 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93204702-2a55-48b9-8158-e236dda457a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:52.142227 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93204702-2a55-48b9-8158-e236dda457a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:40:52.143840 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93204702-2a55-48b9-8158-e236dda457a7 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:40:52.155224 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1414/2808] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:40:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:40:52.159407 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51d5460-cb28-4d77-b267-9c2897c7f5a4 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:40:52.169915 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51d5460-cb28-4d77-b267-9c2897c7f5a4 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:40:52.174788 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094083e6-99ad-4e18-8cb5-88fb84df8830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:40:52.175428 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094083e6-99ad-4e18-8cb5-88fb84df8830 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:52.175700 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094083e6-99ad-4e18-8cb5-88fb84df8830 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:52.175964 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094083e6-99ad-4e18-8cb5-88fb84df8830 admin admin] PATH_INFO: `/v3/projects/091f0a5c14cf4a68a5293de948162a58/users/a1b690a9a62e4400b2d3d00fc67f819c/roles/fb48693810be495fb4b1893a79429b78` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:52.190779 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094083e6-99ad-4e18-8cb5-88fb84df8830 admin admin] RBAC: Authorizing `identity:create_grant(project_id=091f0a5c14cf4a68a5293de948162a58, user_id=a1b690a9a62e4400b2d3d00fc67f819c, role_id=fb48693810be495fb4b1893a79429b78)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:40:52.193413 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094083e6-99ad-4e18-8cb5-88fb84df8830 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:40:52.208544 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1395/2809] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:40:52 2022] PUT /identity/v3/projects/091f0a5c14cf4a68a5293de948162a58/users/a1b690a9a62e4400b2d3d00fc67f819c/roles/fb48693810be495fb4b1893a79429b78 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:40:52.214373 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93204702-2a55-48b9-8158-e236dda457a7 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:40:52.228675 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93204702-2a55-48b9-8158-e236dda457a7 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:40:52.285059 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb214a9e-9d4b-46b0-8b61-203ad08916e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:40:52.285660 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb214a9e-9d4b-46b0-8b61-203ad08916e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:52.285897 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb214a9e-9d4b-46b0-8b61-203ad08916e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:52.286234 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb214a9e-9d4b-46b0-8b61-203ad08916e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:52.286870 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb214a9e-9d4b-46b0-8b61-203ad08916e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:40:52.288453 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb214a9e-9d4b-46b0-8b61-203ad08916e7 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:40:52.299042 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1415/2810] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:40:52 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:40:52.303386 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094083e6-99ad-4e18-8cb5-88fb84df8830 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:40:52.316464 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094083e6-99ad-4e18-8cb5-88fb84df8830 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:40:52.321844 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f4ded5-b941-45bf-a67a-ae16ec69aaaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:40:52.322520 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f4ded5-b941-45bf-a67a-ae16ec69aaaf admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:52.322795 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f4ded5-b941-45bf-a67a-ae16ec69aaaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:52.323083 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f4ded5-b941-45bf-a67a-ae16ec69aaaf admin admin] PATH_INFO: `/v3/projects/091f0a5c14cf4a68a5293de948162a58/users/a1b690a9a62e4400b2d3d00fc67f819c/roles/fb48693810be495fb4b1893a79429b78` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:52.325034 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f4ded5-b941-45bf-a67a-ae16ec69aaaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=091f0a5c14cf4a68a5293de948162a58, user_id=a1b690a9a62e4400b2d3d00fc67f819c, role_id=fb48693810be495fb4b1893a79429b78)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:40:52.327961 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f4ded5-b941-45bf-a67a-ae16ec69aaaf admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:40:52.338707 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1396/2811] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:40:52 2022] PUT /identity/v3/projects/091f0a5c14cf4a68a5293de948162a58/users/a1b690a9a62e4400b2d3d00fc67f819c/roles/fb48693810be495fb4b1893a79429b78 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:40:52.350224 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce8701d-a850-43c2-b46c-6307bc73ca10 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:52.350514 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce8701d-a850-43c2-b46c-6307bc73ca10 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:52.350787 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce8701d-a850-43c2-b46c-6307bc73ca10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:52.381135 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-7ce8701d-a850-43c2-b46c-6307bc73ca10 None None] MFA Rules not processed for user `a1b690a9a62e4400b2d3d00fc67f819c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:40:52.382377 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-7ce8701d-a850-43c2-b46c-6307bc73ca10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:40:52.437219 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:40:52.460255 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1416/2812] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:40:52 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:40:52.472339 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f4ded5-b941-45bf-a67a-ae16ec69aaaf admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:40:52.474357 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-b7f4ded5-b941-45bf-a67a-ae16ec69aaaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:40:52.536111 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f4ded5-b941-45bf-a67a-ae16ec69aaaf admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:40:52.540227 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b60c43-980d-4670-bc5d-44de2ff00128 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7853d40c29af424c8d7913950d89750b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:40:52.540834 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b60c43-980d-4670-bc5d-44de2ff00128 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:52.541107 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b60c43-980d-4670-bc5d-44de2ff00128 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:52.541376 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b60c43-980d-4670-bc5d-44de2ff00128 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:52.550807 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b60c43-980d-4670-bc5d-44de2ff00128 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:40:52.552244 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b60c43-980d-4670-bc5d-44de2ff00128 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:40:52.561870 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1397/2813] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:40:52 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:40:52.592100 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce8701d-a850-43c2-b46c-6307bc73ca10 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:40:52.669392 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce8701d-a850-43c2-b46c-6307bc73ca10 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:40:52.674091 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe437ab-0890-495b-aa00-13ebb3368841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:40:52.674762 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe437ab-0890-495b-aa00-13ebb3368841 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:52.675036 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe437ab-0890-495b-aa00-13ebb3368841 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:52.675305 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe437ab-0890-495b-aa00-13ebb3368841 admin admin] PATH_INFO: `/v3/users/3e9d239e41f94de98f2bdee6faf57848` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:52.676426 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe437ab-0890-495b-aa00-13ebb3368841 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e9d239e41f94de98f2bdee6faf57848)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:40:52.678369 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe437ab-0890-495b-aa00-13ebb3368841 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:40:52.733263 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-bbe437ab-0890-495b-aa00-13ebb3368841 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e9d239e41f94de98f2bdee6faf57848'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:40:52.741311 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-bbe437ab-0890-495b-aa00-13ebb3368841 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e9d239e41f94de98f2bdee6faf57848'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:40:52.742005 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-bbe437ab-0890-495b-aa00-13ebb3368841 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e9d239e41f94de98f2bdee6faf57848'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:40:52.748977 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-bbe437ab-0890-495b-aa00-13ebb3368841 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e9d239e41f94de98f2bdee6faf57848'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:40:52.761447 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-bbe437ab-0890-495b-aa00-13ebb3368841 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e9d239e41f94de98f2bdee6faf57848'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:40:52.767488 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1417/2814] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:40:52 2022] DELETE /identity/v3/users/3e9d239e41f94de98f2bdee6faf57848 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:40:52.772140 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd59dac-1773-43cd-b897-0a170d132c25 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:52.772420 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd59dac-1773-43cd-b897-0a170d132c25 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:52.772690 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd59dac-1773-43cd-b897-0a170d132c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:52.791858 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-fcd59dac-1773-43cd-b897-0a170d132c25 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:40:52.793061 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-fcd59dac-1773-43cd-b897-0a170d132c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:40:52.798411 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:40:52.855581 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1398/2815] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:40:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:40:52.865476 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe437ab-0890-495b-aa00-13ebb3368841 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:40:52.866989 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-bbe437ab-0890-495b-aa00-13ebb3368841 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:40:52.925166 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe437ab-0890-495b-aa00-13ebb3368841 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:40:52.929266 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f4480-19ff-41e5-bd89-a364a574457f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:40:52.929865 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f4480-19ff-41e5-bd89-a364a574457f service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:52.930164 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f4480-19ff-41e5-bd89-a364a574457f service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:52.930856 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f4480-19ff-41e5-bd89-a364a574457f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:52.939949 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f4480-19ff-41e5-bd89-a364a574457f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:40:52.941403 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f4480-19ff-41e5-bd89-a364a574457f service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:40:52.951535 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1418/2816] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:40:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:40:53.229228 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd59dac-1773-43cd-b897-0a170d132c25 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:40:53.230803 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-fcd59dac-1773-43cd-b897-0a170d132c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:40:53.247100 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd59dac-1773-43cd-b897-0a170d132c25 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:40:53.252253 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb894f3-4241-4c0e-98e8-37e08ddcbbce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:40:53.252894 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb894f3-4241-4c0e-98e8-37e08ddcbbce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:53.253231 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb894f3-4241-4c0e-98e8-37e08ddcbbce admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:53.253416 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb894f3-4241-4c0e-98e8-37e08ddcbbce admin admin] PATH_INFO: `/v3/projects/8339b9f6e25a434b805f40f20feda4be` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:53.254564 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb894f3-4241-4c0e-98e8-37e08ddcbbce admin admin] RBAC: Authorizing `identity:delete_project(project_id=8339b9f6e25a434b805f40f20feda4be)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:40:53.256463 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb894f3-4241-4c0e-98e8-37e08ddcbbce admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:40:53.305483 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-abb894f3-4241-4c0e-98e8-37e08ddcbbce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8339b9f6e25a434b805f40f20feda4be', 'request_id': 'req-abb894f3-4241-4c0e-98e8-37e08ddcbbce'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:40:53.313415 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-abb894f3-4241-4c0e-98e8-37e08ddcbbce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8339b9f6e25a434b805f40f20feda4be', 'request_id': 'req-abb894f3-4241-4c0e-98e8-37e08ddcbbce'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:40:53.319118 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-abb894f3-4241-4c0e-98e8-37e08ddcbbce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8339b9f6e25a434b805f40f20feda4be', 'request_id': 'req-abb894f3-4241-4c0e-98e8-37e08ddcbbce'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:40:53.331327 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-abb894f3-4241-4c0e-98e8-37e08ddcbbce admin admin] The token cache is being invalidate because project 8339b9f6e25a434b805f40f20feda4be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:40:53.331602 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-abb894f3-4241-4c0e-98e8-37e08ddcbbce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:40:53.332221 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-abb894f3-4241-4c0e-98e8-37e08ddcbbce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:40:53.333718 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1399/2817] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:40:53 2022] DELETE /identity/v3/projects/8339b9f6e25a434b805f40f20feda4be => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:40:53.338010 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f4480-19ff-41e5-bd89-a364a574457f service neutron] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:40:53.348004 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f4480-19ff-41e5-bd89-a364a574457f service neutron] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:40:53.352901 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:40:53.413652 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3371ef1c-8130-4821-8fc4-9fe4f77a0e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:40:53.414307 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371ef1c-8130-4821-8fc4-9fe4f77a0e27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:53.414578 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371ef1c-8130-4821-8fc4-9fe4f77a0e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:53.414863 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371ef1c-8130-4821-8fc4-9fe4f77a0e27 admin admin] PATH_INFO: `/v3/users/a1b690a9a62e4400b2d3d00fc67f819c` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:53.416099 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3371ef1c-8130-4821-8fc4-9fe4f77a0e27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1b690a9a62e4400b2d3d00fc67f819c)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:40:53.418013 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3371ef1c-8130-4821-8fc4-9fe4f77a0e27 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:40:53.469548 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-3371ef1c-8130-4821-8fc4-9fe4f77a0e27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1b690a9a62e4400b2d3d00fc67f819c'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:40:53.481253 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-3371ef1c-8130-4821-8fc4-9fe4f77a0e27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1b690a9a62e4400b2d3d00fc67f819c'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:40:53.482265 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-3371ef1c-8130-4821-8fc4-9fe4f77a0e27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1b690a9a62e4400b2d3d00fc67f819c'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:40:53.494538 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-3371ef1c-8130-4821-8fc4-9fe4f77a0e27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1b690a9a62e4400b2d3d00fc67f819c'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:40:53.508058 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-3371ef1c-8130-4821-8fc4-9fe4f77a0e27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1b690a9a62e4400b2d3d00fc67f819c'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:40:53.514701 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1419/2818] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:40:53 2022] DELETE /identity/v3/users/a1b690a9a62e4400b2d3d00fc67f819c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:40:53.808929 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb894f3-4241-4c0e-98e8-37e08ddcbbce admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:40:53.810484 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-abb894f3-4241-4c0e-98e8-37e08ddcbbce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:40:53.824574 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb894f3-4241-4c0e-98e8-37e08ddcbbce admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:40:53.883253 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abbae66-76b8-470a-bf90-63fb116a74cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:40:53.883810 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abbae66-76b8-470a-bf90-63fb116a74cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:53.884143 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abbae66-76b8-470a-bf90-63fb116a74cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:53.884373 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abbae66-76b8-470a-bf90-63fb116a74cc admin admin] PATH_INFO: `/v3/projects/091f0a5c14cf4a68a5293de948162a58` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:53.885844 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abbae66-76b8-470a-bf90-63fb116a74cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=091f0a5c14cf4a68a5293de948162a58)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:40:53.887808 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abbae66-76b8-470a-bf90-63fb116a74cc admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:40:53.932999 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:40:53.943428 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-5abbae66-76b8-470a-bf90-63fb116a74cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '091f0a5c14cf4a68a5293de948162a58', 'request_id': 'req-5abbae66-76b8-470a-bf90-63fb116a74cc'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:40:53.952628 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-5abbae66-76b8-470a-bf90-63fb116a74cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '091f0a5c14cf4a68a5293de948162a58', 'request_id': 'req-5abbae66-76b8-470a-bf90-63fb116a74cc'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:40:53.958346 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-5abbae66-76b8-470a-bf90-63fb116a74cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '091f0a5c14cf4a68a5293de948162a58', 'request_id': 'req-5abbae66-76b8-470a-bf90-63fb116a74cc'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:40:53.970076 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-5abbae66-76b8-470a-bf90-63fb116a74cc admin admin] The token cache is being invalidate because project 091f0a5c14cf4a68a5293de948162a58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:40:53.970386 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-5abbae66-76b8-470a-bf90-63fb116a74cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:40:53.971011 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-5abbae66-76b8-470a-bf90-63fb116a74cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:40:53.972745 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1400/2819] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:40:53 2022] DELETE /identity/v3/projects/091f0a5c14cf4a68a5293de948162a58 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:40:53.977885 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f9cc4b-cf54-42e9-a224-3a165d6ef20b None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:53.978242 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f9cc4b-cf54-42e9-a224-3a165d6ef20b None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:53.978523 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f9cc4b-cf54-42e9-a224-3a165d6ef20b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:53.998839 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-c6f9cc4b-cf54-42e9-a224-3a165d6ef20b None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:40:54.000039 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-c6f9cc4b-cf54-42e9-a224-3a165d6ef20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:40:54.077948 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1420/2820] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:40:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:40:54.087375 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52eab9d-7b72-4f3c-b473-91b1f1482b33 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:54.087680 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52eab9d-7b72-4f3c-b473-91b1f1482b33 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:54.087936 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52eab9d-7b72-4f3c-b473-91b1f1482b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:54.108809 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-c52eab9d-7b72-4f3c-b473-91b1f1482b33 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:40:54.110027 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c52eab9d-7b72-4f3c-b473-91b1f1482b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:40:54.119146 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1401/2821] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:40:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:40:54.124001 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f9cc4b-cf54-42e9-a224-3a165d6ef20b None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:40:54.137584 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f9cc4b-cf54-42e9-a224-3a165d6ef20b None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:40:54.142704 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c75495c-3089-4507-967c-35a329254c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:40:54.143331 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75495c-3089-4507-967c-35a329254c17 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:54.143604 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75495c-3089-4507-967c-35a329254c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:54.143871 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75495c-3089-4507-967c-35a329254c17 admin admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:54.144540 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c75495c-3089-4507-967c-35a329254c17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:40:54.144867 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c75495c-3089-4507-967c-35a329254c17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:40:54.146517 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c75495c-3089-4507-967c-35a329254c17 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:40:54.159352 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1421/2822] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 01:40:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:40:54.166088 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52eab9d-7b72-4f3c-b473-91b1f1482b33 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:40:54.175526 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52eab9d-7b72-4f3c-b473-91b1f1482b33 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:40:54.182237 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d9ba83-805e-473d-9251-926eac98c74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:40:54.182872 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9ba83-805e-473d-9251-926eac98c74d admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:54.183122 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9ba83-805e-473d-9251-926eac98c74d admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:54.183412 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9ba83-805e-473d-9251-926eac98c74d admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:54.184015 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d9ba83-805e-473d-9251-926eac98c74d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:40:54.185922 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d9ba83-805e-473d-9251-926eac98c74d admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:40:54.221395 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1402/2823] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:40:54 2022] POST /identity/v3/projects => generated 381 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:40:54.226355 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c75495c-3089-4507-967c-35a329254c17 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:40:54.237347 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c75495c-3089-4507-967c-35a329254c17 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:40:54.249326 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:40:54.296180 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2e1e99-4467-4f06-aa86-237893d2d850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:40:54.296789 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e1e99-4467-4f06-aa86-237893d2d850 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:54.297071 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e1e99-4467-4f06-aa86-237893d2d850 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:54.297342 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e1e99-4467-4f06-aa86-237893d2d850 admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:54.297961 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2e1e99-4467-4f06-aa86-237893d2d850 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:40:54.299918 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2e1e99-4467-4f06-aa86-237893d2d850 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:40:54.326345 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1422/2824] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:40:54 2022] POST /identity/v3/users => generated 291 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:40:54.330419 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d9ba83-805e-473d-9251-926eac98c74d admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:40:54.341335 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d9ba83-805e-473d-9251-926eac98c74d admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:40:54.346153 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a820f5d-39be-4a7f-a195-25fa26fee3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:40:54.346767 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a820f5d-39be-4a7f-a195-25fa26fee3cc admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:54.347046 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a820f5d-39be-4a7f-a195-25fa26fee3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:54.347312 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a820f5d-39be-4a7f-a195-25fa26fee3cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:54.347961 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a820f5d-39be-4a7f-a195-25fa26fee3cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:40:54.349593 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a820f5d-39be-4a7f-a195-25fa26fee3cc admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:40:54.359869 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1403/2825] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:40:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 01:40:54.364103 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2e1e99-4467-4f06-aa86-237893d2d850 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:40:54.374629 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2e1e99-4467-4f06-aa86-237893d2d850 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:40:54.379567 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b7fbe2-9fc2-4900-9fa6-69cf8d73a225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:40:54.380193 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7fbe2-9fc2-4900-9fa6-69cf8d73a225 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:54.380472 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7fbe2-9fc2-4900-9fa6-69cf8d73a225 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:54.380741 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7fbe2-9fc2-4900-9fa6-69cf8d73a225 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:54.381418 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b7fbe2-9fc2-4900-9fa6-69cf8d73a225 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:40:54.383167 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b7fbe2-9fc2-4900-9fa6-69cf8d73a225 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:40:54.394824 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1423/2826] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:40:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:40:54.398845 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a820f5d-39be-4a7f-a195-25fa26fee3cc admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:40:54.412489 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a820f5d-39be-4a7f-a195-25fa26fee3cc admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:40:54.419477 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe601c-5055-470c-bb85-8b3a95062a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:40:54.420151 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe601c-5055-470c-bb85-8b3a95062a51 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:54.420404 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe601c-5055-470c-bb85-8b3a95062a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:54.420682 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe601c-5055-470c-bb85-8b3a95062a51 admin admin] PATH_INFO: `/v3/projects/7f8846c017784d3c9af449b3e8c144c2/users/f7fdaa8683364debbd32fb29727db992/roles/13af81971c1c428eae0a571a22ea583d` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:54.436593 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbe601c-5055-470c-bb85-8b3a95062a51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f8846c017784d3c9af449b3e8c144c2, user_id=f7fdaa8683364debbd32fb29727db992, role_id=13af81971c1c428eae0a571a22ea583d)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:40:54.439334 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbe601c-5055-470c-bb85-8b3a95062a51 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:40:54.455353 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1404/2827] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:40:54 2022] PUT /identity/v3/projects/7f8846c017784d3c9af449b3e8c144c2/users/f7fdaa8683364debbd32fb29727db992/roles/13af81971c1c428eae0a571a22ea583d => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 01:40:54.466973 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5963874-4bba-4594-9513-4f36f5284f84 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:54.467257 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5963874-4bba-4594-9513-4f36f5284f84 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:54.467536 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5963874-4bba-4594-9513-4f36f5284f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:54.497741 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-c5963874-4bba-4594-9513-4f36f5284f84 None None] MFA Rules not processed for user `f7fdaa8683364debbd32fb29727db992`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:40:54.498991 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-c5963874-4bba-4594-9513-4f36f5284f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:40:54.572346 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1424/2828] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:40:54 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:40:54.577089 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe601c-5055-470c-bb85-8b3a95062a51 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:40:54.651997 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe601c-5055-470c-bb85-8b3a95062a51 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:40:54.657928 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c0619c-215b-4a8a-bc8c-2202d14d277c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:40:54.658614 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0619c-215b-4a8a-bc8c-2202d14d277c admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:54.658889 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0619c-215b-4a8a-bc8c-2202d14d277c admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:54.659156 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0619c-215b-4a8a-bc8c-2202d14d277c admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:54.659776 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c0619c-215b-4a8a-bc8c-2202d14d277c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:40:54.661694 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c0619c-215b-4a8a-bc8c-2202d14d277c admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:40:54.691283 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1405/2829] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:40:54 2022] POST /identity/v3/projects => generated 379 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:40:54.695587 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5963874-4bba-4594-9513-4f36f5284f84 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:40:54.706574 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5963874-4bba-4594-9513-4f36f5284f84 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:40:54.764368 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c6fb6f-ee68-4232-9d8c-a64c8d3c1d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:40:54.764973 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6fb6f-ee68-4232-9d8c-a64c8d3c1d82 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:54.765243 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6fb6f-ee68-4232-9d8c-a64c8d3c1d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:54.765512 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6fb6f-ee68-4232-9d8c-a64c8d3c1d82 admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:54.766153 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c6fb6f-ee68-4232-9d8c-a64c8d3c1d82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:40:54.768082 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c6fb6f-ee68-4232-9d8c-a64c8d3c1d82 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:40:54.791677 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1425/2830] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:40:54 2022] POST /identity/v3/users => generated 296 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 01:40:54.795925 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c0619c-215b-4a8a-bc8c-2202d14d277c admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:40:54.806145 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c0619c-215b-4a8a-bc8c-2202d14d277c admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:40:54.811009 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e223e9-631b-4315-95eb-9ee596251446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:40:54.811604 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e223e9-631b-4315-95eb-9ee596251446 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:54.811877 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e223e9-631b-4315-95eb-9ee596251446 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:54.812146 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e223e9-631b-4315-95eb-9ee596251446 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:54.812817 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e223e9-631b-4315-95eb-9ee596251446 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:40:54.814432 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e223e9-631b-4315-95eb-9ee596251446 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:40:54.824918 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1406/2831] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:40:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:40:54.829111 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c6fb6f-ee68-4232-9d8c-a64c8d3c1d82 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:40:54.840071 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c6fb6f-ee68-4232-9d8c-a64c8d3c1d82 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:40:54.845774 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed51e95b-7b1a-4db3-9069-50b9da30c707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:40:54.846469 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed51e95b-7b1a-4db3-9069-50b9da30c707 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:54.846748 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed51e95b-7b1a-4db3-9069-50b9da30c707 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:54.847017 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed51e95b-7b1a-4db3-9069-50b9da30c707 admin admin] PATH_INFO: `/v3/projects/53bdd577f008493189b63e1124a4e470/users/cc85477e03484735abe49e37b41326c2/roles/fb48693810be495fb4b1893a79429b78` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:54.859110 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:40:54.864104 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed51e95b-7b1a-4db3-9069-50b9da30c707 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53bdd577f008493189b63e1124a4e470, user_id=cc85477e03484735abe49e37b41326c2, role_id=fb48693810be495fb4b1893a79429b78)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:40:54.867021 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed51e95b-7b1a-4db3-9069-50b9da30c707 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:40:54.885729 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1426/2832] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:40:54 2022] PUT /identity/v3/projects/53bdd577f008493189b63e1124a4e470/users/cc85477e03484735abe49e37b41326c2/roles/fb48693810be495fb4b1893a79429b78 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:40:54.890166 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e223e9-631b-4315-95eb-9ee596251446 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:40:54.900759 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e223e9-631b-4315-95eb-9ee596251446 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:40:54.934970 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:40:54.961055 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114dec0a-eb28-4edf-b457-838a9f949c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:40:54.961689 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114dec0a-eb28-4edf-b457-838a9f949c66 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:54.961993 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114dec0a-eb28-4edf-b457-838a9f949c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:54.962289 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114dec0a-eb28-4edf-b457-838a9f949c66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:54.962917 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114dec0a-eb28-4edf-b457-838a9f949c66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:40:54.964853 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114dec0a-eb28-4edf-b457-838a9f949c66 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:40:54.974478 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1407/2833] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:40:54 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:40:54.979513 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed51e95b-7b1a-4db3-9069-50b9da30c707 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:40:54.990078 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed51e95b-7b1a-4db3-9069-50b9da30c707 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:40:54.995624 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0426198e-dfc8-4e2b-9f37-276ff4de160e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:40:54.996292 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426198e-dfc8-4e2b-9f37-276ff4de160e admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:54.996539 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426198e-dfc8-4e2b-9f37-276ff4de160e admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:54.996811 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426198e-dfc8-4e2b-9f37-276ff4de160e admin admin] PATH_INFO: `/v3/projects/53bdd577f008493189b63e1124a4e470/users/cc85477e03484735abe49e37b41326c2/roles/fb48693810be495fb4b1893a79429b78` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:54.999039 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0426198e-dfc8-4e2b-9f37-276ff4de160e admin admin] RBAC: Authorizing `identity:create_grant(project_id=53bdd577f008493189b63e1124a4e470, user_id=cc85477e03484735abe49e37b41326c2, role_id=fb48693810be495fb4b1893a79429b78)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:40:55.001745 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0426198e-dfc8-4e2b-9f37-276ff4de160e admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:40:55.014619 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1427/2834] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:40:54 2022] PUT /identity/v3/projects/53bdd577f008493189b63e1124a4e470/users/cc85477e03484735abe49e37b41326c2/roles/fb48693810be495fb4b1893a79429b78 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:40:55.025230 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c957bf-16ee-4514-b9be-7493af371050 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:55.025515 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c957bf-16ee-4514-b9be-7493af371050 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:55.025784 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c957bf-16ee-4514-b9be-7493af371050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:55.056140 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-e9c957bf-16ee-4514-b9be-7493af371050 None None] MFA Rules not processed for user `cc85477e03484735abe49e37b41326c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:40:55.057365 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-e9c957bf-16ee-4514-b9be-7493af371050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:40:55.128039 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1408/2835] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:40:55 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:40:55.144829 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0426198e-dfc8-4e2b-9f37-276ff4de160e admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:40:55.147650 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-0426198e-dfc8-4e2b-9f37-276ff4de160e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:40:55.219143 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0426198e-dfc8-4e2b-9f37-276ff4de160e admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:40:55.223383 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da693748-9df1-4523-b9bb-4b3f9cfb04e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7853d40c29af424c8d7913950d89750b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:40:55.223992 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da693748-9df1-4523-b9bb-4b3f9cfb04e9 service cinder] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:55.224983 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da693748-9df1-4523-b9bb-4b3f9cfb04e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:55.225258 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da693748-9df1-4523-b9bb-4b3f9cfb04e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:55.235279 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da693748-9df1-4523-b9bb-4b3f9cfb04e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:40:55.236707 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da693748-9df1-4523-b9bb-4b3f9cfb04e9 service cinder] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:40:55.246859 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1428/2836] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:40:55 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:40:55.588684 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c957bf-16ee-4514-b9be-7493af371050 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:40:55.598368 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c957bf-16ee-4514-b9be-7493af371050 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:40:55.604064 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d81f0e7-8e69-4db2-a9ec-caf044bad7db tempest-VolumeQuotaClassesTest-802964971 tempest-VolumeQuotaClassesTest-802964971-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc85477e03484735abe49e37b41326c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53bdd577f008493189b63e1124a4e470', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:40:55.604669 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81f0e7-8e69-4db2-a9ec-caf044bad7db tempest-VolumeQuotaClassesTest-802964971 tempest-VolumeQuotaClassesTest-802964971-project-admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:55.605068 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81f0e7-8e69-4db2-a9ec-caf044bad7db tempest-VolumeQuotaClassesTest-802964971 tempest-VolumeQuotaClassesTest-802964971-project-admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:55.605424 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81f0e7-8e69-4db2-a9ec-caf044bad7db tempest-VolumeQuotaClassesTest-802964971 tempest-VolumeQuotaClassesTest-802964971-project-admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:55.606081 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d81f0e7-8e69-4db2-a9ec-caf044bad7db tempest-VolumeQuotaClassesTest-802964971 tempest-VolumeQuotaClassesTest-802964971-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:40:55.606416 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d81f0e7-8e69-4db2-a9ec-caf044bad7db tempest-VolumeQuotaClassesTest-802964971 tempest-VolumeQuotaClassesTest-802964971-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:40:55.608027 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d81f0e7-8e69-4db2-a9ec-caf044bad7db tempest-VolumeQuotaClassesTest-802964971 tempest-VolumeQuotaClassesTest-802964971-project-admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:40:55.619776 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1409/2837] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 01:40:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:40:55.624166 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da693748-9df1-4523-b9bb-4b3f9cfb04e9 service cinder] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:40:55.633450 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da693748-9df1-4523-b9bb-4b3f9cfb04e9 service cinder] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:40:55.639376 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eafb3d-cab3-49bd-bb6d-0fdfbe5f7531 tempest-VolumeQuotaClassesTest-802964971 tempest-VolumeQuotaClassesTest-802964971-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc85477e03484735abe49e37b41326c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53bdd577f008493189b63e1124a4e470', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:40:55.640006 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eafb3d-cab3-49bd-bb6d-0fdfbe5f7531 tempest-VolumeQuotaClassesTest-802964971 tempest-VolumeQuotaClassesTest-802964971-project-admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:55.640266 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eafb3d-cab3-49bd-bb6d-0fdfbe5f7531 tempest-VolumeQuotaClassesTest-802964971 tempest-VolumeQuotaClassesTest-802964971-project-admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:55.640554 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eafb3d-cab3-49bd-bb6d-0fdfbe5f7531 tempest-VolumeQuotaClassesTest-802964971 tempest-VolumeQuotaClassesTest-802964971-project-admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:55.641195 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eafb3d-cab3-49bd-bb6d-0fdfbe5f7531 tempest-VolumeQuotaClassesTest-802964971 tempest-VolumeQuotaClassesTest-802964971-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:40:55.643127 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eafb3d-cab3-49bd-bb6d-0fdfbe5f7531 tempest-VolumeQuotaClassesTest-802964971 tempest-VolumeQuotaClassesTest-802964971-project-admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:40:55.675958 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1429/2838] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:40:55 2022] POST /identity/v3/projects => generated 355 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:40:55.677889 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d81f0e7-8e69-4db2-a9ec-caf044bad7db tempest-VolumeQuotaClassesTest-802964971 tempest-VolumeQuotaClassesTest-802964971-project-admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:40:55.688760 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d81f0e7-8e69-4db2-a9ec-caf044bad7db tempest-VolumeQuotaClassesTest-802964971 tempest-VolumeQuotaClassesTest-802964971-project-admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:40:55.752357 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bb19a5-8d4e-4599-9816-2b90ce2f59fc tempest-VolumeQuotaClassesTest-802964971 tempest-VolumeQuotaClassesTest-802964971-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc85477e03484735abe49e37b41326c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53bdd577f008493189b63e1124a4e470', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:40:55.752873 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb19a5-8d4e-4599-9816-2b90ce2f59fc tempest-VolumeQuotaClassesTest-802964971 tempest-VolumeQuotaClassesTest-802964971-project-admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:55.753127 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb19a5-8d4e-4599-9816-2b90ce2f59fc tempest-VolumeQuotaClassesTest-802964971 tempest-VolumeQuotaClassesTest-802964971-project-admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:55.753394 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb19a5-8d4e-4599-9816-2b90ce2f59fc tempest-VolumeQuotaClassesTest-802964971 tempest-VolumeQuotaClassesTest-802964971-project-admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:55.754026 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bb19a5-8d4e-4599-9816-2b90ce2f59fc tempest-VolumeQuotaClassesTest-802964971 tempest-VolumeQuotaClassesTest-802964971-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:40:55.754350 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bb19a5-8d4e-4599-9816-2b90ce2f59fc tempest-VolumeQuotaClassesTest-802964971 tempest-VolumeQuotaClassesTest-802964971-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:40:55.755935 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bb19a5-8d4e-4599-9816-2b90ce2f59fc tempest-VolumeQuotaClassesTest-802964971 tempest-VolumeQuotaClassesTest-802964971-project-admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:40:55.767605 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1410/2839] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 01:40:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:40:55.808402 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eafb3d-cab3-49bd-bb6d-0fdfbe5f7531 tempest-VolumeQuotaClassesTest-802964971 tempest-VolumeQuotaClassesTest-802964971-project-admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:40:55.824649 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eafb3d-cab3-49bd-bb6d-0fdfbe5f7531 tempest-VolumeQuotaClassesTest-802964971 tempest-VolumeQuotaClassesTest-802964971-project-admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:40:55.830139 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b02f8b9-acc7-4434-b595-3dabe3cdf5dc tempest-VolumeQuotaClassesTest-802964971 tempest-VolumeQuotaClassesTest-802964971-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc85477e03484735abe49e37b41326c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53bdd577f008493189b63e1124a4e470', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:40:55.830779 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b02f8b9-acc7-4434-b595-3dabe3cdf5dc tempest-VolumeQuotaClassesTest-802964971 tempest-VolumeQuotaClassesTest-802964971-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:55.831071 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b02f8b9-acc7-4434-b595-3dabe3cdf5dc tempest-VolumeQuotaClassesTest-802964971 tempest-VolumeQuotaClassesTest-802964971-project-admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:55.831343 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b02f8b9-acc7-4434-b595-3dabe3cdf5dc tempest-VolumeQuotaClassesTest-802964971 tempest-VolumeQuotaClassesTest-802964971-project-admin] PATH_INFO: `/v3/projects/73107b60dfdb4a05819dea9557cbf6dd` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:55.832575 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b02f8b9-acc7-4434-b595-3dabe3cdf5dc tempest-VolumeQuotaClassesTest-802964971 tempest-VolumeQuotaClassesTest-802964971-project-admin] RBAC: Authorizing `identity:delete_project(project_id=73107b60dfdb4a05819dea9557cbf6dd)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:40:55.834566 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b02f8b9-acc7-4434-b595-3dabe3cdf5dc tempest-VolumeQuotaClassesTest-802964971 tempest-VolumeQuotaClassesTest-802964971-project-admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:40:55.891425 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-7b02f8b9-acc7-4434-b595-3dabe3cdf5dc tempest-VolumeQuotaClassesTest-802964971 tempest-VolumeQuotaClassesTest-802964971-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73107b60dfdb4a05819dea9557cbf6dd', 'request_id': 'req-7b02f8b9-acc7-4434-b595-3dabe3cdf5dc'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:40:55.897390 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-7b02f8b9-acc7-4434-b595-3dabe3cdf5dc tempest-VolumeQuotaClassesTest-802964971 tempest-VolumeQuotaClassesTest-802964971-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73107b60dfdb4a05819dea9557cbf6dd', 'request_id': 'req-7b02f8b9-acc7-4434-b595-3dabe3cdf5dc'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:40:55.904191 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-7b02f8b9-acc7-4434-b595-3dabe3cdf5dc tempest-VolumeQuotaClassesTest-802964971 tempest-VolumeQuotaClassesTest-802964971-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73107b60dfdb4a05819dea9557cbf6dd', 'request_id': 'req-7b02f8b9-acc7-4434-b595-3dabe3cdf5dc'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:40:55.919116 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-7b02f8b9-acc7-4434-b595-3dabe3cdf5dc tempest-VolumeQuotaClassesTest-802964971 tempest-VolumeQuotaClassesTest-802964971-project-admin] The token cache is being invalidate because project 73107b60dfdb4a05819dea9557cbf6dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:40:55.919438 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-7b02f8b9-acc7-4434-b595-3dabe3cdf5dc tempest-VolumeQuotaClassesTest-802964971 tempest-VolumeQuotaClassesTest-802964971-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:40:55.920179 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-7b02f8b9-acc7-4434-b595-3dabe3cdf5dc tempest-VolumeQuotaClassesTest-802964971 tempest-VolumeQuotaClassesTest-802964971-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:40:55.921806 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1430/2840] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:40:55 2022] DELETE /identity/v3/projects/73107b60dfdb4a05819dea9557cbf6dd => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:40:56.153663 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bb19a5-8d4e-4599-9816-2b90ce2f59fc tempest-VolumeQuotaClassesTest-802964971 tempest-VolumeQuotaClassesTest-802964971-project-admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:40:56.155741 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-49bb19a5-8d4e-4599-9816-2b90ce2f59fc tempest-VolumeQuotaClassesTest-802964971 tempest-VolumeQuotaClassesTest-802964971-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:40:56.200212 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:40:56.224454 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bb19a5-8d4e-4599-9816-2b90ce2f59fc tempest-VolumeQuotaClassesTest-802964971 tempest-VolumeQuotaClassesTest-802964971-project-admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:40:56.286426 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4980a19-8a91-4116-91b8-5c598e116cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:40:56.287340 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4980a19-8a91-4116-91b8-5c598e116cb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:56.287700 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4980a19-8a91-4116-91b8-5c598e116cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:56.288080 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4980a19-8a91-4116-91b8-5c598e116cb1 admin admin] PATH_INFO: `/v3/users/f7fdaa8683364debbd32fb29727db992` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:56.289806 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4980a19-8a91-4116-91b8-5c598e116cb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7fdaa8683364debbd32fb29727db992)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:40:56.292874 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4980a19-8a91-4116-91b8-5c598e116cb1 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:40:56.352563 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b4980a19-8a91-4116-91b8-5c598e116cb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7fdaa8683364debbd32fb29727db992'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:40:56.360837 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b4980a19-8a91-4116-91b8-5c598e116cb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7fdaa8683364debbd32fb29727db992'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:40:56.361616 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b4980a19-8a91-4116-91b8-5c598e116cb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7fdaa8683364debbd32fb29727db992'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:40:56.370248 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b4980a19-8a91-4116-91b8-5c598e116cb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7fdaa8683364debbd32fb29727db992'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:40:56.384984 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b4980a19-8a91-4116-91b8-5c598e116cb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7fdaa8683364debbd32fb29727db992'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:40:56.392605 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1411/2841] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:40:56 2022] DELETE /identity/v3/users/f7fdaa8683364debbd32fb29727db992 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:40:56.397353 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfacd9b1-e8cf-4ebf-bd82-287b64429627 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:56.397623 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfacd9b1-e8cf-4ebf-bd82-287b64429627 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:56.397902 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfacd9b1-e8cf-4ebf-bd82-287b64429627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:56.417861 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-dfacd9b1-e8cf-4ebf-bd82-287b64429627 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:40:56.419149 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-dfacd9b1-e8cf-4ebf-bd82-287b64429627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:40:56.458941 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:40:56.485349 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1431/2842] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:40:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:40:56.495468 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4980a19-8a91-4116-91b8-5c598e116cb1 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:40:56.496950 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-b4980a19-8a91-4116-91b8-5c598e116cb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:40:56.555850 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4980a19-8a91-4116-91b8-5c598e116cb1 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:40:56.560041 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b032e067-be86-43f8-9f00-d0bf9207f70f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:40:56.560646 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b032e067-be86-43f8-9f00-d0bf9207f70f service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:56.560905 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b032e067-be86-43f8-9f00-d0bf9207f70f service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:56.561178 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b032e067-be86-43f8-9f00-d0bf9207f70f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:56.571137 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b032e067-be86-43f8-9f00-d0bf9207f70f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:40:56.572576 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b032e067-be86-43f8-9f00-d0bf9207f70f service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:40:56.582245 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1412/2843] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:40:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:40:56.860622 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfacd9b1-e8cf-4ebf-bd82-287b64429627 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:40:56.862187 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-dfacd9b1-e8cf-4ebf-bd82-287b64429627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:40:56.875298 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfacd9b1-e8cf-4ebf-bd82-287b64429627 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:40:56.880123 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc3c2d2-b058-49dc-a95f-e628dc3dfa66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:40:56.880915 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3c2d2-b058-49dc-a95f-e628dc3dfa66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:56.881326 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3c2d2-b058-49dc-a95f-e628dc3dfa66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:56.882390 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3c2d2-b058-49dc-a95f-e628dc3dfa66 admin admin] PATH_INFO: `/v3/projects/7f8846c017784d3c9af449b3e8c144c2` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:56.883629 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc3c2d2-b058-49dc-a95f-e628dc3dfa66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f8846c017784d3c9af449b3e8c144c2)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:40:56.886235 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc3c2d2-b058-49dc-a95f-e628dc3dfa66 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:40:56.936671 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-5fc3c2d2-b058-49dc-a95f-e628dc3dfa66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f8846c017784d3c9af449b3e8c144c2', 'request_id': 'req-5fc3c2d2-b058-49dc-a95f-e628dc3dfa66'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:40:56.942219 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-5fc3c2d2-b058-49dc-a95f-e628dc3dfa66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f8846c017784d3c9af449b3e8c144c2', 'request_id': 'req-5fc3c2d2-b058-49dc-a95f-e628dc3dfa66'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:40:56.948491 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-5fc3c2d2-b058-49dc-a95f-e628dc3dfa66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f8846c017784d3c9af449b3e8c144c2', 'request_id': 'req-5fc3c2d2-b058-49dc-a95f-e628dc3dfa66'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:40:56.962574 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-5fc3c2d2-b058-49dc-a95f-e628dc3dfa66 admin admin] The token cache is being invalidate because project 7f8846c017784d3c9af449b3e8c144c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:40:56.962858 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-5fc3c2d2-b058-49dc-a95f-e628dc3dfa66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:40:56.963500 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-5fc3c2d2-b058-49dc-a95f-e628dc3dfa66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:40:56.965081 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1432/2844] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:40:56 2022] DELETE /identity/v3/projects/7f8846c017784d3c9af449b3e8c144c2 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:40:56.969451 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b032e067-be86-43f8-9f00-d0bf9207f70f service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:40:56.979432 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b032e067-be86-43f8-9f00-d0bf9207f70f service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:40:56.983470 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:40:57.043510 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2635e40c-faad-4219-8f2f-51c26a686312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:40:57.044338 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2635e40c-faad-4219-8f2f-51c26a686312 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:57.044615 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2635e40c-faad-4219-8f2f-51c26a686312 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:57.044892 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2635e40c-faad-4219-8f2f-51c26a686312 admin admin] PATH_INFO: `/v3/users/cc85477e03484735abe49e37b41326c2` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:57.046189 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2635e40c-faad-4219-8f2f-51c26a686312 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc85477e03484735abe49e37b41326c2)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:40:57.048168 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2635e40c-faad-4219-8f2f-51c26a686312 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:40:57.103153 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-2635e40c-faad-4219-8f2f-51c26a686312 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc85477e03484735abe49e37b41326c2'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:40:57.112211 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-2635e40c-faad-4219-8f2f-51c26a686312 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc85477e03484735abe49e37b41326c2'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:40:57.112961 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-2635e40c-faad-4219-8f2f-51c26a686312 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc85477e03484735abe49e37b41326c2'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:40:57.122385 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-2635e40c-faad-4219-8f2f-51c26a686312 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc85477e03484735abe49e37b41326c2'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:40:57.138614 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-2635e40c-faad-4219-8f2f-51c26a686312 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc85477e03484735abe49e37b41326c2'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:40:57.145595 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1413/2845] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:40:56 2022] DELETE /identity/v3/users/cc85477e03484735abe49e37b41326c2 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:40:57.433175 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc3c2d2-b058-49dc-a95f-e628dc3dfa66 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:40:57.434915 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-5fc3c2d2-b058-49dc-a95f-e628dc3dfa66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:40:57.448579 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc3c2d2-b058-49dc-a95f-e628dc3dfa66 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:40:57.511287 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f858be-eb2e-4737-b6ef-15c2f085f3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:40:57.511923 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f858be-eb2e-4737-b6ef-15c2f085f3d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:57.512221 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f858be-eb2e-4737-b6ef-15c2f085f3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:57.512838 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f858be-eb2e-4737-b6ef-15c2f085f3d3 admin admin] PATH_INFO: `/v3/projects/53bdd577f008493189b63e1124a4e470` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:57.513976 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f858be-eb2e-4737-b6ef-15c2f085f3d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53bdd577f008493189b63e1124a4e470)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:40:57.515999 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f858be-eb2e-4737-b6ef-15c2f085f3d3 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:40:57.564618 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-18f858be-eb2e-4737-b6ef-15c2f085f3d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53bdd577f008493189b63e1124a4e470', 'request_id': 'req-18f858be-eb2e-4737-b6ef-15c2f085f3d3'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:40:57.570278 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-18f858be-eb2e-4737-b6ef-15c2f085f3d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53bdd577f008493189b63e1124a4e470', 'request_id': 'req-18f858be-eb2e-4737-b6ef-15c2f085f3d3'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:40:57.576595 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-18f858be-eb2e-4737-b6ef-15c2f085f3d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53bdd577f008493189b63e1124a4e470', 'request_id': 'req-18f858be-eb2e-4737-b6ef-15c2f085f3d3'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:40:57.579193 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:40:57.592981 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-18f858be-eb2e-4737-b6ef-15c2f085f3d3 admin admin] The token cache is being invalidate because project 53bdd577f008493189b63e1124a4e470 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:40:57.593264 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-18f858be-eb2e-4737-b6ef-15c2f085f3d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:40:57.593908 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-18f858be-eb2e-4737-b6ef-15c2f085f3d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:40:57.595601 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1433/2846] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:40:57 2022] DELETE /identity/v3/projects/53bdd577f008493189b63e1124a4e470 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:40:57.600555 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d322f8e6-fd2a-48e0-aa70-566777c8ee0e None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:57.600843 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d322f8e6-fd2a-48e0-aa70-566777c8ee0e None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:57.601119 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d322f8e6-fd2a-48e0-aa70-566777c8ee0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:57.621322 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-d322f8e6-fd2a-48e0-aa70-566777c8ee0e None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:40:57.622601 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d322f8e6-fd2a-48e0-aa70-566777c8ee0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:40:57.681853 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1414/2847] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:40:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:40:57.689806 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c470994-d8b2-4257-967d-a2004aac7ada None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:57.690089 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c470994-d8b2-4257-967d-a2004aac7ada None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:57.690382 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c470994-d8b2-4257-967d-a2004aac7ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:57.711033 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-6c470994-d8b2-4257-967d-a2004aac7ada None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:40:57.712246 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-6c470994-d8b2-4257-967d-a2004aac7ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:40:57.721402 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1434/2848] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:40:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:40:57.725867 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d322f8e6-fd2a-48e0-aa70-566777c8ee0e None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:40:57.736338 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d322f8e6-fd2a-48e0-aa70-566777c8ee0e None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:40:57.741985 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5248dfd-1e73-48a0-a161-40a6018f6fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:40:57.742638 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5248dfd-1e73-48a0-a161-40a6018f6fec admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:57.742915 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5248dfd-1e73-48a0-a161-40a6018f6fec admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:57.743179 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5248dfd-1e73-48a0-a161-40a6018f6fec admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:57.743822 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5248dfd-1e73-48a0-a161-40a6018f6fec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:40:57.744125 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5248dfd-1e73-48a0-a161-40a6018f6fec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:40:57.745721 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5248dfd-1e73-48a0-a161-40a6018f6fec admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:40:57.758562 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1415/2849] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 01:40:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:40:57.763692 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c470994-d8b2-4257-967d-a2004aac7ada None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:40:57.775030 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c470994-d8b2-4257-967d-a2004aac7ada None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:40:57.780118 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777d0e36-185c-4aac-8f0d-04e138e15b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:40:57.780712 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777d0e36-185c-4aac-8f0d-04e138e15b36 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:57.780987 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777d0e36-185c-4aac-8f0d-04e138e15b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:57.781252 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777d0e36-185c-4aac-8f0d-04e138e15b36 admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:57.781902 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777d0e36-185c-4aac-8f0d-04e138e15b36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:40:57.783847 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777d0e36-185c-4aac-8f0d-04e138e15b36 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:40:57.813461 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1435/2850] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:40:57 2022] POST /identity/v3/projects => generated 381 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:40:57.818071 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5248dfd-1e73-48a0-a161-40a6018f6fec admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:40:57.834661 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5248dfd-1e73-48a0-a161-40a6018f6fec admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:40:57.847471 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:40:57.897492 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b49b6-4a59-4ddc-8003-02ab4ef45a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:40:57.898089 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b49b6-4a59-4ddc-8003-02ab4ef45a83 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:57.898395 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b49b6-4a59-4ddc-8003-02ab4ef45a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:57.898658 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b49b6-4a59-4ddc-8003-02ab4ef45a83 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:57.899262 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6b49b6-4a59-4ddc-8003-02ab4ef45a83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:40:57.901167 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6b49b6-4a59-4ddc-8003-02ab4ef45a83 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:40:57.924997 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1416/2851] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:40:57 2022] POST /identity/v3/users => generated 291 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:40:57.929369 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777d0e36-185c-4aac-8f0d-04e138e15b36 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:40:57.940981 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777d0e36-185c-4aac-8f0d-04e138e15b36 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:40:57.946398 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f47ff9-c4df-487e-a89e-536558588b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:40:57.947021 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f47ff9-c4df-487e-a89e-536558588b6e admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:57.947295 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f47ff9-c4df-487e-a89e-536558588b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:57.947566 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f47ff9-c4df-487e-a89e-536558588b6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:57.948216 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f47ff9-c4df-487e-a89e-536558588b6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:40:57.949923 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f47ff9-c4df-487e-a89e-536558588b6e admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:40:57.960706 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1436/2852] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:40:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:40:57.964868 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b49b6-4a59-4ddc-8003-02ab4ef45a83 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:40:57.975914 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b49b6-4a59-4ddc-8003-02ab4ef45a83 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:40:57.981828 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559f14e2-f775-4388-9bc9-7d4235c24f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:40:57.982463 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f14e2-f775-4388-9bc9-7d4235c24f43 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:57.982740 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f14e2-f775-4388-9bc9-7d4235c24f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:57.983006 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f14e2-f775-4388-9bc9-7d4235c24f43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:57.983653 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559f14e2-f775-4388-9bc9-7d4235c24f43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:40:57.985265 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559f14e2-f775-4388-9bc9-7d4235c24f43 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:40:57.996156 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1417/2853] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:40:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 01:40:58.000807 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f47ff9-c4df-487e-a89e-536558588b6e admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:40:58.011049 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f47ff9-c4df-487e-a89e-536558588b6e admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:40:58.017048 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2992a293-67c8-4ce0-9f1e-abf726bc4c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:40:58.017689 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2992a293-67c8-4ce0-9f1e-abf726bc4c90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:58.017965 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2992a293-67c8-4ce0-9f1e-abf726bc4c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:58.018268 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2992a293-67c8-4ce0-9f1e-abf726bc4c90 admin admin] PATH_INFO: `/v3/projects/016ca38350714afaae838102612e6ef7/users/125fe95e4af54539a684c04b2fd18daf/roles/13af81971c1c428eae0a571a22ea583d` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:58.033874 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2992a293-67c8-4ce0-9f1e-abf726bc4c90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=016ca38350714afaae838102612e6ef7, user_id=125fe95e4af54539a684c04b2fd18daf, role_id=13af81971c1c428eae0a571a22ea583d)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:40:58.036538 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2992a293-67c8-4ce0-9f1e-abf726bc4c90 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:40:58.057139 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1437/2854] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:40:57 2022] PUT /identity/v3/projects/016ca38350714afaae838102612e6ef7/users/125fe95e4af54539a684c04b2fd18daf/roles/13af81971c1c428eae0a571a22ea583d => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:40:58.131322 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ff806-5f14-4f28-8fbb-be8abdbd3e62 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:58.131613 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ff806-5f14-4f28-8fbb-be8abdbd3e62 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:58.131855 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ff806-5f14-4f28-8fbb-be8abdbd3e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:58.161249 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-137ff806-5f14-4f28-8fbb-be8abdbd3e62 None None] MFA Rules not processed for user `125fe95e4af54539a684c04b2fd18daf`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:40:58.162514 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-137ff806-5f14-4f28-8fbb-be8abdbd3e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:40:58.228816 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1418/2855] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:40:58 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:40:58.233638 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2992a293-67c8-4ce0-9f1e-abf726bc4c90 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:40:58.309197 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2992a293-67c8-4ce0-9f1e-abf726bc4c90 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:40:58.315261 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97705c2-3c66-4995-be02-d105ac4755cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:40:58.316119 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97705c2-3c66-4995-be02-d105ac4755cb admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:58.316427 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97705c2-3c66-4995-be02-d105ac4755cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:58.316661 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97705c2-3c66-4995-be02-d105ac4755cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:58.317603 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97705c2-3c66-4995-be02-d105ac4755cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:40:58.320578 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97705c2-3c66-4995-be02-d105ac4755cb admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:40:58.358562 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1438/2856] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:40:58 2022] POST /identity/v3/projects => generated 379 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:40:58.364318 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137ff806-5f14-4f28-8fbb-be8abdbd3e62 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:40:58.376127 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137ff806-5f14-4f28-8fbb-be8abdbd3e62 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:40:58.434898 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e6b219-d053-40fa-8e03-13edc56e31a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:40:58.435534 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e6b219-d053-40fa-8e03-13edc56e31a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:58.435824 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e6b219-d053-40fa-8e03-13edc56e31a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:58.436094 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e6b219-d053-40fa-8e03-13edc56e31a6 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:58.436710 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e6b219-d053-40fa-8e03-13edc56e31a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:40:58.438668 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e6b219-d053-40fa-8e03-13edc56e31a6 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:40:58.461883 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1419/2857] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:40:58 2022] POST /identity/v3/users => generated 296 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:40:58.466647 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97705c2-3c66-4995-be02-d105ac4755cb admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:40:58.477621 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97705c2-3c66-4995-be02-d105ac4755cb admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:40:58.483498 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d32d919-0765-4a22-b5bc-7975198b4c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:40:58.484047 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d32d919-0765-4a22-b5bc-7975198b4c0f admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:58.484352 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d32d919-0765-4a22-b5bc-7975198b4c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:58.484617 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d32d919-0765-4a22-b5bc-7975198b4c0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:58.485279 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d32d919-0765-4a22-b5bc-7975198b4c0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:40:58.486936 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d32d919-0765-4a22-b5bc-7975198b4c0f admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:40:58.498792 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1439/2858] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:40:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:40:58.504209 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e6b219-d053-40fa-8e03-13edc56e31a6 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:40:58.520821 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e6b219-d053-40fa-8e03-13edc56e31a6 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:40:58.529165 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f950879-7055-4fb2-b9dc-9d28872e40ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:40:58.529845 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f950879-7055-4fb2-b9dc-9d28872e40ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:58.530143 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f950879-7055-4fb2-b9dc-9d28872e40ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:58.530415 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f950879-7055-4fb2-b9dc-9d28872e40ac admin admin] PATH_INFO: `/v3/projects/877519a0fdd54280a904a0a2c3b9a4b5/users/af54b76076bc42968f584addd3c822f5/roles/fb48693810be495fb4b1893a79429b78` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:58.539551 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:40:58.548293 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f950879-7055-4fb2-b9dc-9d28872e40ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=877519a0fdd54280a904a0a2c3b9a4b5, user_id=af54b76076bc42968f584addd3c822f5, role_id=fb48693810be495fb4b1893a79429b78)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:40:58.552962 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f950879-7055-4fb2-b9dc-9d28872e40ac admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:40:58.572068 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1420/2859] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:40:58 2022] PUT /identity/v3/projects/877519a0fdd54280a904a0a2c3b9a4b5/users/af54b76076bc42968f584addd3c822f5/roles/fb48693810be495fb4b1893a79429b78 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:40:58.576329 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d32d919-0765-4a22-b5bc-7975198b4c0f admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:40:58.586680 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d32d919-0765-4a22-b5bc-7975198b4c0f admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:40:58.647325 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702dec68-8160-4212-bffb-f6f4bf2a38f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:40:58.647933 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702dec68-8160-4212-bffb-f6f4bf2a38f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:58.648222 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702dec68-8160-4212-bffb-f6f4bf2a38f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:58.648465 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702dec68-8160-4212-bffb-f6f4bf2a38f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:58.649104 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702dec68-8160-4212-bffb-f6f4bf2a38f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:40:58.650767 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702dec68-8160-4212-bffb-f6f4bf2a38f3 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:40:58.656318 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:40:58.662195 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1440/2860] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:40:58 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:40:58.666807 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f950879-7055-4fb2-b9dc-9d28872e40ac admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:40:58.678064 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f950879-7055-4fb2-b9dc-9d28872e40ac admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:40:58.683013 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f91b1-48af-41a4-83d2-5926295091d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:40:58.683666 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f91b1-48af-41a4-83d2-5926295091d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:58.683939 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f91b1-48af-41a4-83d2-5926295091d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:58.684204 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f91b1-48af-41a4-83d2-5926295091d6 admin admin] PATH_INFO: `/v3/projects/877519a0fdd54280a904a0a2c3b9a4b5/users/af54b76076bc42968f584addd3c822f5/roles/fb48693810be495fb4b1893a79429b78` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:58.686150 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742f91b1-48af-41a4-83d2-5926295091d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=877519a0fdd54280a904a0a2c3b9a4b5, user_id=af54b76076bc42968f584addd3c822f5, role_id=fb48693810be495fb4b1893a79429b78)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:40:58.688822 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742f91b1-48af-41a4-83d2-5926295091d6 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:40:58.699304 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1421/2861] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:40:58 2022] PUT /identity/v3/projects/877519a0fdd54280a904a0a2c3b9a4b5/users/af54b76076bc42968f584addd3c822f5/roles/fb48693810be495fb4b1893a79429b78 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:40:58.709932 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a021ce-6aa5-495f-b981-2a45e11d1140 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:58.710231 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a021ce-6aa5-495f-b981-2a45e11d1140 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:58.710507 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a021ce-6aa5-495f-b981-2a45e11d1140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:58.740268 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-46a021ce-6aa5-495f-b981-2a45e11d1140 None None] MFA Rules not processed for user `af54b76076bc42968f584addd3c822f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:40:58.741525 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-46a021ce-6aa5-495f-b981-2a45e11d1140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:40:58.815134 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1441/2862] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:40:58 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:40:58.828146 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f91b1-48af-41a4-83d2-5926295091d6 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:40:58.830039 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-742f91b1-48af-41a4-83d2-5926295091d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:40:58.888914 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f91b1-48af-41a4-83d2-5926295091d6 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:40:58.892527 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2416d853-66b1-49c0-bd28-6d6289a85c7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7853d40c29af424c8d7913950d89750b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:40:58.893126 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416d853-66b1-49c0-bd28-6d6289a85c7f service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:58.893397 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416d853-66b1-49c0-bd28-6d6289a85c7f service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:58.893658 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416d853-66b1-49c0-bd28-6d6289a85c7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:58.903320 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2416d853-66b1-49c0-bd28-6d6289a85c7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:40:58.904786 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2416d853-66b1-49c0-bd28-6d6289a85c7f service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:40:58.914170 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1422/2863] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:40:58 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:40:59.310545 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a021ce-6aa5-495f-b981-2a45e11d1140 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:40:59.391064 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a021ce-6aa5-495f-b981-2a45e11d1140 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:40:59.397038 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a427f713-acda-45a5-8214-3ecd401adc5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:40:59.397696 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a427f713-acda-45a5-8214-3ecd401adc5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:59.397969 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a427f713-acda-45a5-8214-3ecd401adc5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:59.398272 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a427f713-acda-45a5-8214-3ecd401adc5c admin admin] PATH_INFO: `/v3/users/125fe95e4af54539a684c04b2fd18daf` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:59.399555 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a427f713-acda-45a5-8214-3ecd401adc5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=125fe95e4af54539a684c04b2fd18daf)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:40:59.401521 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a427f713-acda-45a5-8214-3ecd401adc5c admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:40:59.458519 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-a427f713-acda-45a5-8214-3ecd401adc5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '125fe95e4af54539a684c04b2fd18daf'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:40:59.468503 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-a427f713-acda-45a5-8214-3ecd401adc5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '125fe95e4af54539a684c04b2fd18daf'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:40:59.469234 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-a427f713-acda-45a5-8214-3ecd401adc5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '125fe95e4af54539a684c04b2fd18daf'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:40:59.476711 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-a427f713-acda-45a5-8214-3ecd401adc5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '125fe95e4af54539a684c04b2fd18daf'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:40:59.491724 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-a427f713-acda-45a5-8214-3ecd401adc5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '125fe95e4af54539a684c04b2fd18daf'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:40:59.498644 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1442/2864] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:40:59 2022] DELETE /identity/v3/users/125fe95e4af54539a684c04b2fd18daf => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:40:59.503083 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecccb447-11ac-4939-9b2e-918940510a73 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:59.503568 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecccb447-11ac-4939-9b2e-918940510a73 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:59.503691 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecccb447-11ac-4939-9b2e-918940510a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:59.523434 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-ecccb447-11ac-4939-9b2e-918940510a73 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:40:59.524617 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-ecccb447-11ac-4939-9b2e-918940510a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:40:59.592836 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1423/2865] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:40:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:40:59.603468 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a427f713-acda-45a5-8214-3ecd401adc5c admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:40:59.605701 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-a427f713-acda-45a5-8214-3ecd401adc5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:40:59.613637 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:40:59.670668 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a427f713-acda-45a5-8214-3ecd401adc5c admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:40:59.675283 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8ac64e-47af-4d5a-9bbf-b02f843c9c5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:40:59.675904 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ac64e-47af-4d5a-9bbf-b02f843c9c5a service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:40:59.676177 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ac64e-47af-4d5a-9bbf-b02f843c9c5a service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:40:59.676446 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ac64e-47af-4d5a-9bbf-b02f843c9c5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:40:59.686394 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8ac64e-47af-4d5a-9bbf-b02f843c9c5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:40:59.687852 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8ac64e-47af-4d5a-9bbf-b02f843c9c5a service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:40:59.696972 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1443/2866] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:40:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:40:59.979889 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecccb447-11ac-4939-9b2e-918940510a73 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:40:59.981493 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-ecccb447-11ac-4939-9b2e-918940510a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:40:59.995459 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecccb447-11ac-4939-9b2e-918940510a73 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:41:00.001847 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9b78ad-f14d-46cc-9811-3f0556a5c31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:41:00.002563 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b78ad-f14d-46cc-9811-3f0556a5c31f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:41:00.002840 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b78ad-f14d-46cc-9811-3f0556a5c31f admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:41:00.003096 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b78ad-f14d-46cc-9811-3f0556a5c31f admin admin] PATH_INFO: `/v3/projects/016ca38350714afaae838102612e6ef7` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:41:00.005355 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9b78ad-f14d-46cc-9811-3f0556a5c31f admin admin] RBAC: Authorizing `identity:delete_project(project_id=016ca38350714afaae838102612e6ef7)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:41:00.007404 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9b78ad-f14d-46cc-9811-3f0556a5c31f admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:41:00.058084 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-df9b78ad-f14d-46cc-9811-3f0556a5c31f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '016ca38350714afaae838102612e6ef7', 'request_id': 'req-df9b78ad-f14d-46cc-9811-3f0556a5c31f'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:41:00.067093 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-df9b78ad-f14d-46cc-9811-3f0556a5c31f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '016ca38350714afaae838102612e6ef7', 'request_id': 'req-df9b78ad-f14d-46cc-9811-3f0556a5c31f'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:41:00.073490 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-df9b78ad-f14d-46cc-9811-3f0556a5c31f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '016ca38350714afaae838102612e6ef7', 'request_id': 'req-df9b78ad-f14d-46cc-9811-3f0556a5c31f'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:41:00.082125 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:41:00.086367 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-df9b78ad-f14d-46cc-9811-3f0556a5c31f admin admin] The token cache is being invalidate because project 016ca38350714afaae838102612e6ef7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:41:00.087044 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-df9b78ad-f14d-46cc-9811-3f0556a5c31f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:41:00.087721 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-df9b78ad-f14d-46cc-9811-3f0556a5c31f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:41:00.089416 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1424/2867] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:40:59 2022] DELETE /identity/v3/projects/016ca38350714afaae838102612e6ef7 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:41:00.093949 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8ac64e-47af-4d5a-9bbf-b02f843c9c5a service neutron] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:41:00.103815 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8ac64e-47af-4d5a-9bbf-b02f843c9c5a service neutron] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:41:00.166503 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dc4932-db2b-42ea-a2f0-e5dd602e7063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:41:00.167159 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc4932-db2b-42ea-a2f0-e5dd602e7063 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:41:00.167435 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc4932-db2b-42ea-a2f0-e5dd602e7063 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:41:00.167705 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc4932-db2b-42ea-a2f0-e5dd602e7063 admin admin] PATH_INFO: `/v3/users/af54b76076bc42968f584addd3c822f5` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:41:00.168849 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dc4932-db2b-42ea-a2f0-e5dd602e7063 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af54b76076bc42968f584addd3c822f5)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:41:00.170907 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dc4932-db2b-42ea-a2f0-e5dd602e7063 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:41:00.218513 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-46dc4932-db2b-42ea-a2f0-e5dd602e7063 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af54b76076bc42968f584addd3c822f5'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:41:00.226739 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-46dc4932-db2b-42ea-a2f0-e5dd602e7063 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af54b76076bc42968f584addd3c822f5'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:41:00.227354 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-46dc4932-db2b-42ea-a2f0-e5dd602e7063 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af54b76076bc42968f584addd3c822f5'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:41:00.234686 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-46dc4932-db2b-42ea-a2f0-e5dd602e7063 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af54b76076bc42968f584addd3c822f5'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:41:00.251514 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-46dc4932-db2b-42ea-a2f0-e5dd602e7063 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af54b76076bc42968f584addd3c822f5'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:41:00.260467 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1444/2868] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:41:00 2022] DELETE /identity/v3/users/af54b76076bc42968f584addd3c822f5 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:41:00.561814 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9b78ad-f14d-46cc-9811-3f0556a5c31f admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:41:00.563465 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-df9b78ad-f14d-46cc-9811-3f0556a5c31f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:41:00.576312 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9b78ad-f14d-46cc-9811-3f0556a5c31f admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:41:00.639658 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209f038c-ffe9-4f58-be74-81b8374847f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:41:00.640297 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f038c-ffe9-4f58-be74-81b8374847f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:41:00.641029 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f038c-ffe9-4f58-be74-81b8374847f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:41:00.641308 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f038c-ffe9-4f58-be74-81b8374847f0 admin admin] PATH_INFO: `/v3/projects/877519a0fdd54280a904a0a2c3b9a4b5` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:41:00.642612 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209f038c-ffe9-4f58-be74-81b8374847f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=877519a0fdd54280a904a0a2c3b9a4b5)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:41:00.644517 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209f038c-ffe9-4f58-be74-81b8374847f0 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:41:00.692301 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-209f038c-ffe9-4f58-be74-81b8374847f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '877519a0fdd54280a904a0a2c3b9a4b5', 'request_id': 'req-209f038c-ffe9-4f58-be74-81b8374847f0'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:41:00.703130 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-209f038c-ffe9-4f58-be74-81b8374847f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '877519a0fdd54280a904a0a2c3b9a4b5', 'request_id': 'req-209f038c-ffe9-4f58-be74-81b8374847f0'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:41:00.708770 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-209f038c-ffe9-4f58-be74-81b8374847f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '877519a0fdd54280a904a0a2c3b9a4b5', 'request_id': 'req-209f038c-ffe9-4f58-be74-81b8374847f0'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:41:00.721613 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-209f038c-ffe9-4f58-be74-81b8374847f0 admin admin] The token cache is being invalidate because project 877519a0fdd54280a904a0a2c3b9a4b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:41:00.721871 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-209f038c-ffe9-4f58-be74-81b8374847f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:41:00.722761 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-209f038c-ffe9-4f58-be74-81b8374847f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:41:00.724499 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1425/2869] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:41:00 2022] DELETE /identity/v3/projects/877519a0fdd54280a904a0a2c3b9a4b5 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:41:00.729652 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24874dd-a270-4b57-b467-35c4434fc451 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:41:00.730182 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24874dd-a270-4b57-b467-35c4434fc451 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:41:00.730182 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24874dd-a270-4b57-b467-35c4434fc451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:41:00.755544 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-e24874dd-a270-4b57-b467-35c4434fc451 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:41:00.756748 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-e24874dd-a270-4b57-b467-35c4434fc451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:41:00.779825 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:41:00.820765 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1445/2870] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:41:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:41:00.829026 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e208517-b282-494d-9377-048ca8c7995c None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:41:00.829307 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e208517-b282-494d-9377-048ca8c7995c None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:41:00.829577 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e208517-b282-494d-9377-048ca8c7995c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:41:00.849781 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-8e208517-b282-494d-9377-048ca8c7995c None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:41:00.850955 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-8e208517-b282-494d-9377-048ca8c7995c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:41:00.859511 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1426/2871] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:41:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:41:00.863832 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24874dd-a270-4b57-b467-35c4434fc451 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:41:00.874645 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24874dd-a270-4b57-b467-35c4434fc451 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:41:00.880233 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4c4a32-0b4e-411f-a234-9dfd53df9ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:41:00.880888 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c4a32-0b4e-411f-a234-9dfd53df9ef8 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:41:00.881160 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c4a32-0b4e-411f-a234-9dfd53df9ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:41:00.881394 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c4a32-0b4e-411f-a234-9dfd53df9ef8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:41:00.882055 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4c4a32-0b4e-411f-a234-9dfd53df9ef8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:41:00.882378 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4c4a32-0b4e-411f-a234-9dfd53df9ef8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:41:00.883968 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4c4a32-0b4e-411f-a234-9dfd53df9ef8 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:41:00.896477 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1446/2872] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 01:41:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:41:00.900914 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e208517-b282-494d-9377-048ca8c7995c None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:41:00.910310 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e208517-b282-494d-9377-048ca8c7995c None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:41:00.915128 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6577fe19-f977-4e9d-a3c0-574c7f4df9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:41:00.915725 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6577fe19-f977-4e9d-a3c0-574c7f4df9bd admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:41:00.915996 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6577fe19-f977-4e9d-a3c0-574c7f4df9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:41:00.916261 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6577fe19-f977-4e9d-a3c0-574c7f4df9bd admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:41:00.916873 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6577fe19-f977-4e9d-a3c0-574c7f4df9bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:41:00.918817 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6577fe19-f977-4e9d-a3c0-574c7f4df9bd admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:41:00.949742 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1427/2873] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:41:00 2022] POST /identity/v3/projects => generated 361 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:41:00.954249 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4c4a32-0b4e-411f-a234-9dfd53df9ef8 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:41:00.964940 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4c4a32-0b4e-411f-a234-9dfd53df9ef8 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:41:01.028509 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d55e36f-2c60-4f24-89ef-687d1eda3e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:41:01.029117 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d55e36f-2c60-4f24-89ef-687d1eda3e8c admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:41:01.029393 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d55e36f-2c60-4f24-89ef-687d1eda3e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:41:01.029661 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d55e36f-2c60-4f24-89ef-687d1eda3e8c admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:41:01.030334 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d55e36f-2c60-4f24-89ef-687d1eda3e8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:41:01.032577 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d55e36f-2c60-4f24-89ef-687d1eda3e8c admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:41:01.054870 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1447/2874] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:41:00 2022] POST /identity/v3/users => generated 281 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:41:01.059791 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6577fe19-f977-4e9d-a3c0-574c7f4df9bd admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:41:01.077374 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6577fe19-f977-4e9d-a3c0-574c7f4df9bd admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:41:01.083673 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb34cfde-d402-443d-a96c-e9eeae394cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:41:01.084275 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34cfde-d402-443d-a96c-e9eeae394cf8 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:41:01.084549 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34cfde-d402-443d-a96c-e9eeae394cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:41:01.084814 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34cfde-d402-443d-a96c-e9eeae394cf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:41:01.085461 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb34cfde-d402-443d-a96c-e9eeae394cf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:41:01.087111 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb34cfde-d402-443d-a96c-e9eeae394cf8 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:41:01.099332 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1428/2875] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:41:01 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:41:01.105818 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d55e36f-2c60-4f24-89ef-687d1eda3e8c admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:41:01.117217 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d55e36f-2c60-4f24-89ef-687d1eda3e8c admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:41:01.123073 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5723228-a87b-4a48-8f40-7ba2e3b08209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:41:01.123671 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5723228-a87b-4a48-8f40-7ba2e3b08209 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:41:01.123946 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5723228-a87b-4a48-8f40-7ba2e3b08209 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:41:01.124209 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5723228-a87b-4a48-8f40-7ba2e3b08209 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:41:01.125476 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5723228-a87b-4a48-8f40-7ba2e3b08209 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:41:01.127361 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5723228-a87b-4a48-8f40-7ba2e3b08209 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:41:01.138419 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1448/2876] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:41:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:41:01.144415 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb34cfde-d402-443d-a96c-e9eeae394cf8 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:41:01.161142 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb34cfde-d402-443d-a96c-e9eeae394cf8 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:41:01.170594 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1b243d-2f0c-4482-9bfd-0c48b927b18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:41:01.171603 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b243d-2f0c-4482-9bfd-0c48b927b18f admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:41:01.172018 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b243d-2f0c-4482-9bfd-0c48b927b18f admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:41:01.172296 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b243d-2f0c-4482-9bfd-0c48b927b18f admin admin] PATH_INFO: `/v3/projects/87e1999cdca44dc4aab6112369733b10/users/f1ca07ff40d048feab4d8bca87a6cc43/roles/13af81971c1c428eae0a571a22ea583d` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:41:01.188930 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1b243d-2f0c-4482-9bfd-0c48b927b18f admin admin] RBAC: Authorizing `identity:create_grant(project_id=87e1999cdca44dc4aab6112369733b10, user_id=f1ca07ff40d048feab4d8bca87a6cc43, role_id=13af81971c1c428eae0a571a22ea583d)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:41:01.191646 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1b243d-2f0c-4482-9bfd-0c48b927b18f admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:41:01.207169 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1429/2877] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:41:01 2022] PUT /identity/v3/projects/87e1999cdca44dc4aab6112369733b10/users/f1ca07ff40d048feab4d8bca87a6cc43/roles/13af81971c1c428eae0a571a22ea583d => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 12 01:41:01.219186 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e435f876-8a53-404d-85d4-07b4b073de7a None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:41:01.219465 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e435f876-8a53-404d-85d4-07b4b073de7a None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:41:01.219735 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e435f876-8a53-404d-85d4-07b4b073de7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:41:01.250215 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-e435f876-8a53-404d-85d4-07b4b073de7a None None] MFA Rules not processed for user `f1ca07ff40d048feab4d8bca87a6cc43`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:41:01.251437 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-e435f876-8a53-404d-85d4-07b4b073de7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:41:01.320397 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1449/2878] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:41:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:41:01.355239 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1b243d-2f0c-4482-9bfd-0c48b927b18f admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:41:01.357475 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-0a1b243d-2f0c-4482-9bfd-0c48b927b18f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:41:01.393023 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:41:01.421649 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1b243d-2f0c-4482-9bfd-0c48b927b18f admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:41:01.426786 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419eab8f-ab39-4cf3-a7e2-4573b9d89b30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7853d40c29af424c8d7913950d89750b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:41:01.427384 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419eab8f-ab39-4cf3-a7e2-4573b9d89b30 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:41:01.427678 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419eab8f-ab39-4cf3-a7e2-4573b9d89b30 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:41:01.427942 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419eab8f-ab39-4cf3-a7e2-4573b9d89b30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:41:01.436616 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419eab8f-ab39-4cf3-a7e2-4573b9d89b30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:41:01.438249 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419eab8f-ab39-4cf3-a7e2-4573b9d89b30 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:41:01.446975 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1430/2879] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:41:01 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:41:01.466016 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e435f876-8a53-404d-85d4-07b4b073de7a None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:41:01.500067 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:41:01.542039 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e435f876-8a53-404d-85d4-07b4b073de7a None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:41:01.547596 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c127b02c-5024-4636-997c-e5a3208585c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:41:01.548242 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c127b02c-5024-4636-997c-e5a3208585c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:41:01.548547 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c127b02c-5024-4636-997c-e5a3208585c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:41:01.548815 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c127b02c-5024-4636-997c-e5a3208585c4 admin admin] PATH_INFO: `/v3/users/f1ca07ff40d048feab4d8bca87a6cc43` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:41:01.550101 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c127b02c-5024-4636-997c-e5a3208585c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1ca07ff40d048feab4d8bca87a6cc43)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:41:01.552169 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c127b02c-5024-4636-997c-e5a3208585c4 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:41:01.610661 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-c127b02c-5024-4636-997c-e5a3208585c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1ca07ff40d048feab4d8bca87a6cc43'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:41:01.619501 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-c127b02c-5024-4636-997c-e5a3208585c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1ca07ff40d048feab4d8bca87a6cc43'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:41:01.620141 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-c127b02c-5024-4636-997c-e5a3208585c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1ca07ff40d048feab4d8bca87a6cc43'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:41:01.627468 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-c127b02c-5024-4636-997c-e5a3208585c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1ca07ff40d048feab4d8bca87a6cc43'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:41:01.639969 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-c127b02c-5024-4636-997c-e5a3208585c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1ca07ff40d048feab4d8bca87a6cc43'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:41:01.645918 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1450/2880] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:41:01 2022] DELETE /identity/v3/users/f1ca07ff40d048feab4d8bca87a6cc43 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:41:01.650799 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10470d09-53b2-4881-a412-a81380df0e51 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:41:01.651291 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10470d09-53b2-4881-a412-a81380df0e51 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:41:01.651291 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10470d09-53b2-4881-a412-a81380df0e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:41:01.671172 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-10470d09-53b2-4881-a412-a81380df0e51 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:41:01.672640 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-10470d09-53b2-4881-a412-a81380df0e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:41:01.732544 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1431/2881] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:41:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 12 01:41:01.742709 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c127b02c-5024-4636-997c-e5a3208585c4 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:41:01.744328 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-c127b02c-5024-4636-997c-e5a3208585c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:41:01.808134 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c127b02c-5024-4636-997c-e5a3208585c4 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:41:01.812895 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f42bda-6e1f-462f-be9d-70852f8a95e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:41:01.813529 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f42bda-6e1f-462f-be9d-70852f8a95e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:41:01.813831 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f42bda-6e1f-462f-be9d-70852f8a95e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:41:01.814092 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f42bda-6e1f-462f-be9d-70852f8a95e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:41:01.827087 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f42bda-6e1f-462f-be9d-70852f8a95e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:41:01.828666 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f42bda-6e1f-462f-be9d-70852f8a95e5 service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:41:01.838931 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1451/2882] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:41:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:41:02.119768 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10470d09-53b2-4881-a412-a81380df0e51 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:41:02.121350 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-10470d09-53b2-4881-a412-a81380df0e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:41:02.136925 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10470d09-53b2-4881-a412-a81380df0e51 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:41:02.142354 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f3dced-3a5f-40d3-86e4-e179d42ae671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:41:02.143231 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f3dced-3a5f-40d3-86e4-e179d42ae671 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:41:02.143478 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f3dced-3a5f-40d3-86e4-e179d42ae671 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:41:02.143792 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f3dced-3a5f-40d3-86e4-e179d42ae671 admin admin] PATH_INFO: `/v3/projects/87e1999cdca44dc4aab6112369733b10` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:41:02.144908 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f3dced-3a5f-40d3-86e4-e179d42ae671 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87e1999cdca44dc4aab6112369733b10)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:41:02.147016 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f3dced-3a5f-40d3-86e4-e179d42ae671 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:41:02.198603 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-57f3dced-3a5f-40d3-86e4-e179d42ae671 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87e1999cdca44dc4aab6112369733b10', 'request_id': 'req-57f3dced-3a5f-40d3-86e4-e179d42ae671'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:41:02.210172 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-57f3dced-3a5f-40d3-86e4-e179d42ae671 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87e1999cdca44dc4aab6112369733b10', 'request_id': 'req-57f3dced-3a5f-40d3-86e4-e179d42ae671'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:41:02.216026 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-57f3dced-3a5f-40d3-86e4-e179d42ae671 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87e1999cdca44dc4aab6112369733b10', 'request_id': 'req-57f3dced-3a5f-40d3-86e4-e179d42ae671'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:41:02.226842 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-57f3dced-3a5f-40d3-86e4-e179d42ae671 admin admin] The token cache is being invalidate because project 87e1999cdca44dc4aab6112369733b10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:41:02.227121 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-57f3dced-3a5f-40d3-86e4-e179d42ae671 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:41:02.227845 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-57f3dced-3a5f-40d3-86e4-e179d42ae671 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:41:02.229440 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1432/2883] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:41:02 2022] DELETE /identity/v3/projects/87e1999cdca44dc4aab6112369733b10 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:41:02.234497 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9f82a-77c6-4869-a74f-74abb6de0f11 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:41:02.234805 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9f82a-77c6-4869-a74f-74abb6de0f11 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:41:02.235279 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9f82a-77c6-4869-a74f-74abb6de0f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:41:02.257923 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-aab9f82a-77c6-4869-a74f-74abb6de0f11 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:41:02.259171 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-aab9f82a-77c6-4869-a74f-74abb6de0f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:41:02.302234 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:41:02.323897 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1452/2884] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:41:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:41:02.332187 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bab062-3026-43ba-b7f1-365f7b2270d5 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:41:02.332495 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bab062-3026-43ba-b7f1-365f7b2270d5 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:41:02.332834 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bab062-3026-43ba-b7f1-365f7b2270d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:41:02.354652 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-91bab062-3026-43ba-b7f1-365f7b2270d5 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:41:02.355894 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-91bab062-3026-43ba-b7f1-365f7b2270d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:41:02.368086 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1433/2885] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:41:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:41:02.374869 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab9f82a-77c6-4869-a74f-74abb6de0f11 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:41:02.385606 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab9f82a-77c6-4869-a74f-74abb6de0f11 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:41:02.392824 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757b8238-2a15-438e-8d6d-a761cbaf0be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:41:02.393423 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757b8238-2a15-438e-8d6d-a761cbaf0be7 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:41:02.393695 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757b8238-2a15-438e-8d6d-a761cbaf0be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:41:02.393959 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757b8238-2a15-438e-8d6d-a761cbaf0be7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:41:02.394636 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757b8238-2a15-438e-8d6d-a761cbaf0be7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:41:02.394931 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757b8238-2a15-438e-8d6d-a761cbaf0be7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:41:02.396549 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757b8238-2a15-438e-8d6d-a761cbaf0be7 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:41:02.408116 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1453/2886] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 01:41:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:41:02.412531 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bab062-3026-43ba-b7f1-365f7b2270d5 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:41:02.422296 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bab062-3026-43ba-b7f1-365f7b2270d5 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:41:02.428355 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926cca5b-80c6-48cf-be3d-5c11a5c9e53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:41:02.429023 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926cca5b-80c6-48cf-be3d-5c11a5c9e53b admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:41:02.429295 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926cca5b-80c6-48cf-be3d-5c11a5c9e53b admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:41:02.429563 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926cca5b-80c6-48cf-be3d-5c11a5c9e53b admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:41:02.430228 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926cca5b-80c6-48cf-be3d-5c11a5c9e53b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:41:02.432135 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926cca5b-80c6-48cf-be3d-5c11a5c9e53b admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:41:02.470785 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1434/2887] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:41:02 2022] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 12 01:41:02.475006 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757b8238-2a15-438e-8d6d-a761cbaf0be7 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:41:02.485707 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757b8238-2a15-438e-8d6d-a761cbaf0be7 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:41:02.547401 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a2c17f-0665-4b26-932b-1c61d9d65197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:41:02.548084 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a2c17f-0665-4b26-932b-1c61d9d65197 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:41:02.548354 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a2c17f-0665-4b26-932b-1c61d9d65197 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:41:02.548625 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a2c17f-0665-4b26-932b-1c61d9d65197 admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:41:02.549279 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a2c17f-0665-4b26-932b-1c61d9d65197 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:41:02.551256 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a2c17f-0665-4b26-932b-1c61d9d65197 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:41:02.576758 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1454/2888] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:41:02 2022] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:41:02.581413 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926cca5b-80c6-48cf-be3d-5c11a5c9e53b admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:41:02.592390 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926cca5b-80c6-48cf-be3d-5c11a5c9e53b admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:41:02.598147 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba37155f-d757-4522-9aa2-e4a1fb95caf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:41:02.598762 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba37155f-d757-4522-9aa2-e4a1fb95caf9 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:41:02.599042 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba37155f-d757-4522-9aa2-e4a1fb95caf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:41:02.599310 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba37155f-d757-4522-9aa2-e4a1fb95caf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:41:02.599951 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba37155f-d757-4522-9aa2-e4a1fb95caf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:41:02.601574 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba37155f-d757-4522-9aa2-e4a1fb95caf9 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:41:02.611631 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1435/2889] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:41:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:41:02.616280 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a2c17f-0665-4b26-932b-1c61d9d65197 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:41:02.627262 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a2c17f-0665-4b26-932b-1c61d9d65197 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:41:02.633874 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe224440-d8f4-49ef-a344-b8d9dc75126a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:41:02.634501 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe224440-d8f4-49ef-a344-b8d9dc75126a admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:41:02.634770 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe224440-d8f4-49ef-a344-b8d9dc75126a admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:41:02.635034 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe224440-d8f4-49ef-a344-b8d9dc75126a admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:41:02.635681 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe224440-d8f4-49ef-a344-b8d9dc75126a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:41:02.637299 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe224440-d8f4-49ef-a344-b8d9dc75126a admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:41:02.649580 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1455/2890] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:41:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:41:02.653778 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba37155f-d757-4522-9aa2-e4a1fb95caf9 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:41:02.664503 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba37155f-d757-4522-9aa2-e4a1fb95caf9 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:41:02.670152 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4dc690-2cc6-41b8-abc6-b3e351d1f5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:41:02.670834 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4dc690-2cc6-41b8-abc6-b3e351d1f5ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:41:02.671104 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4dc690-2cc6-41b8-abc6-b3e351d1f5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:41:02.671366 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4dc690-2cc6-41b8-abc6-b3e351d1f5ca admin admin] PATH_INFO: `/v3/projects/d3b4593bc0c742d9a24e7d4205d76d07/users/20904a0a26fa49929fa7e69ae1b46691/roles/13af81971c1c428eae0a571a22ea583d` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:41:02.683343 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:41:02.687725 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4dc690-2cc6-41b8-abc6-b3e351d1f5ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3b4593bc0c742d9a24e7d4205d76d07, user_id=20904a0a26fa49929fa7e69ae1b46691, role_id=13af81971c1c428eae0a571a22ea583d)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:41:02.691227 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4dc690-2cc6-41b8-abc6-b3e351d1f5ca admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:41:02.708360 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1436/2891] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:41:02 2022] PUT /identity/v3/projects/d3b4593bc0c742d9a24e7d4205d76d07/users/20904a0a26fa49929fa7e69ae1b46691/roles/13af81971c1c428eae0a571a22ea583d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:41:02.720120 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843fb455-48ed-4a7c-955e-f57efbc5a3a7 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:41:02.720474 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843fb455-48ed-4a7c-955e-f57efbc5a3a7 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:41:02.720754 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843fb455-48ed-4a7c-955e-f57efbc5a3a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:41:02.748830 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-843fb455-48ed-4a7c-955e-f57efbc5a3a7 None None] MFA Rules not processed for user `20904a0a26fa49929fa7e69ae1b46691`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:41:02.750029 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-843fb455-48ed-4a7c-955e-f57efbc5a3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:41:02.818174 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1456/2892] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:41:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:41:02.831887 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4dc690-2cc6-41b8-abc6-b3e351d1f5ca admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:41:02.833890 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-fb4dc690-2cc6-41b8-abc6-b3e351d1f5ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:41:02.904393 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4dc690-2cc6-41b8-abc6-b3e351d1f5ca admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:41:02.910215 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed1023-7267-4fa1-9265-50642526c102 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7853d40c29af424c8d7913950d89750b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:41:02.910835 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed1023-7267-4fa1-9265-50642526c102 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:41:02.911106 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed1023-7267-4fa1-9265-50642526c102 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:41:02.911367 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed1023-7267-4fa1-9265-50642526c102 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:41:02.919932 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeed1023-7267-4fa1-9265-50642526c102 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:41:02.921360 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeed1023-7267-4fa1-9265-50642526c102 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:41:02.930248 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1437/2893] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:41:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:41:12.814973 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=79,keystone:INSERT=3 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:41:12.926510 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:41:14.596883 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843fb455-48ed-4a7c-955e-f57efbc5a3a7 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:41:14.675326 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843fb455-48ed-4a7c-955e-f57efbc5a3a7 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:41:14.682526 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc86d5-0a20-4df2-9096-0da9799a1c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:41:14.683160 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc86d5-0a20-4df2-9096-0da9799a1c73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:41:14.683432 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc86d5-0a20-4df2-9096-0da9799a1c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:41:14.683715 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc86d5-0a20-4df2-9096-0da9799a1c73 admin admin] PATH_INFO: `/v3/users/20904a0a26fa49929fa7e69ae1b46691` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:41:14.684967 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bc86d5-0a20-4df2-9096-0da9799a1c73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20904a0a26fa49929fa7e69ae1b46691)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:41:14.686955 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bc86d5-0a20-4df2-9096-0da9799a1c73 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:41:14.740786 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-43bc86d5-0a20-4df2-9096-0da9799a1c73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20904a0a26fa49929fa7e69ae1b46691'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:41:14.749168 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-43bc86d5-0a20-4df2-9096-0da9799a1c73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20904a0a26fa49929fa7e69ae1b46691'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:41:14.749821 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-43bc86d5-0a20-4df2-9096-0da9799a1c73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20904a0a26fa49929fa7e69ae1b46691'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:41:14.759040 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-43bc86d5-0a20-4df2-9096-0da9799a1c73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20904a0a26fa49929fa7e69ae1b46691'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:41:14.773470 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-43bc86d5-0a20-4df2-9096-0da9799a1c73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20904a0a26fa49929fa7e69ae1b46691'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:41:14.782543 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1457/2894] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:41:14 2022] DELETE /identity/v3/users/20904a0a26fa49929fa7e69ae1b46691 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:41:14.789401 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb9e853-ae29-429f-a5bd-1ac27e767be9 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:41:14.789918 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb9e853-ae29-429f-a5bd-1ac27e767be9 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:41:14.789918 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb9e853-ae29-429f-a5bd-1ac27e767be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:41:14.809469 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-edb9e853-ae29-429f-a5bd-1ac27e767be9 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:41:14.810733 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-edb9e853-ae29-429f-a5bd-1ac27e767be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:41:14.871810 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1438/2895] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:41:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:41:14.881643 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc86d5-0a20-4df2-9096-0da9799a1c73 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:41:14.883181 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-43bc86d5-0a20-4df2-9096-0da9799a1c73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:41:14.941609 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc86d5-0a20-4df2-9096-0da9799a1c73 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:41:14.945707 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e48d2d2-d4ba-478d-985a-cc5fffc7f001 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:41:14.946347 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48d2d2-d4ba-478d-985a-cc5fffc7f001 service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:41:14.946622 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48d2d2-d4ba-478d-985a-cc5fffc7f001 service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:41:14.946893 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48d2d2-d4ba-478d-985a-cc5fffc7f001 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:41:14.956454 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e48d2d2-d4ba-478d-985a-cc5fffc7f001 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:41:14.957877 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e48d2d2-d4ba-478d-985a-cc5fffc7f001 service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:41:14.967351 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1458/2896] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:41:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:41:15.255377 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb9e853-ae29-429f-a5bd-1ac27e767be9 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:41:15.257058 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-edb9e853-ae29-429f-a5bd-1ac27e767be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:41:15.272420 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb9e853-ae29-429f-a5bd-1ac27e767be9 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:41:15.279313 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0438015a-0cd2-4b33-8adc-b26a4212d9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:41:15.280042 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0438015a-0cd2-4b33-8adc-b26a4212d9cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:41:15.280148 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0438015a-0cd2-4b33-8adc-b26a4212d9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:41:15.280409 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0438015a-0cd2-4b33-8adc-b26a4212d9cd admin admin] PATH_INFO: `/v3/projects/d3b4593bc0c742d9a24e7d4205d76d07` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:41:15.281617 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0438015a-0cd2-4b33-8adc-b26a4212d9cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3b4593bc0c742d9a24e7d4205d76d07)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:41:15.283655 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0438015a-0cd2-4b33-8adc-b26a4212d9cd admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:41:15.331727 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-0438015a-0cd2-4b33-8adc-b26a4212d9cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3b4593bc0c742d9a24e7d4205d76d07', 'request_id': 'req-0438015a-0cd2-4b33-8adc-b26a4212d9cd'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:41:15.342782 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-0438015a-0cd2-4b33-8adc-b26a4212d9cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3b4593bc0c742d9a24e7d4205d76d07', 'request_id': 'req-0438015a-0cd2-4b33-8adc-b26a4212d9cd'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:41:15.352016 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-0438015a-0cd2-4b33-8adc-b26a4212d9cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3b4593bc0c742d9a24e7d4205d76d07', 'request_id': 'req-0438015a-0cd2-4b33-8adc-b26a4212d9cd'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:41:15.369366 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-0438015a-0cd2-4b33-8adc-b26a4212d9cd admin admin] The token cache is being invalidate because project d3b4593bc0c742d9a24e7d4205d76d07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:41:15.369653 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-0438015a-0cd2-4b33-8adc-b26a4212d9cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:41:15.370398 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-0438015a-0cd2-4b33-8adc-b26a4212d9cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:41:15.372048 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1439/2897] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:41:15 2022] DELETE /identity/v3/projects/d3b4593bc0c742d9a24e7d4205d76d07 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:41:15.377046 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c951d03-a060-4acc-9902-9b33db862b42 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:41:15.377331 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c951d03-a060-4acc-9902-9b33db862b42 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:41:15.377599 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c951d03-a060-4acc-9902-9b33db862b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:41:15.398851 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-2c951d03-a060-4acc-9902-9b33db862b42 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:41:15.400063 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-2c951d03-a060-4acc-9902-9b33db862b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:41:15.418333 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:41:15.462957 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1459/2898] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:41:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:41:15.471112 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9870eb6-3eea-410e-8ec3-3d8267a8f134 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:41:15.471424 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9870eb6-3eea-410e-8ec3-3d8267a8f134 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:41:15.471688 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9870eb6-3eea-410e-8ec3-3d8267a8f134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:41:15.493953 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-d9870eb6-3eea-410e-8ec3-3d8267a8f134 None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:41:15.495219 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d9870eb6-3eea-410e-8ec3-3d8267a8f134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:41:15.503139 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1440/2899] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:41:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:41:15.508065 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c951d03-a060-4acc-9902-9b33db862b42 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:41:15.518459 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c951d03-a060-4acc-9902-9b33db862b42 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:41:15.523789 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee83ba8-bf65-4d1c-854f-ab133a460c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:41:15.524384 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee83ba8-bf65-4d1c-854f-ab133a460c15 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:41:15.524628 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee83ba8-bf65-4d1c-854f-ab133a460c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:41:15.524912 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee83ba8-bf65-4d1c-854f-ab133a460c15 admin admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:41:15.525560 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee83ba8-bf65-4d1c-854f-ab133a460c15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 12 01:41:15.525861 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee83ba8-bf65-4d1c-854f-ab133a460c15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:41:15.527504 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee83ba8-bf65-4d1c-854f-ab133a460c15 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:41:15.539073 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1460/2900] 10.222.0.26 () {58 vars in 1153 bytes} [Fri Aug 12 01:41:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 12 01:41:15.543334 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9870eb6-3eea-410e-8ec3-3d8267a8f134 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:41:15.552655 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9870eb6-3eea-410e-8ec3-3d8267a8f134 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:41:15.557568 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874e6066-6a21-4754-8a0d-7056a8b49a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:41:15.558198 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e6066-6a21-4754-8a0d-7056a8b49a98 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:41:15.558473 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e6066-6a21-4754-8a0d-7056a8b49a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:41:15.558738 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e6066-6a21-4754-8a0d-7056a8b49a98 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:41:15.559361 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874e6066-6a21-4754-8a0d-7056a8b49a98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:41:15.561253 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874e6066-6a21-4754-8a0d-7056a8b49a98 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:41:15.590853 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1441/2901] 10.222.0.26 () {60 vars in 1153 bytes} [Fri Aug 12 01:41:15 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:41:15.595018 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee83ba8-bf65-4d1c-854f-ab133a460c15 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:41:15.605738 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee83ba8-bf65-4d1c-854f-ab133a460c15 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:41:15.662854 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4ff1f6-6363-4d56-b57b-7697f57a688d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:41:15.663375 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ff1f6-6363-4d56-b57b-7697f57a688d admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:41:15.663799 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ff1f6-6363-4d56-b57b-7697f57a688d admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:41:15.664341 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ff1f6-6363-4d56-b57b-7697f57a688d admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:41:15.664873 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4ff1f6-6363-4d56-b57b-7697f57a688d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:41:15.666815 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4ff1f6-6363-4d56-b57b-7697f57a688d admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:41:15.688961 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1461/2902] 10.222.0.26 () {60 vars in 1144 bytes} [Fri Aug 12 01:41:15 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 12 01:41:15.693348 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874e6066-6a21-4754-8a0d-7056a8b49a98 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:41:15.704839 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874e6066-6a21-4754-8a0d-7056a8b49a98 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:41:15.709800 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4471eb6-9faf-4c57-ae2c-655c49a184c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:41:15.710434 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4471eb6-9faf-4c57-ae2c-655c49a184c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:41:15.710722 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4471eb6-9faf-4c57-ae2c-655c49a184c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:41:15.710988 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4471eb6-9faf-4c57-ae2c-655c49a184c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:41:15.711676 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4471eb6-9faf-4c57-ae2c-655c49a184c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:41:15.713276 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4471eb6-9faf-4c57-ae2c-655c49a184c9 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:41:15.723672 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1442/2903] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:41:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 12 01:41:15.728372 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4ff1f6-6363-4d56-b57b-7697f57a688d admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:41:15.738607 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4ff1f6-6363-4d56-b57b-7697f57a688d admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:41:15.743520 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e6241-8cc7-4dc1-ae51-71eeeda31c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:41:15.744112 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e6241-8cc7-4dc1-ae51-71eeeda31c99 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:41:15.744390 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e6241-8cc7-4dc1-ae51-71eeeda31c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:41:15.744654 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e6241-8cc7-4dc1-ae51-71eeeda31c99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:41:15.745326 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2e6241-8cc7-4dc1-ae51-71eeeda31c99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:41:15.746965 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2e6241-8cc7-4dc1-ae51-71eeeda31c99 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:41:15.757961 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1462/2904] 10.222.0.26 () {58 vars in 1122 bytes} [Fri Aug 12 01:41:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 12 01:41:15.762111 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4471eb6-9faf-4c57-ae2c-655c49a184c9 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:41:15.772403 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4471eb6-9faf-4c57-ae2c-655c49a184c9 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:41:15.777123 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c79c68b-6f5c-4434-a741-93cea4b0f102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:41:15.777767 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c79c68b-6f5c-4434-a741-93cea4b0f102 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:41:15.778041 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c79c68b-6f5c-4434-a741-93cea4b0f102 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:41:15.778347 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c79c68b-6f5c-4434-a741-93cea4b0f102 admin admin] PATH_INFO: `/v3/projects/9a6e9acaf86a4108aa14e0a86e540c06/users/b0b37d229b9d45babc47c539b4f32fea/roles/13af81971c1c428eae0a571a22ea583d` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:41:15.793333 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c79c68b-6f5c-4434-a741-93cea4b0f102 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a6e9acaf86a4108aa14e0a86e540c06, user_id=b0b37d229b9d45babc47c539b4f32fea, role_id=13af81971c1c428eae0a571a22ea583d)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:41:15.796073 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c79c68b-6f5c-4434-a741-93cea4b0f102 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:41:15.811595 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1443/2905] 10.222.0.26 () {60 vars in 1483 bytes} [Fri Aug 12 01:41:15 2022] PUT /identity/v3/projects/9a6e9acaf86a4108aa14e0a86e540c06/users/b0b37d229b9d45babc47c539b4f32fea/roles/13af81971c1c428eae0a571a22ea583d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:41:15.822151 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53feebc-6252-42c3-9180-b2ef9fb29f27 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:41:15.822504 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53feebc-6252-42c3-9180-b2ef9fb29f27 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:41:15.822774 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53feebc-6252-42c3-9180-b2ef9fb29f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:41:15.852652 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-e53feebc-6252-42c3-9180-b2ef9fb29f27 None None] MFA Rules not processed for user `b0b37d229b9d45babc47c539b4f32fea`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:41:15.853872 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-e53feebc-6252-42c3-9180-b2ef9fb29f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:41:15.921658 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1463/2906] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:41:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:41:15.933385 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c79c68b-6f5c-4434-a741-93cea4b0f102 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:41:15.935121 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-9c79c68b-6f5c-4434-a741-93cea4b0f102 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:41:15.957756 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:41:15.994226 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c79c68b-6f5c-4434-a741-93cea4b0f102 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:41:15.997763 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da24aec7-7742-4278-a675-2edcdbb65ab9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7853d40c29af424c8d7913950d89750b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:41:15.998392 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24aec7-7742-4278-a675-2edcdbb65ab9 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:41:15.998668 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24aec7-7742-4278-a675-2edcdbb65ab9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:41:15.998938 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24aec7-7742-4278-a675-2edcdbb65ab9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:41:16.007505 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da24aec7-7742-4278-a675-2edcdbb65ab9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:41:16.008858 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da24aec7-7742-4278-a675-2edcdbb65ab9 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:41:16.017659 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1444/2907] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:41:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:41:25.918780 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:41:26.014047 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=17 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:41:26.321641 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53feebc-6252-42c3-9180-b2ef9fb29f27 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:41:26.389210 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53feebc-6252-42c3-9180-b2ef9fb29f27 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:41:26.394219 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2476536a-b333-40fa-95ca-bb286359d295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:41:26.394846 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2476536a-b333-40fa-95ca-bb286359d295 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:41:26.395119 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2476536a-b333-40fa-95ca-bb286359d295 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:41:26.395384 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2476536a-b333-40fa-95ca-bb286359d295 admin admin] PATH_INFO: `/v3/users/b0b37d229b9d45babc47c539b4f32fea` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:41:26.396818 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2476536a-b333-40fa-95ca-bb286359d295 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0b37d229b9d45babc47c539b4f32fea)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:41:26.398773 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2476536a-b333-40fa-95ca-bb286359d295 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:41:26.451303 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-2476536a-b333-40fa-95ca-bb286359d295 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0b37d229b9d45babc47c539b4f32fea'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:41:26.460940 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-2476536a-b333-40fa-95ca-bb286359d295 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0b37d229b9d45babc47c539b4f32fea'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:41:26.461566 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-2476536a-b333-40fa-95ca-bb286359d295 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0b37d229b9d45babc47c539b4f32fea'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:41:26.468592 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-2476536a-b333-40fa-95ca-bb286359d295 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0b37d229b9d45babc47c539b4f32fea'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:41:26.482235 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-2476536a-b333-40fa-95ca-bb286359d295 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0b37d229b9d45babc47c539b4f32fea'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:41:26.488542 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1464/2908] 10.222.0.26 () {58 vars in 1224 bytes} [Fri Aug 12 01:41:26 2022] DELETE /identity/v3/users/b0b37d229b9d45babc47c539b4f32fea => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:41:26.493226 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dede19ef-9e9d-4897-a32b-4dad94322b1e None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:41:26.493511 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dede19ef-9e9d-4897-a32b-4dad94322b1e None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:41:26.493778 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dede19ef-9e9d-4897-a32b-4dad94322b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:41:26.514462 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-dede19ef-9e9d-4897-a32b-4dad94322b1e None None] MFA Rules not processed for user `7f20260f94904e78a150a9644ed5191c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 12 01:41:26.515660 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-dede19ef-9e9d-4897-a32b-4dad94322b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:41:26.580575 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1445/2909] 10.222.0.26 () {58 vars in 958 bytes} [Fri Aug 12 01:41:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 12 01:41:26.590408 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2476536a-b333-40fa-95ca-bb286359d295 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:41:26.592071 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-2476536a-b333-40fa-95ca-bb286359d295 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:41:26.656117 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2476536a-b333-40fa-95ca-bb286359d295 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:41:26.663964 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdcf9b9-0f83-4798-8feb-a81d1313b792 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a80678458dc9405285b70da707a399c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:41:26.664968 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdcf9b9-0f83-4798-8feb-a81d1313b792 service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:41:26.665415 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdcf9b9-0f83-4798-8feb-a81d1313b792 service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:41:26.665853 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdcf9b9-0f83-4798-8feb-a81d1313b792 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:41:26.681567 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdcf9b9-0f83-4798-8feb-a81d1313b792 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:41:26.683035 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdcf9b9-0f83-4798-8feb-a81d1313b792 service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:41:26.693428 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1465/2910] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:41:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:41:26.967127 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dede19ef-9e9d-4897-a32b-4dad94322b1e None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:41:26.968605 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-dede19ef-9e9d-4897-a32b-4dad94322b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:41:26.988128 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dede19ef-9e9d-4897-a32b-4dad94322b1e None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:41:26.994914 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2396fe-f2ae-405c-8c06-3a0dbdd59ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f20260f94904e78a150a9644ed5191c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f7a63ab9a434ddfb7cb138101d2e804', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:41:26.995431 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2396fe-f2ae-405c-8c06-3a0dbdd59ce4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:41:26.995701 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2396fe-f2ae-405c-8c06-3a0dbdd59ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:41:26.995962 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2396fe-f2ae-405c-8c06-3a0dbdd59ce4 admin admin] PATH_INFO: `/v3/projects/9a6e9acaf86a4108aa14e0a86e540c06` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:41:26.997165 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2396fe-f2ae-405c-8c06-3a0dbdd59ce4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a6e9acaf86a4108aa14e0a86e540c06)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:41:26.999124 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2396fe-f2ae-405c-8c06-3a0dbdd59ce4 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:41:27.051833 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-8d2396fe-f2ae-405c-8c06-3a0dbdd59ce4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a6e9acaf86a4108aa14e0a86e540c06', 'request_id': 'req-8d2396fe-f2ae-405c-8c06-3a0dbdd59ce4'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:41:27.059645 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-8d2396fe-f2ae-405c-8c06-3a0dbdd59ce4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a6e9acaf86a4108aa14e0a86e540c06', 'request_id': 'req-8d2396fe-f2ae-405c-8c06-3a0dbdd59ce4'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:41:27.065895 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-8d2396fe-f2ae-405c-8c06-3a0dbdd59ce4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a6e9acaf86a4108aa14e0a86e540c06', 'request_id': 'req-8d2396fe-f2ae-405c-8c06-3a0dbdd59ce4'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:41:27.077355 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-8d2396fe-f2ae-405c-8c06-3a0dbdd59ce4 admin admin] The token cache is being invalidate because project 9a6e9acaf86a4108aa14e0a86e540c06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 12 01:41:27.077638 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-8d2396fe-f2ae-405c-8c06-3a0dbdd59ce4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:41:27.078390 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-8d2396fe-f2ae-405c-8c06-3a0dbdd59ce4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 12 01:41:27.080020 dv-cinder-784815-15-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1446/2911] 10.222.0.26 () {58 vars in 1233 bytes} [Fri Aug 12 01:41:26 2022] DELETE /identity/v3/projects/9a6e9acaf86a4108aa14e0a86e540c06 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 12 01:41:36.688804 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:41:37.074466 dv-cinder-784815-15-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 01:44:20.064882 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdcf9b9-0f83-4798-8feb-a81d1313b792 service neutron] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 12 01:44:20.066478 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-6cdcf9b9-0f83-4798-8feb-a81d1313b792 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:44:20.139348 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdcf9b9-0f83-4798-8feb-a81d1313b792 service neutron] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 12 01:44:20.201789 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d3071-65c5-41ba-bddf-6de600788a67 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06dccf61c686414d904bdf1ecf19d53d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa91143910a74c6b896ced5b51f9966a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 12 01:44:20.202419 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d3071-65c5-41ba-bddf-6de600788a67 service placement] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 12 01:44:20.202690 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d3071-65c5-41ba-bddf-6de600788a67 service placement] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 12 01:44:20.202957 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d3071-65c5-41ba-bddf-6de600788a67 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 12 01:44:20.205121 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-b21d3071-65c5-41ba-bddf-6de600788a67 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 12 01:44:20.216467 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21d3071-65c5-41ba-bddf-6de600788a67 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 12 01:44:20.218028 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21d3071-65c5-41ba-bddf-6de600788a67 service placement] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 12 01:44:20.227972 dv-cinder-784815-15-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1466/2912] 10.222.0.26 () {60 vars in 1365 bytes} [Fri Aug 12 01:44:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 12 01:44:30.223906 dv-cinder-784815-15-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=58 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}